-- Logs begin at Sun 2022-09-11 04:50:13 UTC, end at Sun 2022-09-11 05:49:32 UTC. -- Sep 11 05:15:12.326419 dv-cinder-856921-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 11 05:15:12.336840 dv-cinder-856921-1-smb devstack@keystone.service[81371]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 11 05:15:12.340313 dv-cinder-856921-1-smb devstack@keystone.service[81371]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Sep 11 05:15:12 2022] *** Sep 11 05:15:12.340313 dv-cinder-856921-1-smb devstack@keystone.service[81371]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 11 05:15:12.340313 dv-cinder-856921-1-smb devstack@keystone.service[81371]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 11 05:15:12.340313 dv-cinder-856921-1-smb devstack@keystone.service[81371]: nodename: dv-cinder-856921-1-smb Sep 11 05:15:12.340313 dv-cinder-856921-1-smb devstack@keystone.service[81371]: machine: x86_64 Sep 11 05:15:12.340313 dv-cinder-856921-1-smb devstack@keystone.service[81371]: clock source: unix Sep 11 05:15:12.340313 dv-cinder-856921-1-smb devstack@keystone.service[81371]: pcre jit disabled Sep 11 05:15:12.340313 dv-cinder-856921-1-smb devstack@keystone.service[81371]: detected number of CPU cores: 4 Sep 11 05:15:12.340313 dv-cinder-856921-1-smb devstack@keystone.service[81371]: current working directory: / Sep 11 05:15:12.340313 dv-cinder-856921-1-smb devstack@keystone.service[81371]: detected binary path: /usr/bin/uwsgi-core Sep 11 05:15:12.340313 dv-cinder-856921-1-smb devstack@keystone.service[81371]: your processes number limit is 47680 Sep 11 05:15:12.340313 dv-cinder-856921-1-smb devstack@keystone.service[81371]: your memory page size is 4096 bytes Sep 11 05:15:12.340313 dv-cinder-856921-1-smb devstack@keystone.service[81371]: detected max file descriptor number: 2048 Sep 11 05:15:12.340313 dv-cinder-856921-1-smb devstack@keystone.service[81371]: lock engine: pthread robust mutexes Sep 11 05:15:12.341109 dv-cinder-856921-1-smb devstack@keystone.service[81371]: thunder lock: enabled Sep 11 05:15:12.341109 dv-cinder-856921-1-smb devstack@keystone.service[81371]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 11 05:15:12.341109 dv-cinder-856921-1-smb devstack@keystone.service[81371]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 11 05:15:12.380180 dv-cinder-856921-1-smb devstack@keystone.service[81371]: Python main interpreter initialized at 0x55ee38fd39c0 Sep 11 05:15:12.380180 dv-cinder-856921-1-smb devstack@keystone.service[81371]: python threads support enabled Sep 11 05:15:12.380180 dv-cinder-856921-1-smb devstack@keystone.service[81371]: your server socket listen backlog is limited to 100 connections Sep 11 05:15:12.380180 dv-cinder-856921-1-smb devstack@keystone.service[81371]: your mercy for graceful operations on workers is 90 seconds Sep 11 05:15:12.380505 dv-cinder-856921-1-smb devstack@keystone.service[81371]: mapped 403077 bytes (393 KB) for 2 cores Sep 11 05:15:12.380585 dv-cinder-856921-1-smb devstack@keystone.service[81371]: *** Operational MODE: preforking *** Sep 11 05:15:12.380851 dv-cinder-856921-1-smb devstack@keystone.service[81371]: *** uWSGI is running in multiple interpreter mode *** Sep 11 05:15:12.380851 dv-cinder-856921-1-smb devstack@keystone.service[81371]: spawned uWSGI master process (pid: 81371) Sep 11 05:15:12.381047 dv-cinder-856921-1-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 11 05:15:12.384740 dv-cinder-856921-1-smb devstack@keystone.service[81371]: spawned uWSGI worker 1 (pid: 81383, cores: 1) Sep 11 05:15:12.384740 dv-cinder-856921-1-smb devstack@keystone.service[81371]: spawned uWSGI worker 2 (pid: 81384, cores: 1) Sep 11 05:15:12.384740 dv-cinder-856921-1-smb devstack@keystone.service[81371]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 11 05:15:16.635729 dv-cinder-856921-1-smb devstack@keystone.service[81383]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 11 05:15:16.635729 dv-cinder-856921-1-smb devstack@keystone.service[81383]: from cryptography.utils import int_from_bytes Sep 11 05:15:16.636528 dv-cinder-856921-1-smb devstack@keystone.service[81383]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 11 05:15:16.636528 dv-cinder-856921-1-smb devstack@keystone.service[81383]: from cryptography.utils import int_from_bytes Sep 11 05:15:16.636651 dv-cinder-856921-1-smb devstack@keystone.service[81384]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 11 05:15:16.636651 dv-cinder-856921-1-smb devstack@keystone.service[81384]: from cryptography.utils import int_from_bytes Sep 11 05:15:16.636651 dv-cinder-856921-1-smb devstack@keystone.service[81384]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 11 05:15:16.636651 dv-cinder-856921-1-smb devstack@keystone.service[81384]: from cryptography.utils import int_from_bytes Sep 11 05:15:16.685505 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 11 05:15:16.685680 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 11 05:15:16.685772 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 11 05:15:16.685862 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] command line args: [] {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 11 05:15:16.685941 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 11 05:15:16.686115 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 11 05:15:16.686203 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] command line args: [] {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 11 05:15:16.686275 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] ================================================================================ {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 11 05:15:16.686390 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 11 05:15:16.686522 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] admin_token = **** {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:15:16.686601 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ================================================================================ {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 11 05:15:16.686763 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] config_dir = [] {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:15:16.686849 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] admin_token = **** {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:15:16.686946 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:15:16.687031 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] config_dir = [] {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:15:16.687124 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] config_source = [] {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:15:16.687208 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:15:16.687285 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] debug = True {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:15:16.687363 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] config_source = [] {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:15:16.687483 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:15:16.687746 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] debug = True {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:15:16.687746 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:15:16.687903 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:15:16.687992 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:15:16.688062 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:15:16.688229 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:15:16.688319 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:15:16.688380 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:15:16.688495 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:15:16.688628 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:15:16.688743 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] list_limit = None {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:15:16.688850 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] list_limit = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:15:16.688946 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] log_config_append = None {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:15:16.689039 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] log_config_append = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:15:16.689140 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:15:16.689241 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:15:16.689342 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] log_dir = None {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:15:16.689435 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] log_dir = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:15:16.689533 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] log_file = None {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:15:16.689628 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] log_file = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:15:16.689745 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:15:16.689825 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:15:16.689940 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:15:16.690021 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:15:16.690135 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:15:16.690215 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:15:16.690337 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:15:16.690420 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:15:16.690537 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:15:16.690612 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:15:16.690727 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:15:16.690809 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:15:16.690886 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:15:16.691000 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:15:16.691075 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:15:16.691241 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:15:16.691334 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:15:16.691461 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:15:16.691537 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:15:16.691711 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:15:16.691794 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:15:16.691948 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:15:16.692029 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:15:16.692183 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:15:16.692261 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:15:16.692424 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:15:16.692548 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:15:16.692668 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:15:16.692779 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:15:16.692927 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:15:16.693167 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:15:16.693345 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] publish_errors = False {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:15:16.693461 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:15:16.693583 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:15:16.693703 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] publish_errors = False {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:15:16.693816 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:15:16.693933 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:15:16.694058 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:15:16.694167 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:15:16.694285 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:15:16.694398 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:15:16.694532 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:15:16.694659 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:15:16.694773 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] standard_threads = False {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:15:16.694890 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:15:16.695001 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:15:16.695109 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] standard_threads = False {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:15:16.695229 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:15:16.695343 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:15:16.695461 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:15:16.695575 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:15:16.695717 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] use_journal = False {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:15:16.695843 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:15:16.696007 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] use_json = False {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:15:16.696123 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] use_journal = False {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:15:16.696242 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] use_stderr = False {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:15:16.696356 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] use_json = False {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:15:16.696468 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] use_syslog = False {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:15:16.696586 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] use_stderr = False {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:15:16.696709 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:15:16.696824 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] use_syslog = False {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:15:16.696936 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.697048 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:15:16.697149 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.697259 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.697382 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.697497 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.697614 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.697729 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.697842 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.697960 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.698084 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.698198 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.698347 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.698464 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.698583 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.698697 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.698818 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.698938 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.699051 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.699162 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.699279 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.699392 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.699513 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.699640 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.699785 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.699901 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.700013 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.700124 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.700252 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.700367 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.700479 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.700592 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.700710 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.700829 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.700955 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.701075 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.701188 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.701300 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.701411 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.701597 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.701719 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.701839 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.701954 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.702067 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.702184 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.702306 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.702420 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.702533 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.702651 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.702770 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.702884 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.703006 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.703121 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.703233 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.703345 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.703457 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.703575 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.703726 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.703849 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.703962 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.704081 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.704195 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.704313 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.704437 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.704551 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.704663 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.704776 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.704893 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.705005 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.705126 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.705240 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.705240 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.705452 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.705570 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.705683 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.705807 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.705921 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.706034 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.706647 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.706762 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.706880 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.707002 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.707122 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.707243 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.707357 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.707475 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.707589 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.707843 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.707962 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.708077 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.708190 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.708303 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.708454 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.708578 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.708699 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.708812 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.708925 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.709037 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.709149 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.709271 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.709385 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.709498 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.709611 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.709723 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.709835 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.709955 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.710069 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.710182 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.710299 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.710413 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.710524 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.710645 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.710758 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.710871 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.711020 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.711143 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.711266 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.711366 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.711461 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.711563 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.711660 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.711777 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.711885 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.711982 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.712077 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.712179 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.712277 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.712372 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.712499 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.712617 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.712738 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.712852 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.712965 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.713079 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.713192 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.713305 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.713426 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.713541 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.713654 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.713773 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.713887 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.714000 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.714121 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.714233 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.714346 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.714459 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.714563 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.714674 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.714794 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.714907 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.715025 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.715139 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.715244 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.715355 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.715476 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.715581 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.715733 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.715898 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.716018 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.716133 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.716255 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.716371 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.716484 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.716626 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.716735 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.716855 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.716978 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.717093 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.717207 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.717326 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.717447 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.717561 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.717683 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.717798 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.717912 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.718025 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.718138 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.718251 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.718372 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.718519 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.718643 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.718759 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.718872 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.718986 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.719169 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.719286 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.719400 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.719513 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.719626 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.719770 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.719899 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.720023 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.720023 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.720239 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.720353 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.720465 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.720579 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.720700 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.720817 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.720930 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.721044 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.721157 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.721157 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.721378 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.721378 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.721592 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.721592 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.722387 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.722498 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.722620 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.722747 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.722863 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.722863 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] auth.external = None {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.723074 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.723214 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.723342 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.723342 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.723565 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.723706 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] auth.external = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.723824 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.723952 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.724070 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] auth.password = None {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.724070 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] auth.token = None {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.724297 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.724414 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.724528 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.724643 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.724757 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] auth.password = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.724757 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] auth.token = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.724986 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.724986 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.725202 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.725202 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.725418 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.725418 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.725640 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.725757 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.725871 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.725992 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] credential.caching = True {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.726108 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.726222 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.726345 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.726461 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.726575 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.726575 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] credential.caching = True {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.726789 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.726789 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.727011 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.727128 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.727242 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.727357 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.727470 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.727584 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.727724 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.727843 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.727958 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.728072 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.728194 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.728310 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.728433 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.728433 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.728690 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.728814 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.728930 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.729045 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.729167 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.729167 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.729384 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.729384 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.729598 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.729598 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] federation.caching = True {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.729832 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.729949 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.730063 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.730178 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.730293 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.730408 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.730537 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] federation.caching = True {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.730654 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.730773 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.730889 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.731004 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.731127 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.731249 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.731366 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.731480 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.731594 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.731749 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.731879 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.731996 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.732111 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.732224 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.732347 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.732462 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.732584 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] identity.caching = True {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.732699 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.732814 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.732928 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.733050 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.733165 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.733354 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.733473 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] identity.caching = True {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.733594 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.733711 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.733825 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.733939 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.734061 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.734178 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.734293 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.734407 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.734522 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.734636 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.734758 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.734878 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.735241 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.735356 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.735471 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.735586 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.735790 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.735910 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.736025 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.736139 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.736253 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.736367 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.736492 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.736610 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.736720 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.736834 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.736949 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.737071 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.737195 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.737311 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.739245 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.739366 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.739483 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.739598 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.739779 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.739779 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.740000 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.740114 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.740229 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.740343 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.740470 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.740587 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.740702 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.740816 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.740930 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.741044 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.741167 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.741283 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.741398 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.741398 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.741611 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.741725 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.741849 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.741849 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.742065 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.742179 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.742292 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.742414 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.742529 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.742644 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.742758 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.742873 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.742987 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.743109 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.743225 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.743339 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.743452 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.743654 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.743789 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.743922 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.744040 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.744155 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.744270 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.744270 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.744484 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.744606 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.744723 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.744837 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.744953 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.745067 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.745181 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.745181 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.745406 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.745534 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.745716 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.745833 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.745953 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.746077 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.746193 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.746307 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.746420 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.746534 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.746651 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.746777 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] ldap.user = None {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.746901 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.747017 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.747131 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.747244 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.747357 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.747478 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.747593 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.747738 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.747854 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.user = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.747967 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.748081 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.748206 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.748321 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.748435 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.748548 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.748660 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.748773 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.748893 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.749008 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.749122 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.749267 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.749376 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.749479 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.749589 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.749688 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.749784 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.749881 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.749983 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.750081 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.750187 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.750285 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.750380 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.750475 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.750571 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.750667 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.750771 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.750870 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.750965 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.751060 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.751164 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.751261 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.751366 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.751463 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.751565 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.751661 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.751783 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.751880 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.751987 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.752091 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.752188 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.752284 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.752385 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.752488 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.752593 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.752690 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.752785 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.752886 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.752982 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.753077 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.753182 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.753286 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.753382 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.753477 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.753572 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.753667 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.753776 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.753873 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.753968 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.754063 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.754164 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.754259 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.754363 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.754486 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.754601 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] resource.caching = True {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.754715 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.754830 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.754944 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.755067 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.755184 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.755298 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.755414 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.755528 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.755642 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] resource.caching = True {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.755803 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.755921 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.756035 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.756150 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.756264 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.756379 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.756503 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.756623 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.756746 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.756746 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] role.caching = True {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.756962 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.757154 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] role.driver = sql {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.757273 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.757388 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.757505 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.757620 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.757735 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.757858 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.757976 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.758091 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.758205 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] role.caching = True {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.758320 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.758434 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] role.driver = sql {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.758434 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.758660 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.758775 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.758889 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.759003 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.759118 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.759240 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.759397 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.759397 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.759615 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.759743 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.759860 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.759986 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.760110 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.760227 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.760342 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.760456 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.760571 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.760571 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.760797 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.760912 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.761027 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.761141 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.761255 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.761378 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.761495 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.761609 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.761725 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.761725 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.761947 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.762070 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.762187 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.762301 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.762414 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.762529 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.762651 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.762768 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.762883 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.762997 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.763111 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.763225 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.763350 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.763467 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.763581 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.763750 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.763869 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.763984 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.764110 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.764227 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.764342 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.764456 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.764570 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.764683 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.764805 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.764922 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.765036 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.765151 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] token.caching = True {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.765265 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.765379 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.765501 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.765617 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.765732 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.765847 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.765962 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.766077 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.766204 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.766322 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.766437 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] token.caching = True {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.766552 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.766671 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.766785 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.766908 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.767025 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.767140 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.767254 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.767368 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.767482 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.767604 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.767733 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.767849 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.767963 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.768079 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.768192 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.768319 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.768436 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.768551 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.769170 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.769294 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.769449 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.769569 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.769692 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.769809 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.769923 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] database.connection = **** {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.770038 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.770153 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.770267 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.770390 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.770506 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.770629 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.770754 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.770871 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.770986 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.771100 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.771216 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] database.connection = **** {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.771339 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.771456 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.771571 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.771699 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.771816 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.771931 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.772058 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.772175 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.772290 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.772404 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.772518 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.772632 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.772756 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.772873 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.772988 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.773102 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.773478 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.773593 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.773717 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.773833 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.773948 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.774062 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.774177 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.774293 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.774416 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.774416 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 11 05:15:16.774633 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.774633 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.774633 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.774633 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.774633 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.774633 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:15:16.774633 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 11 05:15:16.800258 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81383) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 05:15:16.800258 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81383) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 05:15:16.800455 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81383) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 05:15:16.800638 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 05:15:16.800964 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 05:15:16.801104 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 05:15:16.809582 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 05:15:16.809729 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81383) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 05:15:16.838337 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 05:15:16.838565 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 05:15:16.838903 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81383) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 05:15:16.839136 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81383) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 05:15:16.892387 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 05:15:16.892538 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81383) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 05:15:16.941460 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 05:15:16.941607 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81383) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 05:15:16.941694 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 05:15:16.941836 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81383) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 05:15:17.097596 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 05:15:17.097780 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81383) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 05:15:17.097920 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81383) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 05:15:17.098001 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 05:15:17.098101 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81383) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 05:15:17.098179 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 05:15:17.098252 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81383) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 05:15:17.098325 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 05:15:17.098425 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81383) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 05:15:17.098517 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 05:15:17.098641 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81383) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 05:15:17.098723 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 05:15:17.121640 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81383) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 05:15:17.121835 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 05:15:17.121965 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81383) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 05:15:17.122075 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 05:15:17.122154 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81383) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 05:15:17.122254 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 05:15:17.122336 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81383) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 05:15:17.122480 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 05:15:17.122575 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81383) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 05:15:17.122704 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81383) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 05:15:17.122786 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 05:15:17.122916 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81383) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 05:15:17.122997 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 05:15:17.123128 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 05:15:17.134441 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81383) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 05:15:17.134730 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 05:15:17.147671 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81383) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 05:15:17.147876 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81383) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 05:15:17.148106 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81383) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 05:15:17.148205 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 05:15:17.148332 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81383) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 05:15:17.148414 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 05:15:17.148554 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81383) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 05:15:17.148637 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 05:15:17.148771 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81383) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 05:15:17.148854 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 05:15:17.148983 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81383) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 05:15:17.149063 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 05:15:17.149260 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 05:15:17.149478 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 05:15:17.166459 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.166667 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 11 05:15:17.167017 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.167220 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 11 05:15:17.167498 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.167796 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.168065 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.168146 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81383) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.168285 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81383) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 11 05:15:17.168366 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.168631 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81383) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.168893 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81383) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 11 05:15:17.169174 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81383) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.169438 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81383) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.169698 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81383) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.169958 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81383) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.178015 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.178298 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.178576 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.178866 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.179926 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81383) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.180206 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81383) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.180479 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81383) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.180767 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81383) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.185892 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81384) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 05:15:17.187706 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81383) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 05:15:17.188831 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81384) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 05:15:17.189124 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.189409 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.189693 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.189981 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.190246 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.191049 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.191136 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81383) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 05:15:17.191332 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.191414 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81383) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.191609 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.191721 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81383) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.191914 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.191995 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81383) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.192187 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.192267 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81383) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.192501 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81383) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.192772 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81383) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.193046 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81383) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.193314 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81383) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.193587 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81383) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.193855 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81383) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.215381 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.216954 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81384) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 05:15:17.217043 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81383) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.217243 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.218473 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81383) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 05:15:17.218758 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81383) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.221939 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81384) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 05:15:17.222231 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.222518 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.223459 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81383) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 05:15:17.223769 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81383) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.224056 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81383) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.228901 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81384) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 05:15:17.229193 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.230385 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81383) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 05:15:17.230675 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81383) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.234838 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81384) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 05:15:17.235396 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.235707 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.236006 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.236289 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.236566 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.236697 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81383) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 05:15:17.236837 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.236921 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81383) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.237104 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.237197 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81383) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.237501 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81383) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.237743 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81383) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.238024 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81383) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.238300 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81383) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.238575 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81383) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.252563 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.252845 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.254541 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81383) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.254820 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81383) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.257271 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81384) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 05:15:17.258683 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81383) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 05:15:17.260574 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.260879 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.261952 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81383) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.262251 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81383) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.265115 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81384) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 05:15:17.266448 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81383) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 05:15:17.268376 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81384) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 05:15:17.270205 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81383) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 05:15:17.272195 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.272501 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.272792 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.273091 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.273387 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.273468 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81383) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.273679 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.273769 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81383) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.274013 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81383) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.274302 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81383) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.274593 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81383) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.274884 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81383) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.289523 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81384) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 05:15:17.289811 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.290082 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.290350 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.290611 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81383) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 05:15:17.290898 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81383) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.291165 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81383) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.291433 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81383) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.297204 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.298253 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81383) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.298763 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.299824 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81383) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.300348 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.300630 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.301374 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81383) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.301650 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81383) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.303336 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81384) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 05:15:17.303634 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.303951 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.304236 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.304341 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81383) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 05:15:17.304626 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.304710 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81383) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.304907 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81383) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.305187 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81383) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.305577 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81383) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.316376 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81384) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 05:15:17.316666 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.316950 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.317191 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81383) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 05:15:17.317276 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.317479 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81383) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.317603 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.317761 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81383) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.317898 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.318040 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81383) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.318184 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.318420 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81383) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.318699 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81383) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.318976 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81383) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.334120 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81384) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 05:15:17.334921 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81383) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 05:15:17.337086 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81384) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 05:15:17.337865 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81383) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 05:15:17.340016 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.340754 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81383) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.341503 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.342261 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81383) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.342970 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81384) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 05:15:17.343256 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.343654 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.343772 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81383) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 05:15:17.344016 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81383) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.344405 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81383) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.350076 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.350748 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81383) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.351542 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81384) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 05:15:17.352245 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81383) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 05:15:17.354448 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.354846 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.355111 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81383) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.355194 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.355406 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.355499 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81383) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.355812 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81383) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.356092 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81383) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.363524 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81384) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 05:15:17.363862 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.364150 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.364232 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81383) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 05:15:17.364455 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81383) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.364741 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81383) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.370990 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81384) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 05:15:17.371280 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.371563 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81383) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 05:15:17.371645 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.371865 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.371949 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81383) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.372142 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.372235 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81383) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.372418 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81383) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.372499 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.372692 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.372773 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81383) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.372984 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.373078 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81383) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.373257 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81383) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.373339 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.373533 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.373615 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81383) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.373800 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81383) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.373880 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.374076 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81383) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.374167 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.374341 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.374416 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81383) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.374626 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81383) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.374706 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.374892 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81383) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.375159 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81383) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 05:15:17.409494 dv-cinder-856921-1-smb devstack@keystone.service[81384]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ee38fd39c0 pid: 81384 (default app) Sep 11 05:15:17.409895 dv-cinder-856921-1-smb devstack@keystone.service[81383]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ee38fd39c0 pid: 81383 (default app) Sep 11 05:15:17.412705 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8493a2a3-2239-41d9-9c93-a46cc42b30c8 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:17.412996 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8493a2a3-2239-41d9-9c93-a46cc42b30c8 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:17.413273 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8493a2a3-2239-41d9-9c93-a46cc42b30c8 None None] PATH_INFO: `/v3` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:17.417411 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 791 bytes} [Sun Sep 11 05:15:17 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:15:24.174235 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a720a4-d405-42a8-a89d-b45da5a0ae86 None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:24.174739 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a720a4-d405-42a8-a89d-b45da5a0ae86 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:24.174843 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a720a4-d405-42a8-a89d-b45da5a0ae86 None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:24.179533 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1/2] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:15:24 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 05:15:24.184956 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a9f96-3417-4fa7-bdcf-d23a019ea7e1 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:24.185365 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a9f96-3417-4fa7-bdcf-d23a019ea7e1 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:24.185500 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a9f96-3417-4fa7-bdcf-d23a019ea7e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:24.256388 dv-cinder-856921-1-smb devstack@keystone.service[81384]: INFO dbcounter [None req-014a9f96-3417-4fa7-bdcf-d23a019ea7e1 None None] Registered counter for database keystone Sep 11 05:15:24.274746 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG oslo_db.sqlalchemy.engines [None req-014a9f96-3417-4fa7-bdcf-d23a019ea7e1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81384) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 05:15:24.280901 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writer thread running {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 05:15:24.459774 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG passlib.handlers.bcrypt [None req-014a9f96-3417-4fa7-bdcf-d23a019ea7e1 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81384) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 11 05:15:24.460099 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG passlib.handlers.bcrypt [None req-014a9f96-3417-4fa7-bdcf-d23a019ea7e1 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81384) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 11 05:15:24.517770 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-014a9f96-3417-4fa7-bdcf-d23a019ea7e1 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:15:24.519400 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-014a9f96-3417-4fa7-bdcf-d23a019ea7e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:15:24.645359 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 2/3] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:15:24 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 461 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 11 05:15:25.094139 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a720a4-d405-42a8-a89d-b45da5a0ae86 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:25.172989 dv-cinder-856921-1-smb devstack@keystone.service[81383]: INFO dbcounter [None req-e6a720a4-d405-42a8-a89d-b45da5a0ae86 None None] Registered counter for database keystone Sep 11 05:15:25.195274 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG oslo_db.sqlalchemy.engines [None req-e6a720a4-d405-42a8-a89d-b45da5a0ae86 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81383) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 05:15:25.201538 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writer thread running {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 05:15:25.323461 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a720a4-d405-42a8-a89d-b45da5a0ae86 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:25.327807 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b97a36-058b-4908-b7a2-9d2c31e7e0d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:25.328437 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b97a36-058b-4908-b7a2-9d2c31e7e0d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:25.328723 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b97a36-058b-4908-b7a2-9d2c31e7e0d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:25.328999 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b97a36-058b-4908-b7a2-9d2c31e7e0d9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:25.337206 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b97a36-058b-4908-b7a2-9d2c31e7e0d9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:15:25.389059 dv-cinder-856921-1-smb devstack@keystone.service[81383]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e7b97a36-058b-4908-b7a2-9d2c31e7e0d9 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 11 05:15:25.389355 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b97a36-058b-4908-b7a2-9d2c31e7e0d9 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:15:25.398809 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 2/4] 10.222.0.16 () {58 vars in 1324 bytes} [Sun Sep 11 05:15:25 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 11 05:15:25.404752 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014a9f96-3417-4fa7-bdcf-d23a019ea7e1 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:25.421827 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014a9f96-3417-4fa7-bdcf-d23a019ea7e1 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:25.426877 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2161bbb-265a-4e5b-9dea-df1a32817181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:25.428014 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2161bbb-265a-4e5b-9dea-df1a32817181 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:25.428298 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2161bbb-265a-4e5b-9dea-df1a32817181 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:25.428569 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2161bbb-265a-4e5b-9dea-df1a32817181 admin admin] PATH_INFO: `/v3/projects/6b45298f54324df991aa8efd3235c168` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:25.430167 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2161bbb-265a-4e5b-9dea-df1a32817181 admin admin] RBAC: Authorizing `identity:get_project(project_id=6b45298f54324df991aa8efd3235c168)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:15:25.485445 dv-cinder-856921-1-smb devstack@keystone.service[81384]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e2161bbb-265a-4e5b-9dea-df1a32817181 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 11 05:15:25.486043 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2161bbb-265a-4e5b-9dea-df1a32817181 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:15:25.491343 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 3/5] 10.222.0.16 () {56 vars in 1207 bytes} [Sun Sep 11 05:15:25 2022] GET /identity/v3/projects/6b45298f54324df991aa8efd3235c168 => generated 344 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:15:27.641789 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8625ad7-3fd7-410e-b60f-a66be7f575c4 None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:27.642384 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8625ad7-3fd7-410e-b60f-a66be7f575c4 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:27.642384 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8625ad7-3fd7-410e-b60f-a66be7f575c4 None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:27.646497 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 3/6] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:15:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 05:15:27.652058 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c12f88-2a02-40eb-84f6-c41f90f464a1 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:27.652439 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c12f88-2a02-40eb-84f6-c41f90f464a1 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:27.652616 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c12f88-2a02-40eb-84f6-c41f90f464a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:27.672724 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-b2c12f88-2a02-40eb-84f6-c41f90f464a1 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:15:27.674237 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-b2c12f88-2a02-40eb-84f6-c41f90f464a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:15:27.682643 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 4/7] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:15:27 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 11 05:15:27.950956 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8625ad7-3fd7-410e-b60f-a66be7f575c4 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:27.963389 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8625ad7-3fd7-410e-b60f-a66be7f575c4 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:27.967555 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a100a782-78de-40b9-b21a-7d713902ccf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:27.968208 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a100a782-78de-40b9-b21a-7d713902ccf9 admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:27.968487 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a100a782-78de-40b9-b21a-7d713902ccf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:27.968760 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a100a782-78de-40b9-b21a-7d713902ccf9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:27.976356 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a100a782-78de-40b9-b21a-7d713902ccf9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:15:27.978132 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a100a782-78de-40b9-b21a-7d713902ccf9 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:15:27.986921 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 4/8] 10.222.0.16 () {58 vars in 1324 bytes} [Sun Sep 11 05:15:27 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 05:15:27.992636 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c12f88-2a02-40eb-84f6-c41f90f464a1 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:28.001775 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c12f88-2a02-40eb-84f6-c41f90f464a1 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:28.006699 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572c7a95-8e2d-4c3d-8b1c-813e99d29ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:28.007319 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572c7a95-8e2d-4c3d-8b1c-813e99d29ad4 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:28.007600 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572c7a95-8e2d-4c3d-8b1c-813e99d29ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:28.007905 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572c7a95-8e2d-4c3d-8b1c-813e99d29ad4 admin admin] PATH_INFO: `/v3/users/dd85f0a5ebc14829989036033392af00` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:28.009218 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572c7a95-8e2d-4c3d-8b1c-813e99d29ad4 admin admin] RBAC: Authorizing `identity:get_user(user_id=dd85f0a5ebc14829989036033392af00)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:15:28.011057 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572c7a95-8e2d-4c3d-8b1c-813e99d29ad4 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:15:28.012607 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 5/9] 10.222.0.16 () {56 vars in 1198 bytes} [Sun Sep 11 05:15:27 2022] GET /identity/v3/users/dd85f0a5ebc14829989036033392af00 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:15:30.200426 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c945bdf7-52d1-4566-a306-ac312a8e0d04 None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:30.200946 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c945bdf7-52d1-4566-a306-ac312a8e0d04 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:30.200946 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c945bdf7-52d1-4566-a306-ac312a8e0d04 None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:30.202289 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 5/10] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:15:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:15:30.208126 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea304a6-2932-4ed3-844a-ca7b9ce84a70 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:30.208540 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea304a6-2932-4ed3-844a-ca7b9ce84a70 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:30.208809 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea304a6-2932-4ed3-844a-ca7b9ce84a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:30.227114 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-bea304a6-2932-4ed3-844a-ca7b9ce84a70 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:15:30.228348 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-bea304a6-2932-4ed3-844a-ca7b9ce84a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:15:30.234578 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7450446-d496-415c-b320-a16a6a72d01b None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:30.234861 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7450446-d496-415c-b320-a16a6a72d01b None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:30.235132 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7450446-d496-415c-b320-a16a6a72d01b None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:30.236752 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 6/11] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:15:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 05:15:30.241896 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1061ca3b-0854-4c9a-886e-504f987ed65c None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:30.242179 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1061ca3b-0854-4c9a-886e-504f987ed65c None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:30.242457 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1061ca3b-0854-4c9a-886e-504f987ed65c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:30.284222 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG passlib.handlers.bcrypt [None req-1061ca3b-0854-4c9a-886e-504f987ed65c None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81383) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 11 05:15:30.284618 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG passlib.handlers.bcrypt [None req-1061ca3b-0854-4c9a-886e-504f987ed65c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81383) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 11 05:15:30.310588 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 6/12] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:15:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 05:15:30.333815 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-1061ca3b-0854-4c9a-886e-504f987ed65c None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:15:30.335410 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-1061ca3b-0854-4c9a-886e-504f987ed65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:15:30.436639 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 7/13] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:15:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 05:15:30.580632 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea304a6-2932-4ed3-844a-ca7b9ce84a70 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:30.606795 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:15:30.687186 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea304a6-2932-4ed3-844a-ca7b9ce84a70 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:30.700085 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1061ca3b-0854-4c9a-886e-504f987ed65c None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:30.721379 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0e259f-e73f-4488-86a8-836b97c91a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:30.722021 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e259f-e73f-4488-86a8-836b97c91a80 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:30.722305 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e259f-e73f-4488-86a8-836b97c91a80 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:30.722614 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e259f-e73f-4488-86a8-836b97c91a80 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:30.733583 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0e259f-e73f-4488-86a8-836b97c91a80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:15:30.742750 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-dc0e259f-e73f-4488-86a8-836b97c91a80 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 05:15:30.742750 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:15:30.742750 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:15:30.742750 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:15:30.742750 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:15:30.742750 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:15:30.742750 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:15:30.742750 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:15:30.742750 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:15:30.742750 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:15:30.742750 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:15:30.742750 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:15:30.742750 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:15:30.742750 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:15:30.742750 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:15:30.742750 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:15:30.743655 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:15:30.743655 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:15:30.743655 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:15:30.743655 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:15:30.743655 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:15:30.743655 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:15:30.743655 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:15:30.743655 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:15:30.743655 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:15:30.743655 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:15:30.743655 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:15:30.743655 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:15:30.743655 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:15:30.743655 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:15:30.743655 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:15:30.743655 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:15:30.744522 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:15:30.744522 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:15:30.744522 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:15:30.744522 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:15:30.744522 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:15:30.744522 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:15:30.744522 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:15:30.744522 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:15:30.744522 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:15:30.744522 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:15:30.744522 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 05:15:30.744522 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:15:30.744522 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 7/14] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 05:15:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:15:30.749860 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0e259f-e73f-4488-86a8-836b97c91a80 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:30.803274 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1061ca3b-0854-4c9a-886e-504f987ed65c None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:30.805576 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:15:30.833860 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:15:30.842797 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a20b80-f9e8-481d-8d7a-5ebcdc767578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:30.843726 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a20b80-f9e8-481d-8d7a-5ebcdc767578 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:30.844016 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a20b80-f9e8-481d-8d7a-5ebcdc767578 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:30.844292 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a20b80-f9e8-481d-8d7a-5ebcdc767578 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:30.852339 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0e259f-e73f-4488-86a8-836b97c91a80 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:30.885630 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa7788-95b1-4fe8-a519-2e8d37caf269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:30.886245 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa7788-95b1-4fe8-a519-2e8d37caf269 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:30.886531 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa7788-95b1-4fe8-a519-2e8d37caf269 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:30.886810 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa7788-95b1-4fe8-a519-2e8d37caf269 None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:30.887482 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fa7788-95b1-4fe8-a519-2e8d37caf269 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:15:30.887823 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fa7788-95b1-4fe8-a519-2e8d37caf269 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:15:30.889233 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fa7788-95b1-4fe8-a519-2e8d37caf269 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:15:30.901406 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 8/15] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 05:15:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:15:30.907178 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa7788-95b1-4fe8-a519-2e8d37caf269 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:30.910860 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a20b80-f9e8-481d-8d7a-5ebcdc767578 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:15:30.912438 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a20b80-f9e8-481d-8d7a-5ebcdc767578 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:15:31.007768 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa7788-95b1-4fe8-a519-2e8d37caf269 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:31.010646 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 8/16] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 05:15:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 11 05:15:31.016022 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a20b80-f9e8-481d-8d7a-5ebcdc767578 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:31.019014 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:15:31.041969 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fd6176-e05c-4bb1-9471-68a35f76d35d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:31.042604 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd6176-e05c-4bb1-9471-68a35f76d35d None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:31.042885 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd6176-e05c-4bb1-9471-68a35f76d35d None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:31.043164 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd6176-e05c-4bb1-9471-68a35f76d35d None admin] PATH_INFO: `/v3/users/dd85f0a5ebc14829989036033392af00` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:31.044358 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fd6176-e05c-4bb1-9471-68a35f76d35d None admin] RBAC: Authorizing `identity:get_user(user_id=dd85f0a5ebc14829989036033392af00)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:15:31.045816 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fd6176-e05c-4bb1-9471-68a35f76d35d None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:15:31.047368 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 9/17] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 05:15:30 2022] GET /identity/v3/users/dd85f0a5ebc14829989036033392af00 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:15:31.052688 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fd6176-e05c-4bb1-9471-68a35f76d35d None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:31.066869 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:15:31.114588 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a20b80-f9e8-481d-8d7a-5ebcdc767578 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:31.147799 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a94515-a7f2-4160-924e-d0ba232c86f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:31.148653 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a94515-a7f2-4160-924e-d0ba232c86f0 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:31.148935 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a94515-a7f2-4160-924e-d0ba232c86f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:31.149203 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a94515-a7f2-4160-924e-d0ba232c86f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:31.152309 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fd6176-e05c-4bb1-9471-68a35f76d35d None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:31.168091 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a94515-a7f2-4160-924e-d0ba232c86f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:15:31.169571 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a94515-a7f2-4160-924e-d0ba232c86f0 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:15:31.185017 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b8e0fe-7afd-4ddc-a43e-3ddc66b620dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:31.185647 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b8e0fe-7afd-4ddc-a43e-3ddc66b620dd None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:31.185928 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b8e0fe-7afd-4ddc-a43e-3ddc66b620dd None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:31.186200 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b8e0fe-7afd-4ddc-a43e-3ddc66b620dd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:31.187314 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b8e0fe-7afd-4ddc-a43e-3ddc66b620dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:15:31.188544 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-52a94515-a7f2-4160-924e-d0ba232c86f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:15:31.188544 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:15:31.188544 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:15:31.188544 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:15:31.188544 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:15:31.188544 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:15:31.188544 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:15:31.188544 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:15:31.188544 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:15:31.188544 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:15:31.188544 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:15:31.188544 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:15:31.188544 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 05:15:31.188544 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 05:15:31.188544 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 05:15:31.188544 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 05:15:31.189435 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:15:31.189435 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:15:31.189435 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:15:31.189435 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:15:31.189435 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:15:31.189435 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:15:31.189435 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:15:31.189435 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:15:31.189435 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:15:31.189435 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:15:31.189435 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:15:31.189435 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:15:31.189435 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:15:31.189435 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:15:31.189435 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:15:31.189435 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:15:31.189435 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 05:15:31.190236 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 05:15:31.190236 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:15:31.190236 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:15:31.190392 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b8e0fe-7afd-4ddc-a43e-3ddc66b620dd None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:15:31.190464 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 9/18] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:15:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 05:15:31.190533 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 10/19] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:15:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:15:31.196524 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b8e0fe-7afd-4ddc-a43e-3ddc66b620dd None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:31.196634 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a94515-a7f2-4160-924e-d0ba232c86f0 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:31.251637 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:15:31.276795 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:15:31.296395 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b8e0fe-7afd-4ddc-a43e-3ddc66b620dd None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:31.298494 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a94515-a7f2-4160-924e-d0ba232c86f0 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:31.329378 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecca8d78-167c-4665-b5a5-c3abf64f72c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:31.329980 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca8d78-167c-4665-b5a5-c3abf64f72c0 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:31.330261 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca8d78-167c-4665-b5a5-c3abf64f72c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:31.330536 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca8d78-167c-4665-b5a5-c3abf64f72c0 None admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:31.331178 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecca8d78-167c-4665-b5a5-c3abf64f72c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:15:31.331482 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecca8d78-167c-4665-b5a5-c3abf64f72c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:15:31.331829 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0b9e13-f768-4786-a0b4-c69a8a5ebdb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:31.333052 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b9e13-f768-4786-a0b4-c69a8a5ebdb6 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:31.333330 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b9e13-f768-4786-a0b4-c69a8a5ebdb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:31.333456 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecca8d78-167c-4665-b5a5-c3abf64f72c0 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:15:31.333600 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b9e13-f768-4786-a0b4-c69a8a5ebdb6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:31.334320 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0b9e13-f768-4786-a0b4-c69a8a5ebdb6 None admin] RBAC: Adding query filter params (role.id=5b702713e40145b49e0b42abd0a5fba9, scope.domain.id=default, user.id=dd85f0a5ebc14829989036033392af00) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:15:31.334623 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0b9e13-f768-4786-a0b4-c69a8a5ebdb6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:15:31.336079 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0b9e13-f768-4786-a0b4-c69a8a5ebdb6 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:15:31.344163 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 10/20] 10.222.0.16 () {56 vars in 1322 bytes} [Sun Sep 11 05:15:31 2022] GET /identity/v3/role_assignments?user.id=dd85f0a5ebc14829989036033392af00&scope.domain.id=default&role.id=5b702713e40145b49e0b42abd0a5fba9 => generated 233 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:15:31.350422 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 11/21] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 05:15:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:15:33.997073 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9367b9-7feb-40e8-8651-e083496ed9c1 None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:33.998103 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9367b9-7feb-40e8-8651-e083496ed9c1 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:33.998590 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9367b9-7feb-40e8-8651-e083496ed9c1 None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:34.000188 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 11/22] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:15:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:15:34.006269 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec0070-fcb1-42b2-b07b-26aba04d9e61 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:34.007218 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec0070-fcb1-42b2-b07b-26aba04d9e61 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:34.007719 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec0070-fcb1-42b2-b07b-26aba04d9e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:34.032774 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-f5ec0070-fcb1-42b2-b07b-26aba04d9e61 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:15:34.034366 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-f5ec0070-fcb1-42b2-b07b-26aba04d9e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:15:34.124164 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 12/23] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:15:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 05:15:34.149175 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c3c86-8c6a-4233-8ac1-2106ac8bb572 None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:34.149826 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c3c86-8c6a-4233-8ac1-2106ac8bb572 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:34.150312 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c3c86-8c6a-4233-8ac1-2106ac8bb572 None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:34.151962 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 12/24] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:15:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 05:15:34.157927 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee504d3f-a85f-408b-8740-4fcac6071b94 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:34.158523 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee504d3f-a85f-408b-8740-4fcac6071b94 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:34.159009 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee504d3f-a85f-408b-8740-4fcac6071b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:34.187530 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-ee504d3f-a85f-408b-8740-4fcac6071b94 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:15:34.189125 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-ee504d3f-a85f-408b-8740-4fcac6071b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:15:34.270290 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:15:34.274671 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 13/25] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:15:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 05:15:34.307969 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f67015-b486-4ca1-8598-36444d94a9cc None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:34.308281 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f67015-b486-4ca1-8598-36444d94a9cc None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:34.308533 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f67015-b486-4ca1-8598-36444d94a9cc None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:34.310132 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 13/26] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:15:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:15:34.315361 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c46ffc4-f797-483d-a9c1-462fbd07c137 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:34.315646 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c46ffc4-f797-483d-a9c1-462fbd07c137 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:34.315958 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c46ffc4-f797-483d-a9c1-462fbd07c137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:34.343022 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-7c46ffc4-f797-483d-a9c1-462fbd07c137 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:15:34.344268 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-7c46ffc4-f797-483d-a9c1-462fbd07c137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:15:34.429416 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 14/27] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:15:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 05:15:34.668750 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f67015-b486-4ca1-8598-36444d94a9cc None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:34.725003 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c46ffc4-f797-483d-a9c1-462fbd07c137 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:34.872943 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f67015-b486-4ca1-8598-36444d94a9cc None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:34.926937 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:15:34.953004 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c46ffc4-f797-483d-a9c1-462fbd07c137 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:34.953916 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a930bc9-0bfb-4bd2-9e05-eeb9f8bbc365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:34.954687 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a930bc9-0bfb-4bd2-9e05-eeb9f8bbc365 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:34.955070 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a930bc9-0bfb-4bd2-9e05-eeb9f8bbc365 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:34.955437 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a930bc9-0bfb-4bd2-9e05-eeb9f8bbc365 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:34.977265 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a930bc9-0bfb-4bd2-9e05-eeb9f8bbc365 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:15:34.980453 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a930bc9-0bfb-4bd2-9e05-eeb9f8bbc365 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:15:34.996713 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:15:34.997136 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-4a930bc9-0bfb-4bd2-9e05-eeb9f8bbc365 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:15:34.997136 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:15:34.997136 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:15:34.997136 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:15:34.997136 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:15:34.997136 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:15:34.997136 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:15:34.997136 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:15:34.997136 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:15:34.997136 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:15:34.997136 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:15:34.997136 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:15:34.997136 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 05:15:34.997136 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 05:15:34.997136 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 05:15:34.997136 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 05:15:34.998610 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:15:34.998610 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:15:34.998610 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:15:34.998610 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:15:34.998610 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:15:34.998610 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:15:34.998610 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:15:34.998610 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:15:34.998610 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:15:34.998610 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:15:34.998610 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:15:34.998610 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:15:34.998610 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:15:34.998610 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:15:34.998610 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:15:34.998610 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:15:34.998610 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 05:15:34.999414 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 05:15:34.999414 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:15:34.999414 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:15:35.000947 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 14/28] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:15:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:15:35.001887 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a930bc9-0bfb-4bd2-9e05-eeb9f8bbc365 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:35.010121 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243b9751-b9c7-4217-9465-6fc0436efc4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:35.010745 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243b9751-b9c7-4217-9465-6fc0436efc4c None admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:35.011023 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243b9751-b9c7-4217-9465-6fc0436efc4c None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:35.011295 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243b9751-b9c7-4217-9465-6fc0436efc4c None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:35.012008 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243b9751-b9c7-4217-9465-6fc0436efc4c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:15:35.013411 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243b9751-b9c7-4217-9465-6fc0436efc4c None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:15:35.110040 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a930bc9-0bfb-4bd2-9e05-eeb9f8bbc365 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:35.143516 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fa36d3-6547-4bb1-8c7b-6913b0d6a683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:35.144169 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fa36d3-6547-4bb1-8c7b-6913b0d6a683 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:35.144462 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fa36d3-6547-4bb1-8c7b-6913b0d6a683 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:35.145338 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fa36d3-6547-4bb1-8c7b-6913b0d6a683 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:35.148029 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 15/29] 10.222.0.16 () {60 vars in 1131 bytes} [Sun Sep 11 05:15:34 2022] POST /identity/v3/roles => generated 219 bytes in 423 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 05:15:35.149490 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b95d98-2823-40a5-b2cf-03662af07c77 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:35.149778 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b95d98-2823-40a5-b2cf-03662af07c77 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:35.150055 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b95d98-2823-40a5-b2cf-03662af07c77 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:35.151485 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 16/30] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:15:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:15:35.152101 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b95d98-2823-40a5-b2cf-03662af07c77 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:35.170519 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fa36d3-6547-4bb1-8c7b-6913b0d6a683 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:15:35.178544 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-a2fa36d3-6547-4bb1-8c7b-6913b0d6a683 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 05:15:35.178544 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:15:35.178544 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:15:35.178544 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:15:35.178544 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:15:35.178544 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:15:35.178544 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:15:35.178544 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:15:35.178544 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:15:35.178544 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:15:35.178544 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:15:35.178544 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:15:35.178544 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:15:35.178544 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:15:35.178544 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:15:35.178544 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:15:35.179495 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:15:35.179495 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:15:35.179495 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:15:35.179495 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:15:35.179495 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:15:35.179495 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:15:35.179495 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:15:35.179495 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:15:35.179495 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:15:35.179495 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:15:35.179495 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:15:35.179495 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:15:35.179495 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:15:35.179495 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:15:35.179495 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:15:35.179495 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:15:35.180301 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:15:35.180301 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:15:35.180301 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:15:35.180301 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:15:35.180301 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:15:35.180301 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:15:35.180301 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:15:35.180301 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:15:35.180301 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:15:35.180301 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:15:35.180301 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 05:15:35.180301 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:15:35.180301 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 15/31] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 05:15:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:15:35.181214 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf28ffe-a75d-4222-8fd7-5bb836caaf4a None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:35.181500 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf28ffe-a75d-4222-8fd7-5bb836caaf4a None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:35.182061 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf28ffe-a75d-4222-8fd7-5bb836caaf4a None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:35.184421 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 16/32] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:15:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:15:35.185636 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979253cd-0721-4ac7-be82-40edbcf688cb None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:35.186025 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979253cd-0721-4ac7-be82-40edbcf688cb None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:35.186301 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979253cd-0721-4ac7-be82-40edbcf688cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:35.216343 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-979253cd-0721-4ac7-be82-40edbcf688cb None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:15:35.217746 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-979253cd-0721-4ac7-be82-40edbcf688cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:15:35.257436 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:15:35.297872 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b95d98-2823-40a5-b2cf-03662af07c77 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:35.307185 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 17/33] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:15:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 05:15:35.308884 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dc3b50-3440-44eb-89ad-b173c8ad8d60 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:35.308884 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dc3b50-3440-44eb-89ad-b173c8ad8d60 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:35.309294 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dc3b50-3440-44eb-89ad-b173c8ad8d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:35.330562 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-89dc3b50-3440-44eb-89ad-b173c8ad8d60 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:15:35.332077 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-89dc3b50-3440-44eb-89ad-b173c8ad8d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:15:35.342251 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a21d3b-98fb-4838-af7b-9ecfb05a2ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:35.343234 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a21d3b-98fb-4838-af7b-9ecfb05a2ee7 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:35.349069 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a21d3b-98fb-4838-af7b-9ecfb05a2ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:35.349069 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a21d3b-98fb-4838-af7b-9ecfb05a2ee7 None admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:35.349069 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a21d3b-98fb-4838-af7b-9ecfb05a2ee7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:15:35.349069 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a21d3b-98fb-4838-af7b-9ecfb05a2ee7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:15:35.349069 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a21d3b-98fb-4838-af7b-9ecfb05a2ee7 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:15:35.361358 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 17/34] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 05:15:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:15:35.362545 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a21d3b-98fb-4838-af7b-9ecfb05a2ee7 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:35.409260 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 18/35] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:15:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 05:15:35.410146 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dc3b50-3440-44eb-89ad-b173c8ad8d60 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:35.429225 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:15:35.490753 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a21d3b-98fb-4838-af7b-9ecfb05a2ee7 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:35.515890 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:15:35.527214 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dc3b50-3440-44eb-89ad-b173c8ad8d60 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:35.539713 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c4b2e4-7232-43f2-95be-618f343d6cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:35.540674 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c4b2e4-7232-43f2-95be-618f343d6cb3 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:35.541159 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c4b2e4-7232-43f2-95be-618f343d6cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:35.541717 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c4b2e4-7232-43f2-95be-618f343d6cb3 None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:35.542643 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c4b2e4-7232-43f2-95be-618f343d6cb3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:15:35.543172 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c4b2e4-7232-43f2-95be-618f343d6cb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:15:35.545013 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c4b2e4-7232-43f2-95be-618f343d6cb3 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:15:35.556948 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 18/36] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 05:15:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:15:35.563725 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c4b2e4-7232-43f2-95be-618f343d6cb3 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:35.581620 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765e410b-6c94-4b73-91b2-e8cc3f6fa189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:35.582286 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e410b-6c94-4b73-91b2-e8cc3f6fa189 None admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:35.582577 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e410b-6c94-4b73-91b2-e8cc3f6fa189 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:35.582833 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e410b-6c94-4b73-91b2-e8cc3f6fa189 None admin] PATH_INFO: `/v3/projects` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:35.583762 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765e410b-6c94-4b73-91b2-e8cc3f6fa189 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:15:35.585242 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765e410b-6c94-4b73-91b2-e8cc3f6fa189 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:15:35.764527 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 19/37] 10.222.0.16 () {60 vars in 1141 bytes} [Sun Sep 11 05:15:35 2022] POST /identity/v3/projects => generated 301 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:15:35.765306 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765e410b-6c94-4b73-91b2-e8cc3f6fa189 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:35.825054 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c4b2e4-7232-43f2-95be-618f343d6cb3 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:35.841420 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:15:35.868053 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c665fe-318e-4a78-8ee5-cdd5926499e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:35.869129 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c665fe-318e-4a78-8ee5-cdd5926499e0 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:35.869416 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c665fe-318e-4a78-8ee5-cdd5926499e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:35.869694 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c665fe-318e-4a78-8ee5-cdd5926499e0 None admin] PATH_INFO: `/v3/users/dd85f0a5ebc14829989036033392af00` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:35.871018 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c665fe-318e-4a78-8ee5-cdd5926499e0 None admin] RBAC: Authorizing `identity:get_user(user_id=dd85f0a5ebc14829989036033392af00)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:15:35.872543 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c665fe-318e-4a78-8ee5-cdd5926499e0 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:15:35.878738 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 19/38] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 05:15:35 2022] GET /identity/v3/users/dd85f0a5ebc14829989036033392af00 => generated 247 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:15:35.880715 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094f9b5c-2e43-46de-9b57-afef119c197f None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:35.881002 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094f9b5c-2e43-46de-9b57-afef119c197f None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:35.881278 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094f9b5c-2e43-46de-9b57-afef119c197f None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:35.882624 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 20/39] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:15:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:15:35.883340 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094f9b5c-2e43-46de-9b57-afef119c197f None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:35.904620 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765e410b-6c94-4b73-91b2-e8cc3f6fa189 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:35.941326 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e5e506-6f20-487e-a1a8-ae2bb8eaf0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:35.942504 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e5e506-6f20-487e-a1a8-ae2bb8eaf0dc None admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:35.942784 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e5e506-6f20-487e-a1a8-ae2bb8eaf0dc None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:35.943067 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e5e506-6f20-487e-a1a8-ae2bb8eaf0dc None admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:35.943924 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e5e506-6f20-487e-a1a8-ae2bb8eaf0dc None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:15:35.945443 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e5e506-6f20-487e-a1a8-ae2bb8eaf0dc None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:15:35.964732 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 20/40] 10.222.0.16 () {60 vars in 1131 bytes} [Sun Sep 11 05:15:35 2022] POST /identity/v3/roles => generated 225 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:15:35.965569 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e5e506-6f20-487e-a1a8-ae2bb8eaf0dc None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:35.972324 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:15:36.041985 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094f9b5c-2e43-46de-9b57-afef119c197f None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:36.088388 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2125a3-7e35-41a2-987f-ba5240eeef7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:36.088594 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2125a3-7e35-41a2-987f-ba5240eeef7a None admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:36.088868 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2125a3-7e35-41a2-987f-ba5240eeef7a None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:36.089137 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2125a3-7e35-41a2-987f-ba5240eeef7a None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:36.089821 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2125a3-7e35-41a2-987f-ba5240eeef7a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:15:36.091232 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2125a3-7e35-41a2-987f-ba5240eeef7a None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:15:36.108622 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 21/41] 10.222.0.16 () {60 vars in 1131 bytes} [Sun Sep 11 05:15:35 2022] POST /identity/v3/roles => generated 223 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:15:36.109780 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b5a104-c8cc-49e3-a492-8af586907810 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:36.110121 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b5a104-c8cc-49e3-a492-8af586907810 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:36.110403 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b5a104-c8cc-49e3-a492-8af586907810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:36.132557 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-32b5a104-c8cc-49e3-a492-8af586907810 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:15:36.134221 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-32b5a104-c8cc-49e3-a492-8af586907810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:15:36.141410 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e5e506-6f20-487e-a1a8-ae2bb8eaf0dc None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:36.185189 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:15:36.210137 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d386166-8187-4980-859f-a621e4fc6147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:36.210812 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d386166-8187-4980-859f-a621e4fc6147 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:36.211094 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d386166-8187-4980-859f-a621e4fc6147 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:36.211367 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d386166-8187-4980-859f-a621e4fc6147 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:36.212731 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d386166-8187-4980-859f-a621e4fc6147 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:15:36.215015 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d386166-8187-4980-859f-a621e4fc6147 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:15:36.217634 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 21/42] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:15:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:15:36.223306 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d386166-8187-4980-859f-a621e4fc6147 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:36.230552 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 22/43] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:15:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 05:15:36.306889 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:15:36.339642 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d386166-8187-4980-859f-a621e4fc6147 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:36.374512 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e97aea9-b989-4458-b167-f5db0426497d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:36.375191 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e97aea9-b989-4458-b167-f5db0426497d None admin] REQUEST_METHOD: `PUT` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:36.375476 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e97aea9-b989-4458-b167-f5db0426497d None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:36.375784 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e97aea9-b989-4458-b167-f5db0426497d None admin] PATH_INFO: `/v3/domains/default/users/dd85f0a5ebc14829989036033392af00/roles/5b702713e40145b49e0b42abd0a5fba9` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:36.378032 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e97aea9-b989-4458-b167-f5db0426497d None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=dd85f0a5ebc14829989036033392af00, role_id=5b702713e40145b49e0b42abd0a5fba9)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:15:36.379597 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e97aea9-b989-4458-b167-f5db0426497d None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:15:36.396541 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 22/44] 10.222.0.16 () {58 vars in 1361 bytes} [Sun Sep 11 05:15:36 2022] PUT /identity/v3/domains/default/users/dd85f0a5ebc14829989036033392af00/roles/5b702713e40145b49e0b42abd0a5fba9 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 05:15:36.502508 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b5a104-c8cc-49e3-a492-8af586907810 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:36.609168 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b5a104-c8cc-49e3-a492-8af586907810 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:36.643274 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f77aa29-1cae-4822-895b-e526e4863006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:36.643968 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f77aa29-1cae-4822-895b-e526e4863006 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:36.644247 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f77aa29-1cae-4822-895b-e526e4863006 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:36.644523 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f77aa29-1cae-4822-895b-e526e4863006 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:36.646305 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f77aa29-1cae-4822-895b-e526e4863006 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:15:36.647792 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f77aa29-1cae-4822-895b-e526e4863006 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:15:36.649359 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 23/45] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:15:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:15:36.654908 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e97aea9-b989-4458-b167-f5db0426497d None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:36.753533 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e97aea9-b989-4458-b167-f5db0426497d None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:36.784215 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:15:36.791145 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41a2467-226c-49f9-88bc-b5d8add9decb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:36.791853 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a2467-226c-49f9-88bc-b5d8add9decb None admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:36.792314 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a2467-226c-49f9-88bc-b5d8add9decb None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:36.792755 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a2467-226c-49f9-88bc-b5d8add9decb None admin] PATH_INFO: `/v3/projects` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:36.793476 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41a2467-226c-49f9-88bc-b5d8add9decb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:15:36.795088 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41a2467-226c-49f9-88bc-b5d8add9decb None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:15:36.821467 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 23/46] 10.222.0.16 () {60 vars in 1141 bytes} [Sun Sep 11 05:15:36 2022] POST /identity/v3/projects => generated 312 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:15:38.539640 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74eca1e-875b-4d98-975f-2e3e148fa72f None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:38.540240 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74eca1e-875b-4d98-975f-2e3e148fa72f None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:38.540240 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74eca1e-875b-4d98-975f-2e3e148fa72f None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:38.541563 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 24/47] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:15:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:15:38.547111 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811e38fd-aab6-4503-bedd-a312968c3e33 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:38.547536 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811e38fd-aab6-4503-bedd-a312968c3e33 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:38.547818 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811e38fd-aab6-4503-bedd-a312968c3e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:38.565875 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-811e38fd-aab6-4503-bedd-a312968c3e33 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:15:38.567404 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-811e38fd-aab6-4503-bedd-a312968c3e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:15:38.632702 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 24/48] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:15:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 05:15:38.897165 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74eca1e-875b-4d98-975f-2e3e148fa72f None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:38.937731 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:15:38.984228 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f4ec3d-fcff-4db7-8824-f72ef7db5815 None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:38.984529 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f4ec3d-fcff-4db7-8824-f72ef7db5815 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:38.984811 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f4ec3d-fcff-4db7-8824-f72ef7db5815 None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:38.986306 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 25/49] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:15:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:15:38.991290 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e133cce3-df1b-4e06-9fc8-79c827758f2f None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:38.991580 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e133cce3-df1b-4e06-9fc8-79c827758f2f None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:38.991894 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e133cce3-df1b-4e06-9fc8-79c827758f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:38.998825 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74eca1e-875b-4d98-975f-2e3e148fa72f None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:39.009894 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-e133cce3-df1b-4e06-9fc8-79c827758f2f None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:15:39.011097 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-e133cce3-df1b-4e06-9fc8-79c827758f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:15:39.032692 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e270f79-2630-49ef-b6ce-5583184939de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:39.033322 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e270f79-2630-49ef-b6ce-5583184939de None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:39.033611 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e270f79-2630-49ef-b6ce-5583184939de None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:39.033882 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e270f79-2630-49ef-b6ce-5583184939de None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:39.043836 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e270f79-2630-49ef-b6ce-5583184939de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:15:39.048635 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-3e270f79-2630-49ef-b6ce-5583184939de None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 05:15:39.048635 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:15:39.048635 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:15:39.048635 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:15:39.048635 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:15:39.048635 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:15:39.048635 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:15:39.048635 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:15:39.048635 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:15:39.048635 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:15:39.048635 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:15:39.048635 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:15:39.048635 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:15:39.048635 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:15:39.048635 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:15:39.048635 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:15:39.049645 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:15:39.049645 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:15:39.049645 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:15:39.049645 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:15:39.049645 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:15:39.049645 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:15:39.049645 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:15:39.049645 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:15:39.049645 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:15:39.049645 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:15:39.049645 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:15:39.049645 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:15:39.049645 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:15:39.049645 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:15:39.049645 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:15:39.049645 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:15:39.050420 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:15:39.050420 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:15:39.050420 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:15:39.050420 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:15:39.050420 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:15:39.050420 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:15:39.050420 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:15:39.050420 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:15:39.050420 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:15:39.050420 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:15:39.050420 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 05:15:39.050420 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:15:39.050420 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 25/50] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 05:15:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:15:39.055526 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e270f79-2630-49ef-b6ce-5583184939de None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:39.077524 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 26/51] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:15:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 05:15:39.154368 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:15:39.158384 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e270f79-2630-49ef-b6ce-5583184939de None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:39.191358 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0dcd70-5cc8-4e27-b3f6-cb033395e044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:39.192577 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0dcd70-5cc8-4e27-b3f6-cb033395e044 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:39.192854 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0dcd70-5cc8-4e27-b3f6-cb033395e044 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:39.193123 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0dcd70-5cc8-4e27-b3f6-cb033395e044 None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:39.193775 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0dcd70-5cc8-4e27-b3f6-cb033395e044 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:15:39.194074 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0dcd70-5cc8-4e27-b3f6-cb033395e044 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:15:39.195463 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0dcd70-5cc8-4e27-b3f6-cb033395e044 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:15:39.203183 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 26/52] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 05:15:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:15:39.209604 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e133cce3-df1b-4e06-9fc8-79c827758f2f None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:39.253991 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:15:39.309313 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e133cce3-df1b-4e06-9fc8-79c827758f2f None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:39.343148 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4006be-61b9-4e46-8a1f-a22c101f73b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:39.343891 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4006be-61b9-4e46-8a1f-a22c101f73b9 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:39.344174 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4006be-61b9-4e46-8a1f-a22c101f73b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:39.344448 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4006be-61b9-4e46-8a1f-a22c101f73b9 None admin] PATH_INFO: `/v3/users/dd85f0a5ebc14829989036033392af00` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:39.344718 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0dcd70-5cc8-4e27-b3f6-cb033395e044 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:39.345580 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4006be-61b9-4e46-8a1f-a22c101f73b9 None admin] RBAC: Authorizing `identity:get_user(user_id=dd85f0a5ebc14829989036033392af00)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:15:39.347047 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4006be-61b9-4e46-8a1f-a22c101f73b9 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:15:39.348695 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 27/53] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 05:15:39 2022] GET /identity/v3/users/dd85f0a5ebc14829989036033392af00 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:15:39.353748 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4006be-61b9-4e46-8a1f-a22c101f73b9 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:39.443617 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0dcd70-5cc8-4e27-b3f6-cb033395e044 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:39.452499 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4006be-61b9-4e46-8a1f-a22c101f73b9 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:39.465737 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:15:39.478590 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce079f40-16a9-4b03-8161-b9138ce9198d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:39.479221 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce079f40-16a9-4b03-8161-b9138ce9198d None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:39.479507 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce079f40-16a9-4b03-8161-b9138ce9198d None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:39.479819 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce079f40-16a9-4b03-8161-b9138ce9198d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:39.480934 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce079f40-16a9-4b03-8161-b9138ce9198d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:15:39.482389 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce079f40-16a9-4b03-8161-b9138ce9198d None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:15:39.483985 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 27/54] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:15:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:15:39.488200 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d07194-006f-4146-9596-b5b0129d3b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:39.488859 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d07194-006f-4146-9596-b5b0129d3b5c None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:39.489136 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d07194-006f-4146-9596-b5b0129d3b5c None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:39.489406 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d07194-006f-4146-9596-b5b0129d3b5c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:39.489631 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce079f40-16a9-4b03-8161-b9138ce9198d None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:39.490519 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d07194-006f-4146-9596-b5b0129d3b5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:15:39.491991 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d07194-006f-4146-9596-b5b0129d3b5c None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:15:39.493545 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 28/55] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:15:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:15:39.498934 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d07194-006f-4146-9596-b5b0129d3b5c None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:39.517032 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:15:39.593160 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce079f40-16a9-4b03-8161-b9138ce9198d None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:39.597344 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d07194-006f-4146-9596-b5b0129d3b5c None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:39.625568 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d03066-9f95-42b8-aeed-ebb761a271fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:39.626170 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d03066-9f95-42b8-aeed-ebb761a271fb None admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:39.626450 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d03066-9f95-42b8-aeed-ebb761a271fb None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:39.626720 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d03066-9f95-42b8-aeed-ebb761a271fb None admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:39.627364 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d03066-9f95-42b8-aeed-ebb761a271fb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:15:39.628856 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d03066-9f95-42b8-aeed-ebb761a271fb None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:15:39.632088 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efdfa41-56bb-441d-b6fe-fc1abf861b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:39.632694 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efdfa41-56bb-441d-b6fe-fc1abf861b25 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:39.632974 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efdfa41-56bb-441d-b6fe-fc1abf861b25 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:39.633251 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efdfa41-56bb-441d-b6fe-fc1abf861b25 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:39.633982 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efdfa41-56bb-441d-b6fe-fc1abf861b25 None admin] RBAC: Adding query filter params (role.id=5b702713e40145b49e0b42abd0a5fba9, scope.domain.id=default, user.id=dd85f0a5ebc14829989036033392af00) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:15:39.634289 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efdfa41-56bb-441d-b6fe-fc1abf861b25 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:15:39.635756 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efdfa41-56bb-441d-b6fe-fc1abf861b25 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:15:39.641601 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 29/56] 10.222.0.16 () {56 vars in 1322 bytes} [Sun Sep 11 05:15:39 2022] GET /identity/v3/role_assignments?user.id=dd85f0a5ebc14829989036033392af00&scope.domain.id=default&role.id=5b702713e40145b49e0b42abd0a5fba9 => generated 530 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:15:39.660314 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 28/57] 10.222.0.16 () {60 vars in 1140 bytes} [Sun Sep 11 05:15:39 2022] POST /identity/v3/projects => generated 298 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 05:15:41.812983 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a648f-02d7-4eeb-810d-2e35d028634d None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:41.813394 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a648f-02d7-4eeb-810d-2e35d028634d None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:41.813536 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a648f-02d7-4eeb-810d-2e35d028634d None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:41.814893 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 30/58] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:15:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:15:41.820108 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c80db-7704-4fb3-808d-eabc5eb4d8cb None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:41.820492 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c80db-7704-4fb3-808d-eabc5eb4d8cb None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:41.820656 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c80db-7704-4fb3-808d-eabc5eb4d8cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:41.838271 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-4c1c80db-7704-4fb3-808d-eabc5eb4d8cb None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:15:41.839445 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-4c1c80db-7704-4fb3-808d-eabc5eb4d8cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:15:41.904891 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 29/59] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:15:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 05:15:42.175075 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9a648f-02d7-4eeb-810d-2e35d028634d None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:42.326857 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:15:42.381897 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9a648f-02d7-4eeb-810d-2e35d028634d None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:42.414409 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da699bea-c4a4-4ac8-b07f-76f2f14296b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:42.415024 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da699bea-c4a4-4ac8-b07f-76f2f14296b5 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:42.415301 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da699bea-c4a4-4ac8-b07f-76f2f14296b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:42.415572 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da699bea-c4a4-4ac8-b07f-76f2f14296b5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:42.416687 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da699bea-c4a4-4ac8-b07f-76f2f14296b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:15:42.418096 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da699bea-c4a4-4ac8-b07f-76f2f14296b5 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:15:42.419635 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 31/60] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:15:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:15:42.425236 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1c80db-7704-4fb3-808d-eabc5eb4d8cb None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:42.436407 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:15:42.521007 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1c80db-7704-4fb3-808d-eabc5eb4d8cb None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:42.553334 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1da5fd-1734-4ae2-8582-8cdaaf2f2894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:42.553927 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1da5fd-1734-4ae2-8582-8cdaaf2f2894 None admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:42.554205 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1da5fd-1734-4ae2-8582-8cdaaf2f2894 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:42.554476 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1da5fd-1734-4ae2-8582-8cdaaf2f2894 None admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:42.555128 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1da5fd-1734-4ae2-8582-8cdaaf2f2894 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:15:42.556598 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1da5fd-1734-4ae2-8582-8cdaaf2f2894 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:15:42.587902 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 30/61] 10.222.0.16 () {60 vars in 1132 bytes} [Sun Sep 11 05:15:42 2022] POST /identity/v3/users => generated 275 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:15:45.755844 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca8603b-e8a1-483c-b2af-ae4f361433de None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:45.756839 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca8603b-e8a1-483c-b2af-ae4f361433de None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:45.757325 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca8603b-e8a1-483c-b2af-ae4f361433de None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:45.758891 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 32/62] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:15:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:15:45.764431 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc90fd-315e-46f5-ba26-f3c0d0750f31 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:45.765269 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc90fd-315e-46f5-ba26-f3c0d0750f31 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:45.765763 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc90fd-315e-46f5-ba26-f3c0d0750f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:45.799785 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-c6fc90fd-315e-46f5-ba26-f3c0d0750f31 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:15:45.801233 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-c6fc90fd-315e-46f5-ba26-f3c0d0750f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:15:45.896775 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:15:45.905334 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 31/63] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:15:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 05:15:45.974704 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b89395-44bd-4097-9eb3-4f407ca65628 None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:45.975296 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b89395-44bd-4097-9eb3-4f407ca65628 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:45.975768 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b89395-44bd-4097-9eb3-4f407ca65628 None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:45.977566 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 33/64] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:15:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:15:45.982488 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465b81df-e449-4c44-bb69-c858dd7406bd None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:45.982978 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465b81df-e449-4c44-bb69-c858dd7406bd None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:45.983427 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465b81df-e449-4c44-bb69-c858dd7406bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:46.012748 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-465b81df-e449-4c44-bb69-c858dd7406bd None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:15:46.014198 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-465b81df-e449-4c44-bb69-c858dd7406bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:15:46.102202 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 32/65] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:15:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 05:15:46.219749 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b89395-44bd-4097-9eb3-4f407ca65628 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:46.244643 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc89616-1d01-4352-81b3-ad9442005b6e None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:46.245391 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc89616-1d01-4352-81b3-ad9442005b6e None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:46.245876 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc89616-1d01-4352-81b3-ad9442005b6e None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:46.247743 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 33/66] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:15:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:15:46.252435 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e259bd4-20d4-42f5-a515-69a916f05888 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:46.252934 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e259bd4-20d4-42f5-a515-69a916f05888 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:46.253428 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e259bd4-20d4-42f5-a515-69a916f05888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:46.284797 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-2e259bd4-20d4-42f5-a515-69a916f05888 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:15:46.287896 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-2e259bd4-20d4-42f5-a515-69a916f05888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:15:46.367398 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 34/67] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:15:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 05:15:46.433536 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e259bd4-20d4-42f5-a515-69a916f05888 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:46.459140 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b89395-44bd-4097-9eb3-4f407ca65628 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:46.476849 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:15:46.506233 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3ebc65-fb32-49dc-a371-4cf6142bdf14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:46.507125 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ebc65-fb32-49dc-a371-4cf6142bdf14 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:46.507587 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ebc65-fb32-49dc-a371-4cf6142bdf14 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:46.508116 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ebc65-fb32-49dc-a371-4cf6142bdf14 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:46.521095 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:15:46.524383 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3ebc65-fb32-49dc-a371-4cf6142bdf14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:15:46.530379 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-7e3ebc65-fb32-49dc-a371-4cf6142bdf14 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 05:15:46.530379 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:15:46.530379 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:15:46.530379 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:15:46.530379 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:15:46.530379 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:15:46.530379 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:15:46.530379 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:15:46.530379 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:15:46.530379 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:15:46.530379 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:15:46.530379 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:15:46.530379 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:15:46.530379 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:15:46.530379 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:15:46.530379 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:15:46.531221 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:15:46.531221 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:15:46.531221 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:15:46.531221 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:15:46.531221 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:15:46.531221 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:15:46.531221 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:15:46.531221 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:15:46.531221 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:15:46.531221 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:15:46.531221 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:15:46.531221 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:15:46.531221 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:15:46.531221 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:15:46.531221 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:15:46.531221 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:15:46.532016 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:15:46.532016 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:15:46.532016 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:15:46.532016 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:15:46.532016 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:15:46.532016 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:15:46.532016 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:15:46.532016 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:15:46.532016 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:15:46.532016 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:15:46.532016 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 05:15:46.532016 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:15:46.533243 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 34/68] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 05:15:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:15:46.534096 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74030292-b527-4e7e-b8ff-0293861eb092 None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:46.534382 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74030292-b527-4e7e-b8ff-0293861eb092 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:46.534650 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74030292-b527-4e7e-b8ff-0293861eb092 None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:46.540133 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 35/69] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:15:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:15:46.540133 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74030292-b527-4e7e-b8ff-0293861eb092 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:46.576417 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e259bd4-20d4-42f5-a515-69a916f05888 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:46.612302 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa698dd4-e3f4-4fbc-bb81-5ae89905a33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:46.613492 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa698dd4-e3f4-4fbc-bb81-5ae89905a33a None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:46.613959 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa698dd4-e3f4-4fbc-bb81-5ae89905a33a None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:46.614238 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa698dd4-e3f4-4fbc-bb81-5ae89905a33a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:46.624862 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa698dd4-e3f4-4fbc-bb81-5ae89905a33a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:15:46.630327 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-fa698dd4-e3f4-4fbc-bb81-5ae89905a33a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 05:15:46.630327 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:15:46.630327 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:15:46.630327 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:15:46.630327 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:15:46.630327 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:15:46.630327 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:15:46.630327 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:15:46.630327 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:15:46.630327 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:15:46.630327 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:15:46.630327 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:15:46.630327 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:15:46.630327 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:15:46.630327 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:15:46.630327 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:15:46.631208 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:15:46.631208 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:15:46.631208 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:15:46.631208 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:15:46.631208 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:15:46.631208 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:15:46.631208 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:15:46.631208 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:15:46.631208 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:15:46.631208 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:15:46.631208 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:15:46.631208 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:15:46.631208 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:15:46.631208 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:15:46.631208 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:15:46.631208 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:15:46.632005 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:15:46.632005 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:15:46.632005 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:15:46.632005 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:15:46.632005 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:15:46.632005 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:15:46.632005 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:15:46.632005 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:15:46.632005 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:15:46.632005 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:15:46.632005 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 05:15:46.632005 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:15:46.632005 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 35/70] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 05:15:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 05:15:46.634061 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be253d-7167-47b5-8d5b-d87b4dd6ebec None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:46.634350 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be253d-7167-47b5-8d5b-d87b4dd6ebec None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:46.634626 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be253d-7167-47b5-8d5b-d87b4dd6ebec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:46.656675 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-13be253d-7167-47b5-8d5b-d87b4dd6ebec None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:15:46.657880 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-13be253d-7167-47b5-8d5b-d87b4dd6ebec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:15:46.660762 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74030292-b527-4e7e-b8ff-0293861eb092 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:46.694661 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4b3110-ebf9-4d88-a688-852099b1d8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:46.695272 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b3110-ebf9-4d88-a688-852099b1d8e1 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:46.695556 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b3110-ebf9-4d88-a688-852099b1d8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:46.695875 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b3110-ebf9-4d88-a688-852099b1d8e1 None admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:46.696539 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4b3110-ebf9-4d88-a688-852099b1d8e1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:15:46.696846 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4b3110-ebf9-4d88-a688-852099b1d8e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:15:46.698232 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4b3110-ebf9-4d88-a688-852099b1d8e1 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:15:46.709860 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 36/71] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 11 05:15:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:15:46.711029 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d5d6f-0e9e-4c20-88a8-91853f997428 None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:46.711314 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d5d6f-0e9e-4c20-88a8-91853f997428 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:46.711589 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d5d6f-0e9e-4c20-88a8-91853f997428 None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:46.712826 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 37/72] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:15:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:15:46.713528 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3d5d6f-0e9e-4c20-88a8-91853f997428 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:46.725996 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 36/73] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:15:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 05:15:46.727031 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13be253d-7167-47b5-8d5b-d87b4dd6ebec None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:46.750504 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:15:46.783770 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:15:46.830219 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3d5d6f-0e9e-4c20-88a8-91853f997428 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:46.843817 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13be253d-7167-47b5-8d5b-d87b4dd6ebec None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:46.867121 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7badba36-fb1d-49b7-94eb-0714945860b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:46.868073 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7badba36-fb1d-49b7-94eb-0714945860b3 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:46.868592 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7badba36-fb1d-49b7-94eb-0714945860b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:46.869069 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7badba36-fb1d-49b7-94eb-0714945860b3 None admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:46.869928 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7badba36-fb1d-49b7-94eb-0714945860b3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:15:46.870433 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7badba36-fb1d-49b7-94eb-0714945860b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:15:46.871924 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7badba36-fb1d-49b7-94eb-0714945860b3 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:15:46.881201 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 38/74] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 05:15:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:15:46.884471 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c73124-7672-4272-a913-6a9d40003c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:46.885377 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c73124-7672-4272-a913-6a9d40003c81 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:46.885927 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c73124-7672-4272-a913-6a9d40003c81 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:46.886358 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7badba36-fb1d-49b7-94eb-0714945860b3 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:46.886472 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c73124-7672-4272-a913-6a9d40003c81 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:46.899321 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c73124-7672-4272-a913-6a9d40003c81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:15:46.904649 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-32c73124-7672-4272-a913-6a9d40003c81 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 05:15:46.904649 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:15:46.904649 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:15:46.904649 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:15:46.904649 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:15:46.904649 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:15:46.904649 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:15:46.904649 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:15:46.904649 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:15:46.904649 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:15:46.904649 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:15:46.904649 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:15:46.904649 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:15:46.904649 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:15:46.904649 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:15:46.904649 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:15:46.905474 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:15:46.905474 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:15:46.905474 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:15:46.905474 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:15:46.905474 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:15:46.905474 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:15:46.905474 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:15:46.905474 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:15:46.905474 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:15:46.905474 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:15:46.905474 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:15:46.905474 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:15:46.905474 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:15:46.905474 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:15:46.905474 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:15:46.905474 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:15:46.906234 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:15:46.906234 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:15:46.906234 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:15:46.906234 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:15:46.906234 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:15:46.906234 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:15:46.906234 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:15:46.906234 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:15:46.906234 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:15:46.906234 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:15:46.906234 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 05:15:46.906234 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:15:46.906234 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 37/75] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 11 05:15:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:15:46.911819 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e94836c-6d89-4db3-a62d-34a4a0c8038a None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:46.912115 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e94836c-6d89-4db3-a62d-34a4a0c8038a None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:46.912396 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e94836c-6d89-4db3-a62d-34a4a0c8038a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:46.931840 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-6e94836c-6d89-4db3-a62d-34a4a0c8038a None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:15:46.933096 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-6e94836c-6d89-4db3-a62d-34a4a0c8038a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:15:46.980716 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:15:46.986823 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7badba36-fb1d-49b7-94eb-0714945860b3 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:47.006234 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 38/76] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:15:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 05:15:47.008652 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e94836c-6d89-4db3-a62d-34a4a0c8038a None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:47.022784 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88818fe8-cc1d-4e61-a1e6-5a53bd461586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:47.023428 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88818fe8-cc1d-4e61-a1e6-5a53bd461586 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:47.023744 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88818fe8-cc1d-4e61-a1e6-5a53bd461586 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:47.024027 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88818fe8-cc1d-4e61-a1e6-5a53bd461586 None admin] PATH_INFO: `/v3/users/12f73b160732426b867094e731e1a1f8` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:47.039064 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88818fe8-cc1d-4e61-a1e6-5a53bd461586 None admin] RBAC: Authorizing `identity:get_user(user_id=12f73b160732426b867094e731e1a1f8)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:15:47.040560 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88818fe8-cc1d-4e61-a1e6-5a53bd461586 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:15:47.042364 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 39/77] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 05:15:46 2022] GET /identity/v3/users/12f73b160732426b867094e731e1a1f8 => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:15:47.046677 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:15:47.047321 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88818fe8-cc1d-4e61-a1e6-5a53bd461586 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:47.116547 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e94836c-6d89-4db3-a62d-34a4a0c8038a None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:47.150818 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f7259-aad9-4023-933a-81c46f16e35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:47.151321 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88818fe8-cc1d-4e61-a1e6-5a53bd461586 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:47.151494 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f7259-aad9-4023-933a-81c46f16e35f None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:47.151756 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f7259-aad9-4023-933a-81c46f16e35f None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:47.152036 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f7259-aad9-4023-933a-81c46f16e35f None admin] PATH_INFO: `/v3/users/dd85f0a5ebc14829989036033392af00` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:47.153157 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6f7259-aad9-4023-933a-81c46f16e35f None admin] RBAC: Authorizing `identity:get_user(user_id=dd85f0a5ebc14829989036033392af00)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:15:47.154611 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6f7259-aad9-4023-933a-81c46f16e35f None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:15:47.156368 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 39/78] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 05:15:47 2022] GET /identity/v3/users/dd85f0a5ebc14829989036033392af00 => generated 247 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:15:47.161382 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f7259-aad9-4023-933a-81c46f16e35f None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:47.187940 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a717ca68-7e5c-4ca8-ac7c-5aa2813263b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:47.188559 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a717ca68-7e5c-4ca8-ac7c-5aa2813263b3 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:47.188846 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a717ca68-7e5c-4ca8-ac7c-5aa2813263b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:47.189123 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a717ca68-7e5c-4ca8-ac7c-5aa2813263b3 None admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:47.189903 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a717ca68-7e5c-4ca8-ac7c-5aa2813263b3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:15:47.190210 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a717ca68-7e5c-4ca8-ac7c-5aa2813263b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:15:47.191750 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a717ca68-7e5c-4ca8-ac7c-5aa2813263b3 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:15:47.201586 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 40/79] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 05:15:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:15:47.207086 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a717ca68-7e5c-4ca8-ac7c-5aa2813263b3 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:47.226092 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:15:47.259562 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f7259-aad9-4023-933a-81c46f16e35f None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:47.261874 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:15:47.295618 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992279ce-c161-4862-8f95-6b41ddfcc09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:47.296286 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992279ce-c161-4862-8f95-6b41ddfcc09f None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:47.296567 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992279ce-c161-4862-8f95-6b41ddfcc09f None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:47.296840 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992279ce-c161-4862-8f95-6b41ddfcc09f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:47.306932 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992279ce-c161-4862-8f95-6b41ddfcc09f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:15:47.311797 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-992279ce-c161-4862-8f95-6b41ddfcc09f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 05:15:47.311797 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:15:47.311797 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:15:47.311797 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:15:47.311797 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:15:47.311797 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:15:47.311797 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:15:47.311797 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:15:47.311797 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:15:47.311797 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:15:47.311797 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:15:47.311797 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:15:47.311797 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:15:47.311797 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:15:47.311797 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:15:47.311797 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:15:47.312817 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:15:47.312817 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:15:47.312817 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:15:47.312817 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:15:47.312817 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:15:47.312817 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:15:47.312817 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:15:47.312817 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:15:47.312817 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:15:47.312817 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:15:47.312817 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:15:47.312817 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:15:47.312817 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:15:47.312817 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:15:47.312817 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:15:47.312817 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:15:47.314049 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:15:47.314049 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:15:47.314049 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:15:47.314049 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:15:47.314049 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:15:47.314049 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:15:47.314049 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:15:47.314049 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:15:47.314049 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:15:47.314049 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:15:47.314049 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 05:15:47.314049 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:15:47.314049 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 40/80] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 05:15:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:15:47.314049 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992279ce-c161-4862-8f95-6b41ddfcc09f None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:47.318502 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a717ca68-7e5c-4ca8-ac7c-5aa2813263b3 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:47.352763 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00296a92-94d1-425c-b6e0-001bdce84c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:47.353375 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00296a92-94d1-425c-b6e0-001bdce84c90 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:47.353657 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00296a92-94d1-425c-b6e0-001bdce84c90 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:47.353937 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00296a92-94d1-425c-b6e0-001bdce84c90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:47.409941 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992279ce-c161-4862-8f95-6b41ddfcc09f None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:47.419940 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00296a92-94d1-425c-b6e0-001bdce84c90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:15:47.421422 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00296a92-94d1-425c-b6e0-001bdce84c90 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:15:47.437976 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:15:47.442920 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f16b7b7-8d06-417f-b2a9-565821add66f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:47.443520 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f16b7b7-8d06-417f-b2a9-565821add66f None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:47.443836 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f16b7b7-8d06-417f-b2a9-565821add66f None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:47.444111 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f16b7b7-8d06-417f-b2a9-565821add66f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:47.475247 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:15:47.512532 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f16b7b7-8d06-417f-b2a9-565821add66f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:15:47.514007 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f16b7b7-8d06-417f-b2a9-565821add66f None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:15:47.520893 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 41/81] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 05:15:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 05:15:47.521564 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00296a92-94d1-425c-b6e0-001bdce84c90 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:47.613385 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 41/82] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 05:15:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 05:15:47.614638 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f16b7b7-8d06-417f-b2a9-565821add66f None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:47.619371 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00296a92-94d1-425c-b6e0-001bdce84c90 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:47.636121 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:15:47.655524 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54893482-b8ad-47c8-ac25-02328e0e650a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:47.656186 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54893482-b8ad-47c8-ac25-02328e0e650a None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:47.656469 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54893482-b8ad-47c8-ac25-02328e0e650a None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:47.656749 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54893482-b8ad-47c8-ac25-02328e0e650a None admin] PATH_INFO: `/v3/users/12f73b160732426b867094e731e1a1f8` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:47.657872 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54893482-b8ad-47c8-ac25-02328e0e650a None admin] RBAC: Authorizing `identity:get_user(user_id=12f73b160732426b867094e731e1a1f8)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:15:47.659332 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54893482-b8ad-47c8-ac25-02328e0e650a None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:15:47.661071 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 42/83] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 05:15:47 2022] GET /identity/v3/users/12f73b160732426b867094e731e1a1f8 => generated 275 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:15:47.661775 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54893482-b8ad-47c8-ac25-02328e0e650a None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:47.673881 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:15:47.712573 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f16b7b7-8d06-417f-b2a9-565821add66f None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:47.746623 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aafbf8-a9db-4216-9161-a40ef864b497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:47.747256 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aafbf8-a9db-4216-9161-a40ef864b497 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:47.747541 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aafbf8-a9db-4216-9161-a40ef864b497 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:47.747860 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aafbf8-a9db-4216-9161-a40ef864b497 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:47.748992 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aafbf8-a9db-4216-9161-a40ef864b497 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:15:47.750488 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aafbf8-a9db-4216-9161-a40ef864b497 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:15:47.752120 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 42/84] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:15:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:15:47.755919 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aafbf8-a9db-4216-9161-a40ef864b497 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:47.765721 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54893482-b8ad-47c8-ac25-02328e0e650a None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:47.807627 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647873cf-d045-4470-b27a-13f259d8425e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:47.808267 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647873cf-d045-4470-b27a-13f259d8425e None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:47.808555 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647873cf-d045-4470-b27a-13f259d8425e None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:47.808828 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647873cf-d045-4470-b27a-13f259d8425e None admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:47.809487 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647873cf-d045-4470-b27a-13f259d8425e None admin] RBAC: Adding query filter params (name=member) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:15:47.809791 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647873cf-d045-4470-b27a-13f259d8425e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:15:47.811165 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647873cf-d045-4470-b27a-13f259d8425e None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:15:47.819566 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 43/85] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 11 05:15:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:15:47.823807 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647873cf-d045-4470-b27a-13f259d8425e None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:47.858220 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aafbf8-a9db-4216-9161-a40ef864b497 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:47.868861 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:15:47.887218 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:15:47.892566 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b1adc-a519-49d7-a3ae-9763397ff356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:47.893205 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b1adc-a519-49d7-a3ae-9763397ff356 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:47.893488 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b1adc-a519-49d7-a3ae-9763397ff356 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:47.893766 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b1adc-a519-49d7-a3ae-9763397ff356 None admin] PATH_INFO: `/v3/projects/199292d828144a70992f2344ae63f351` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:47.894924 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371b1adc-a519-49d7-a3ae-9763397ff356 None admin] RBAC: Authorizing `identity:get_project(project_id=199292d828144a70992f2344ae63f351)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:15:47.897009 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371b1adc-a519-49d7-a3ae-9763397ff356 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:15:47.898653 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 43/86] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 05:15:47 2022] GET /identity/v3/projects/199292d828144a70992f2344ae63f351 => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:15:47.899431 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b1adc-a519-49d7-a3ae-9763397ff356 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:47.925651 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647873cf-d045-4470-b27a-13f259d8425e None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:47.959975 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091df2d8-9194-423e-804c-a06190c9933c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:47.960604 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091df2d8-9194-423e-804c-a06190c9933c None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:47.960882 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091df2d8-9194-423e-804c-a06190c9933c None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:47.961157 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091df2d8-9194-423e-804c-a06190c9933c None admin] PATH_INFO: `/v3/projects/199292d828144a70992f2344ae63f351` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:47.962317 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091df2d8-9194-423e-804c-a06190c9933c None admin] RBAC: Authorizing `identity:get_project(project_id=199292d828144a70992f2344ae63f351)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:15:47.963785 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091df2d8-9194-423e-804c-a06190c9933c None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:15:47.965405 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 44/87] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 05:15:47 2022] GET /identity/v3/projects/199292d828144a70992f2344ae63f351 => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:15:47.966140 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091df2d8-9194-423e-804c-a06190c9933c None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:48.001218 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b1adc-a519-49d7-a3ae-9763397ff356 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:48.033845 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c8cc1d-bbe3-4141-ad15-94d5e525a817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:48.034449 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c8cc1d-bbe3-4141-ad15-94d5e525a817 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:48.034727 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c8cc1d-bbe3-4141-ad15-94d5e525a817 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:48.035001 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c8cc1d-bbe3-4141-ad15-94d5e525a817 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:48.062695 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091df2d8-9194-423e-804c-a06190c9933c None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:48.076307 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:15:48.096846 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e1f113-7557-4f7b-b702-01c967a3f72e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:48.097446 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e1f113-7557-4f7b-b702-01c967a3f72e None admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:48.097726 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e1f113-7557-4f7b-b702-01c967a3f72e None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:48.097996 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e1f113-7557-4f7b-b702-01c967a3f72e None admin] PATH_INFO: `/v3/users` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:48.098670 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e1f113-7557-4f7b-b702-01c967a3f72e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:15:48.098782 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:15:48.100166 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e1f113-7557-4f7b-b702-01c967a3f72e None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:15:48.101438 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c8cc1d-bbe3-4141-ad15-94d5e525a817 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:15:48.103424 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c8cc1d-bbe3-4141-ad15-94d5e525a817 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:15:48.131027 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 45/88] 10.222.0.16 () {60 vars in 1132 bytes} [Sun Sep 11 05:15:47 2022] POST /identity/v3/users => generated 289 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:15:48.132390 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e1f113-7557-4f7b-b702-01c967a3f72e None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:48.239830 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 44/89] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 05:15:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 05:15:48.239830 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c8cc1d-bbe3-4141-ad15-94d5e525a817 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:48.270960 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e1f113-7557-4f7b-b702-01c967a3f72e None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:48.309419 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95ae1e4-4949-411b-8624-4889ee833bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:48.310832 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ae1e4-4949-411b-8624-4889ee833bf7 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:48.311267 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ae1e4-4949-411b-8624-4889ee833bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:48.311829 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ae1e4-4949-411b-8624-4889ee833bf7 None admin] PATH_INFO: `/v3/users/12f73b160732426b867094e731e1a1f8` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:48.313158 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95ae1e4-4949-411b-8624-4889ee833bf7 None admin] RBAC: Authorizing `identity:get_user(user_id=12f73b160732426b867094e731e1a1f8)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:15:48.314690 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95ae1e4-4949-411b-8624-4889ee833bf7 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:15:48.316319 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 46/90] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 05:15:48 2022] GET /identity/v3/users/12f73b160732426b867094e731e1a1f8 => generated 275 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:15:48.320592 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95ae1e4-4949-411b-8624-4889ee833bf7 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:48.357305 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:15:48.360873 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c8cc1d-bbe3-4141-ad15-94d5e525a817 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:48.370619 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:15:48.406821 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053aa876-fc8e-4dcc-ac98-b5ff945524df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:48.407452 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053aa876-fc8e-4dcc-ac98-b5ff945524df None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:48.407765 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053aa876-fc8e-4dcc-ac98-b5ff945524df None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:48.408041 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053aa876-fc8e-4dcc-ac98-b5ff945524df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:48.408786 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053aa876-fc8e-4dcc-ac98-b5ff945524df None admin] RBAC: Adding query filter params (role.id=aa7ff8e0ec1e48e5811335b9eb38b448, scope.project.id=199292d828144a70992f2344ae63f351, user.id=12f73b160732426b867094e731e1a1f8) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:15:48.411043 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053aa876-fc8e-4dcc-ac98-b5ff945524df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:15:48.411043 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053aa876-fc8e-4dcc-ac98-b5ff945524df None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:15:48.418323 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 45/91] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 05:15:48 2022] GET /identity/v3/role_assignments?user.id=12f73b160732426b867094e731e1a1f8&scope.project.id=199292d828144a70992f2344ae63f351&role.id=aa7ff8e0ec1e48e5811335b9eb38b448 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:15:48.419170 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053aa876-fc8e-4dcc-ac98-b5ff945524df None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:48.451789 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95ae1e4-4949-411b-8624-4889ee833bf7 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:48.498850 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1db0bb4-76d9-4703-8f31-c636a2ec6d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:48.499382 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db0bb4-76d9-4703-8f31-c636a2ec6d30 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:48.499657 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db0bb4-76d9-4703-8f31-c636a2ec6d30 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:48.499988 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db0bb4-76d9-4703-8f31-c636a2ec6d30 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:48.500798 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1db0bb4-76d9-4703-8f31-c636a2ec6d30 None admin] RBAC: Adding query filter params (role.id=5b702713e40145b49e0b42abd0a5fba9, scope.project.id=199292d828144a70992f2344ae63f351, user.id=dd85f0a5ebc14829989036033392af00) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:15:48.501113 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1db0bb4-76d9-4703-8f31-c636a2ec6d30 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:15:48.502636 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1db0bb4-76d9-4703-8f31-c636a2ec6d30 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:15:48.512893 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 47/92] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 05:15:48 2022] GET /identity/v3/role_assignments?user.id=dd85f0a5ebc14829989036033392af00&scope.project.id=199292d828144a70992f2344ae63f351&role.id=5b702713e40145b49e0b42abd0a5fba9 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:15:48.513783 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1db0bb4-76d9-4703-8f31-c636a2ec6d30 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:48.555930 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053aa876-fc8e-4dcc-ac98-b5ff945524df None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:48.611120 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45b8244-8a8f-42e7-b521-3547479951c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:48.611855 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b8244-8a8f-42e7-b521-3547479951c7 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:48.612130 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b8244-8a8f-42e7-b521-3547479951c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:48.612411 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b8244-8a8f-42e7-b521-3547479951c7 None admin] PATH_INFO: `/v3/projects/199292d828144a70992f2344ae63f351` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:48.614535 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45b8244-8a8f-42e7-b521-3547479951c7 None admin] RBAC: Authorizing `identity:get_project(project_id=199292d828144a70992f2344ae63f351)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:15:48.617004 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45b8244-8a8f-42e7-b521-3547479951c7 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:15:48.619258 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 46/93] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 05:15:48 2022] GET /identity/v3/projects/199292d828144a70992f2344ae63f351 => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:15:48.625314 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45b8244-8a8f-42e7-b521-3547479951c7 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:48.658990 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1db0bb4-76d9-4703-8f31-c636a2ec6d30 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:48.662156 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:15:48.683094 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:15:48.741593 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d28902f-509e-4a00-a058-0621f6f702d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:48.742596 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d28902f-509e-4a00-a058-0621f6f702d9 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:48.743101 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d28902f-509e-4a00-a058-0621f6f702d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:48.743571 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d28902f-509e-4a00-a058-0621f6f702d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:48.812443 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45b8244-8a8f-42e7-b521-3547479951c7 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:48.852697 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0380bbf-9ca2-498c-afa6-7223e402386c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:48.853704 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0380bbf-9ca2-498c-afa6-7223e402386c None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:48.854080 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0380bbf-9ca2-498c-afa6-7223e402386c None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:48.854456 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0380bbf-9ca2-498c-afa6-7223e402386c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:48.855750 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0380bbf-9ca2-498c-afa6-7223e402386c None admin] RBAC: Adding query filter params (role.id=ada04449ee1f42599a060f4795ec1a74, scope.project.id=199292d828144a70992f2344ae63f351, user.id=12f73b160732426b867094e731e1a1f8) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:15:48.856169 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0380bbf-9ca2-498c-afa6-7223e402386c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:15:48.857902 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0380bbf-9ca2-498c-afa6-7223e402386c None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:15:48.865208 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 47/94] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 05:15:48 2022] GET /identity/v3/role_assignments?user.id=12f73b160732426b867094e731e1a1f8&scope.project.id=199292d828144a70992f2344ae63f351&role.id=ada04449ee1f42599a060f4795ec1a74 => generated 259 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:15:48.886245 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d28902f-509e-4a00-a058-0621f6f702d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:15:48.888451 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d28902f-509e-4a00-a058-0621f6f702d9 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:15:49.050319 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 48/95] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 05:15:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 05:15:49.056428 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0380bbf-9ca2-498c-afa6-7223e402386c None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:49.170606 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:15:49.177313 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0380bbf-9ca2-498c-afa6-7223e402386c None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:49.218286 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b02683a-da33-479a-86b3-ed8a8b2d20f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:49.218938 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b02683a-da33-479a-86b3-ed8a8b2d20f4 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:49.219217 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b02683a-da33-479a-86b3-ed8a8b2d20f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:49.219491 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b02683a-da33-479a-86b3-ed8a8b2d20f4 None admin] PATH_INFO: `/v3/projects/7e503384e94e48219fa1772216cc5b53` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:49.220670 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b02683a-da33-479a-86b3-ed8a8b2d20f4 None admin] RBAC: Authorizing `identity:get_project(project_id=7e503384e94e48219fa1772216cc5b53)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:15:49.222124 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b02683a-da33-479a-86b3-ed8a8b2d20f4 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:15:49.224036 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 48/96] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 05:15:49 2022] GET /identity/v3/projects/7e503384e94e48219fa1772216cc5b53 => generated 312 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:15:49.229987 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d28902f-509e-4a00-a058-0621f6f702d9 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:49.232424 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:15:49.364265 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d28902f-509e-4a00-a058-0621f6f702d9 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:49.410164 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207166e5-735d-4889-b5b6-7fde5898182e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:49.410783 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207166e5-735d-4889-b5b6-7fde5898182e None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:49.411627 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207166e5-735d-4889-b5b6-7fde5898182e None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:49.411930 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207166e5-735d-4889-b5b6-7fde5898182e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:49.412662 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207166e5-735d-4889-b5b6-7fde5898182e None admin] RBAC: Adding query filter params (role.id=aa7ff8e0ec1e48e5811335b9eb38b448, scope.project.id=7e503384e94e48219fa1772216cc5b53, user.id=12f73b160732426b867094e731e1a1f8) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:15:49.412973 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207166e5-735d-4889-b5b6-7fde5898182e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:15:49.414424 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207166e5-735d-4889-b5b6-7fde5898182e None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:15:49.420680 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 49/97] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 05:15:49 2022] GET /identity/v3/role_assignments?user.id=12f73b160732426b867094e731e1a1f8&scope.project.id=7e503384e94e48219fa1772216cc5b53&role.id=aa7ff8e0ec1e48e5811335b9eb38b448 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:15:51.559965 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc4f4e-094c-428f-9391-690e447f50e3 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:51.561054 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc4f4e-094c-428f-9391-690e447f50e3 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:51.561544 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc4f4e-094c-428f-9391-690e447f50e3 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:51.563277 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 49/98] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:15:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:15:51.570143 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ccbeb-3b95-458f-9650-cfe83c2abaed None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:51.570689 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ccbeb-3b95-458f-9650-cfe83c2abaed None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:51.570689 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ccbeb-3b95-458f-9650-cfe83c2abaed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:51.596812 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-cc6ccbeb-3b95-458f-9650-cfe83c2abaed None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:15:51.598062 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-cc6ccbeb-3b95-458f-9650-cfe83c2abaed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:15:51.674495 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:15:51.687278 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e9ac88-6966-4312-a167-ea55ad0a4ebb None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:51.687968 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e9ac88-6966-4312-a167-ea55ad0a4ebb None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:51.688440 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e9ac88-6966-4312-a167-ea55ad0a4ebb None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:51.688790 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 50/99] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:15:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 05:15:51.690293 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 50/100] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:15:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:15:51.695934 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c52b07-f5ef-4087-adcf-f6f6c6f68697 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:51.696226 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c52b07-f5ef-4087-adcf-f6f6c6f68697 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:51.696506 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c52b07-f5ef-4087-adcf-f6f6c6f68697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:51.720842 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-c0c52b07-f5ef-4087-adcf-f6f6c6f68697 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:15:51.722090 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-c0c52b07-f5ef-4087-adcf-f6f6c6f68697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:15:51.771251 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd03a4c-1e39-4d32-84d3-ec0bb4977153 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:51.771938 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd03a4c-1e39-4d32-84d3-ec0bb4977153 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:51.772406 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd03a4c-1e39-4d32-84d3-ec0bb4977153 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:51.774124 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 51/101] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:15:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:15:51.779518 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbbe2f2-2963-4f65-b3a6-9c7786cd035a None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:51.780058 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbbe2f2-2963-4f65-b3a6-9c7786cd035a None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:51.780545 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbbe2f2-2963-4f65-b3a6-9c7786cd035a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:51.809512 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-bbbbe2f2-2963-4f65-b3a6-9c7786cd035a None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:15:51.811071 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-bbbbe2f2-2963-4f65-b3a6-9c7786cd035a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:15:51.814920 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 51/102] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:15:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 05:15:51.815766 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64f385e-38d8-4ad9-bf54-6b8608960f94 None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:51.816063 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64f385e-38d8-4ad9-bf54-6b8608960f94 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:51.816346 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64f385e-38d8-4ad9-bf54-6b8608960f94 None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:51.823715 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 52/103] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:15:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:15:51.825406 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab03a6-887e-4303-b88f-4a67b0df979d None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:51.825699 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab03a6-887e-4303-b88f-4a67b0df979d None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:51.825984 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab03a6-887e-4303-b88f-4a67b0df979d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:51.859446 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-efab03a6-887e-4303-b88f-4a67b0df979d None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:15:51.860709 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-efab03a6-887e-4303-b88f-4a67b0df979d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:15:51.917602 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 52/104] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:15:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 05:15:51.918734 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2748f252-d479-487e-a629-877b8e850924 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:51.919019 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2748f252-d479-487e-a629-877b8e850924 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:51.919419 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2748f252-d479-487e-a629-877b8e850924 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:51.920651 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 53/105] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:15:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:15:51.929258 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f59be-9574-4ccb-ba08-770bf885013f None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:51.929893 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f59be-9574-4ccb-ba08-770bf885013f None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:51.930394 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f59be-9574-4ccb-ba08-770bf885013f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:51.962593 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 53/106] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:15:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 05:15:51.963523 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-d87f59be-9574-4ccb-ba08-770bf885013f None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:15:51.964753 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-d87f59be-9574-4ccb-ba08-770bf885013f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:15:52.068532 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 54/107] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:15:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 05:15:52.159976 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efab03a6-887e-4303-b88f-4a67b0df979d None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:52.172088 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87f59be-9574-4ccb-ba08-770bf885013f None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:52.211352 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:15:52.268027 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:15:52.353705 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efab03a6-887e-4303-b88f-4a67b0df979d None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:52.361122 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87f59be-9574-4ccb-ba08-770bf885013f None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:52.416028 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d708aab1-4910-418d-8d84-ef432ee2820e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:52.416914 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708aab1-4910-418d-8d84-ef432ee2820e None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:52.417362 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708aab1-4910-418d-8d84-ef432ee2820e None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:52.417788 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708aab1-4910-418d-8d84-ef432ee2820e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:52.419058 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d708aab1-4910-418d-8d84-ef432ee2820e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:15:52.420765 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d708aab1-4910-418d-8d84-ef432ee2820e None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:15:52.420984 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c966ea8-ac4e-40bd-a4f7-8bb888db117e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:52.421688 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c966ea8-ac4e-40bd-a4f7-8bb888db117e None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:52.421973 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c966ea8-ac4e-40bd-a4f7-8bb888db117e None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:52.422249 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c966ea8-ac4e-40bd-a4f7-8bb888db117e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:52.423138 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 54/108] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:15:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:15:52.424084 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d708aab1-4910-418d-8d84-ef432ee2820e None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:52.433571 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c966ea8-ac4e-40bd-a4f7-8bb888db117e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:15:52.438429 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-5c966ea8-ac4e-40bd-a4f7-8bb888db117e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 05:15:52.438429 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:15:52.438429 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:15:52.438429 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:15:52.438429 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:15:52.438429 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:15:52.438429 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:15:52.438429 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:15:52.438429 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:15:52.438429 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:15:52.438429 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:15:52.438429 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:15:52.438429 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:15:52.438429 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:15:52.438429 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:15:52.438429 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:15:52.439277 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:15:52.439277 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:15:52.439277 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:15:52.439277 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:15:52.439277 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:15:52.439277 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:15:52.439277 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:15:52.439277 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:15:52.439277 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:15:52.439277 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:15:52.439277 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:15:52.439277 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:15:52.439277 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:15:52.439277 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:15:52.439277 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:15:52.439277 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:15:52.440071 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:15:52.440071 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:15:52.440071 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:15:52.440071 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:15:52.440071 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:15:52.440071 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:15:52.440071 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:15:52.440071 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:15:52.440071 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:15:52.440071 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:15:52.440071 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 05:15:52.440071 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:15:52.440071 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 55/109] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 05:15:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:15:52.440712 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c966ea8-ac4e-40bd-a4f7-8bb888db117e None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:52.529836 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:15:52.536210 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d708aab1-4910-418d-8d84-ef432ee2820e None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:52.548170 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c966ea8-ac4e-40bd-a4f7-8bb888db117e None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:52.560683 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:15:52.573394 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3865e5-5ac0-4cf9-8249-9f73752a64bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:52.574664 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3865e5-5ac0-4cf9-8249-9f73752a64bf None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:52.574941 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3865e5-5ac0-4cf9-8249-9f73752a64bf None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:52.575733 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3865e5-5ac0-4cf9-8249-9f73752a64bf None admin] PATH_INFO: `/v3/roles/member` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:52.586979 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73195a2f-8769-4128-83c8-f16a9c64c1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:52.587720 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73195a2f-8769-4128-83c8-f16a9c64c1fc None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:52.588023 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73195a2f-8769-4128-83c8-f16a9c64c1fc None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:52.588280 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73195a2f-8769-4128-83c8-f16a9c64c1fc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:52.588494 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3865e5-5ac0-4cf9-8249-9f73752a64bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:15:52.593505 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-fe3865e5-5ac0-4cf9-8249-9f73752a64bf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 05:15:52.593505 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:15:52.593505 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:15:52.593505 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:15:52.593505 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:15:52.593505 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:15:52.593505 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:15:52.593505 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:15:52.593505 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:15:52.593505 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:15:52.593505 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:15:52.593505 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:15:52.593505 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:15:52.593505 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:15:52.593505 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:15:52.593505 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:15:52.594403 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:15:52.594403 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:15:52.594403 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:15:52.594403 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:15:52.594403 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:15:52.594403 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:15:52.594403 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:15:52.594403 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:15:52.594403 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:15:52.594403 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:15:52.594403 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:15:52.594403 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:15:52.594403 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:15:52.594403 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:15:52.594403 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:15:52.594403 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:15:52.595181 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:15:52.595181 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:15:52.595181 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:15:52.595181 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:15:52.595181 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:15:52.595181 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:15:52.595181 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:15:52.595181 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:15:52.595181 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:15:52.595181 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:15:52.595181 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 05:15:52.595181 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:15:52.595181 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 55/110] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 05:15:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:15:52.595870 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3865e5-5ac0-4cf9-8249-9f73752a64bf None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:52.602436 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73195a2f-8769-4128-83c8-f16a9c64c1fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:15:52.607330 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-73195a2f-8769-4128-83c8-f16a9c64c1fc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 05:15:52.607330 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:15:52.607330 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:15:52.607330 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:15:52.607330 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:15:52.607330 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:15:52.607330 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:15:52.607330 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:15:52.607330 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:15:52.607330 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:15:52.607330 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:15:52.607330 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:15:52.607330 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:15:52.607330 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:15:52.607330 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:15:52.607330 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:15:52.608248 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:15:52.608248 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:15:52.608248 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:15:52.608248 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:15:52.608248 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:15:52.608248 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:15:52.608248 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:15:52.608248 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:15:52.608248 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:15:52.608248 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:15:52.608248 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:15:52.608248 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:15:52.608248 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:15:52.608248 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:15:52.608248 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:15:52.608248 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:15:52.609010 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:15:52.609010 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:15:52.609010 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:15:52.609010 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:15:52.609010 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:15:52.609010 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:15:52.609010 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:15:52.609010 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:15:52.609010 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:15:52.609010 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:15:52.609010 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 05:15:52.609010 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:15:52.613383 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 56/111] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 05:15:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:15:52.614052 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73195a2f-8769-4128-83c8-f16a9c64c1fc None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:52.711735 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3865e5-5ac0-4cf9-8249-9f73752a64bf None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:52.717379 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73195a2f-8769-4128-83c8-f16a9c64c1fc None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:52.748908 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79a8488-6921-4f36-9902-57d017508e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:52.752402 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a8488-6921-4f36-9902-57d017508e2e None admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:52.752402 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a8488-6921-4f36-9902-57d017508e2e None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:52.752402 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a8488-6921-4f36-9902-57d017508e2e None admin] PATH_INFO: `/v3/projects` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:52.752402 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79a8488-6921-4f36-9902-57d017508e2e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:15:52.752698 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79a8488-6921-4f36-9902-57d017508e2e None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:15:52.755795 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796c9ccc-ea94-4a7c-ac1d-1ef37dfc0e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:52.756435 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c9ccc-ea94-4a7c-ac1d-1ef37dfc0e71 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:52.756743 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c9ccc-ea94-4a7c-ac1d-1ef37dfc0e71 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:52.756986 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c9ccc-ea94-4a7c-ac1d-1ef37dfc0e71 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:52.768055 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796c9ccc-ea94-4a7c-ac1d-1ef37dfc0e71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:15:52.774722 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-796c9ccc-ea94-4a7c-ac1d-1ef37dfc0e71 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 05:15:52.774722 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:15:52.774722 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:15:52.774722 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:15:52.774722 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:15:52.774722 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:15:52.774722 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:15:52.774722 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:15:52.774722 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:15:52.774722 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:15:52.774722 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:15:52.774722 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:15:52.774722 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:15:52.774722 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:15:52.774722 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:15:52.774722 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:15:52.775805 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:15:52.775805 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:15:52.775805 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:15:52.775805 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:15:52.775805 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:15:52.775805 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:15:52.775805 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:15:52.775805 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:15:52.775805 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:15:52.775805 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:15:52.775805 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:15:52.775805 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:15:52.775805 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:15:52.775805 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:15:52.775805 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:15:52.775805 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:15:52.776755 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:15:52.776755 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:15:52.776755 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:15:52.776755 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:15:52.776755 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:15:52.776755 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:15:52.776755 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:15:52.776755 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:15:52.776755 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:15:52.776755 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:15:52.776755 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 05:15:52.776755 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:15:52.776755 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 57/112] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 11 05:15:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:15:52.781430 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796c9ccc-ea94-4a7c-ac1d-1ef37dfc0e71 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:52.783776 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 56/113] 10.222.0.16 () {60 vars in 1141 bytes} [Sun Sep 11 05:15:52 2022] POST /identity/v3/projects => generated 302 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:15:52.784800 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79a8488-6921-4f36-9902-57d017508e2e None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:52.785747 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:15:52.838025 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:15:52.916815 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796c9ccc-ea94-4a7c-ac1d-1ef37dfc0e71 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:52.936832 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79a8488-6921-4f36-9902-57d017508e2e None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:52.971571 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f274ab2-9bd0-456c-bdb4-1f7e92041bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:52.972863 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f274ab2-9bd0-456c-bdb4-1f7e92041bfa None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:52.973355 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f274ab2-9bd0-456c-bdb4-1f7e92041bfa None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:52.974423 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f274ab2-9bd0-456c-bdb4-1f7e92041bfa None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:52.975112 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f274ab2-9bd0-456c-bdb4-1f7e92041bfa None admin] RBAC: Adding query filter params (name=reader) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:15:52.975668 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f274ab2-9bd0-456c-bdb4-1f7e92041bfa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:15:52.977593 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f274ab2-9bd0-456c-bdb4-1f7e92041bfa None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:15:52.987483 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 58/114] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 11 05:15:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:15:52.989197 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f274ab2-9bd0-456c-bdb4-1f7e92041bfa None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:52.992264 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3e92b3-ed8d-43a0-830d-819b4e1c413d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:52.992664 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e92b3-ed8d-43a0-830d-819b4e1c413d None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:52.994597 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e92b3-ed8d-43a0-830d-819b4e1c413d None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:52.994597 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e92b3-ed8d-43a0-830d-819b4e1c413d None admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:52.994597 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3e92b3-ed8d-43a0-830d-819b4e1c413d None admin] RBAC: Adding query filter params (name=member) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:15:52.994597 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3e92b3-ed8d-43a0-830d-819b4e1c413d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:15:52.996833 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3e92b3-ed8d-43a0-830d-819b4e1c413d None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:15:53.006056 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 57/115] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 11 05:15:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:15:53.010286 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3e92b3-ed8d-43a0-830d-819b4e1c413d None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:53.071811 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:15:53.108247 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:15:53.111561 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f274ab2-9bd0-456c-bdb4-1f7e92041bfa None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:53.112150 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3e92b3-ed8d-43a0-830d-819b4e1c413d None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:53.147932 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06df3c9-e1b4-43d8-984f-a788ad2bb363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:53.148554 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06df3c9-e1b4-43d8-984f-a788ad2bb363 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:53.148835 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06df3c9-e1b4-43d8-984f-a788ad2bb363 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:53.149109 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06df3c9-e1b4-43d8-984f-a788ad2bb363 None admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:53.149554 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9593ea-8581-4b73-857f-31c262ac33d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:53.149781 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06df3c9-e1b4-43d8-984f-a788ad2bb363 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:15:53.150085 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06df3c9-e1b4-43d8-984f-a788ad2bb363 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:15:53.150185 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9593ea-8581-4b73-857f-31c262ac33d5 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:53.150438 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9593ea-8581-4b73-857f-31c262ac33d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:53.150712 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9593ea-8581-4b73-857f-31c262ac33d5 None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:53.151377 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9593ea-8581-4b73-857f-31c262ac33d5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:15:53.151468 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06df3c9-e1b4-43d8-984f-a788ad2bb363 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:15:53.151701 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9593ea-8581-4b73-857f-31c262ac33d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:15:53.153136 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9593ea-8581-4b73-857f-31c262ac33d5 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:15:53.160484 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 58/116] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 05:15:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:15:53.161924 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06df3c9-e1b4-43d8-984f-a788ad2bb363 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:53.167956 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 59/117] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 05:15:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:15:53.168620 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9593ea-8581-4b73-857f-31c262ac33d5 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:53.268781 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9593ea-8581-4b73-857f-31c262ac33d5 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:53.274244 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06df3c9-e1b4-43d8-984f-a788ad2bb363 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:53.294858 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:15:53.303496 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb5acd1-9595-4286-8df2-f886fcf0d547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:53.304204 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb5acd1-9595-4286-8df2-f886fcf0d547 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:53.304485 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb5acd1-9595-4286-8df2-f886fcf0d547 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:53.304814 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb5acd1-9595-4286-8df2-f886fcf0d547 None admin] PATH_INFO: `/v3/users/12f73b160732426b867094e731e1a1f8` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:53.305902 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb5acd1-9595-4286-8df2-f886fcf0d547 None admin] RBAC: Authorizing `identity:get_user(user_id=12f73b160732426b867094e731e1a1f8)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:15:53.307437 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb5acd1-9595-4286-8df2-f886fcf0d547 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:15:53.313359 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 60/118] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 05:15:53 2022] GET /identity/v3/users/12f73b160732426b867094e731e1a1f8 => generated 275 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:15:53.313359 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac8c4f-1de4-43c2-b373-a2688a1803ae None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:53.313359 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac8c4f-1de4-43c2-b373-a2688a1803ae None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:53.313359 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac8c4f-1de4-43c2-b373-a2688a1803ae None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:53.313359 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 61/119] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:15:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:15:53.313359 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ac8c4f-1de4-43c2-b373-a2688a1803ae None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:53.321595 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b56680-b883-44d2-9946-619ec411165e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:53.322251 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b56680-b883-44d2-9946-619ec411165e None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:53.322537 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b56680-b883-44d2-9946-619ec411165e None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:53.322813 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b56680-b883-44d2-9946-619ec411165e None admin] PATH_INFO: `/v3/users/c395bb82392343abb1eb618fa2d60676` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:53.337805 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b56680-b883-44d2-9946-619ec411165e None admin] RBAC: Authorizing `identity:get_user(user_id=c395bb82392343abb1eb618fa2d60676)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:15:53.339291 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b56680-b883-44d2-9946-619ec411165e None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:15:53.341200 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 59/120] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 05:15:53 2022] GET /identity/v3/users/c395bb82392343abb1eb618fa2d60676 => generated 289 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:15:53.341785 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b56680-b883-44d2-9946-619ec411165e None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:53.361009 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:15:53.428289 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ac8c4f-1de4-43c2-b373-a2688a1803ae None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:53.450936 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b56680-b883-44d2-9946-619ec411165e None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:53.461234 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6c867c-5058-4717-98b8-a22cdb515cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:53.461865 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c867c-5058-4717-98b8-a22cdb515cef None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:53.462145 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c867c-5058-4717-98b8-a22cdb515cef None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:53.462421 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c867c-5058-4717-98b8-a22cdb515cef None admin] PATH_INFO: `/v3/users/12f73b160732426b867094e731e1a1f8` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:53.463539 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6c867c-5058-4717-98b8-a22cdb515cef None admin] RBAC: Authorizing `identity:get_user(user_id=12f73b160732426b867094e731e1a1f8)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:15:53.465045 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6c867c-5058-4717-98b8-a22cdb515cef None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:15:53.466782 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 62/121] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 05:15:53 2022] GET /identity/v3/users/12f73b160732426b867094e731e1a1f8 => generated 275 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:15:53.467380 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6c867c-5058-4717-98b8-a22cdb515cef None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:53.488395 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89329807-224a-4b79-95a3-0928f438e198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:53.489852 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89329807-224a-4b79-95a3-0928f438e198 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:53.490277 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89329807-224a-4b79-95a3-0928f438e198 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:53.490694 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89329807-224a-4b79-95a3-0928f438e198 None admin] PATH_INFO: `/v3/users/dd85f0a5ebc14829989036033392af00` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:53.492127 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89329807-224a-4b79-95a3-0928f438e198 None admin] RBAC: Authorizing `identity:get_user(user_id=dd85f0a5ebc14829989036033392af00)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:15:53.493797 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89329807-224a-4b79-95a3-0928f438e198 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:15:53.495961 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 60/122] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 05:15:53 2022] GET /identity/v3/users/dd85f0a5ebc14829989036033392af00 => generated 247 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:15:53.497214 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829811e7-8414-4484-9a4a-3bc889274100 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:53.497501 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829811e7-8414-4484-9a4a-3bc889274100 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:53.497777 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829811e7-8414-4484-9a4a-3bc889274100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:53.516136 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-829811e7-8414-4484-9a4a-3bc889274100 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:15:53.517662 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-829811e7-8414-4484-9a4a-3bc889274100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:15:53.532701 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:15:53.573333 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6c867c-5058-4717-98b8-a22cdb515cef None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:53.592306 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 61/123] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:15:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 05:15:53.593783 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829811e7-8414-4484-9a4a-3bc889274100 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:53.608345 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a2ec4a-d23d-4fc9-8c70-0f0d50d5f51d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:53.608986 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a2ec4a-d23d-4fc9-8c70-0f0d50d5f51d None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:53.609267 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a2ec4a-d23d-4fc9-8c70-0f0d50d5f51d None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:53.609651 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a2ec4a-d23d-4fc9-8c70-0f0d50d5f51d None admin] PATH_INFO: `/v3/projects/199292d828144a70992f2344ae63f351` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:53.610799 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a2ec4a-d23d-4fc9-8c70-0f0d50d5f51d None admin] RBAC: Authorizing `identity:get_project(project_id=199292d828144a70992f2344ae63f351)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:15:53.612441 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a2ec4a-d23d-4fc9-8c70-0f0d50d5f51d None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:15:53.619415 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 63/124] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 05:15:53 2022] GET /identity/v3/projects/199292d828144a70992f2344ae63f351 => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:15:53.619415 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a2ec4a-d23d-4fc9-8c70-0f0d50d5f51d None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:53.636170 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:15:53.727222 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a2ec4a-d23d-4fc9-8c70-0f0d50d5f51d None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:53.749072 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829811e7-8414-4484-9a4a-3bc889274100 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:53.769587 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:15:53.776184 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875ec42a-6a95-404a-848d-21307c8206d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:53.776951 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ec42a-6a95-404a-848d-21307c8206d4 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:53.777276 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ec42a-6a95-404a-848d-21307c8206d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:53.777562 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ec42a-6a95-404a-848d-21307c8206d4 None admin] PATH_INFO: `/v3/projects/199292d828144a70992f2344ae63f351` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:53.778697 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875ec42a-6a95-404a-848d-21307c8206d4 None admin] RBAC: Authorizing `identity:get_project(project_id=199292d828144a70992f2344ae63f351)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:15:53.780216 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875ec42a-6a95-404a-848d-21307c8206d4 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:15:53.782226 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 64/125] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 05:15:53 2022] GET /identity/v3/projects/199292d828144a70992f2344ae63f351 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:15:53.783106 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875ec42a-6a95-404a-848d-21307c8206d4 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:53.796474 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aab51c6-d751-46bc-979d-e23a48c6ef35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:53.797103 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab51c6-d751-46bc-979d-e23a48c6ef35 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:53.797387 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab51c6-d751-46bc-979d-e23a48c6ef35 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:53.797673 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab51c6-d751-46bc-979d-e23a48c6ef35 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:53.880881 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aab51c6-d751-46bc-979d-e23a48c6ef35 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:15:53.882365 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aab51c6-d751-46bc-979d-e23a48c6ef35 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:15:53.898708 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875ec42a-6a95-404a-848d-21307c8206d4 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:53.901985 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:15:53.934024 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1954ac0f-75ca-4dec-baaf-11f935339c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:53.934873 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1954ac0f-75ca-4dec-baaf-11f935339c8c None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:53.935162 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1954ac0f-75ca-4dec-baaf-11f935339c8c None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:53.935441 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1954ac0f-75ca-4dec-baaf-11f935339c8c None admin] PATH_INFO: `/v3/projects/199292d828144a70992f2344ae63f351` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:53.936672 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1954ac0f-75ca-4dec-baaf-11f935339c8c None admin] RBAC: Authorizing `identity:get_project(project_id=199292d828144a70992f2344ae63f351)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:15:53.938137 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1954ac0f-75ca-4dec-baaf-11f935339c8c None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:15:53.943754 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 65/126] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 05:15:53 2022] GET /identity/v3/projects/199292d828144a70992f2344ae63f351 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:15:53.943754 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1954ac0f-75ca-4dec-baaf-11f935339c8c None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:53.995055 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 62/127] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 05:15:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 05:15:53.996486 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aab51c6-d751-46bc-979d-e23a48c6ef35 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:54.012262 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:15:54.048555 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1954ac0f-75ca-4dec-baaf-11f935339c8c None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:54.086360 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0b78d9-948c-4bc4-98ad-16b5207eea20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:54.087294 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b78d9-948c-4bc4-98ad-16b5207eea20 None admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:54.087753 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b78d9-948c-4bc4-98ad-16b5207eea20 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:54.088176 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b78d9-948c-4bc4-98ad-16b5207eea20 None admin] PATH_INFO: `/v3/projects/199292d828144a70992f2344ae63f351/users/12f73b160732426b867094e731e1a1f8/roles/aa7ff8e0ec1e48e5811335b9eb38b448` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:54.090328 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0b78d9-948c-4bc4-98ad-16b5207eea20 None admin] RBAC: Authorizing `identity:create_grant(project_id=199292d828144a70992f2344ae63f351, user_id=12f73b160732426b867094e731e1a1f8, role_id=aa7ff8e0ec1e48e5811335b9eb38b448)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:15:54.091980 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0b78d9-948c-4bc4-98ad-16b5207eea20 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:15:54.102560 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aab51c6-d751-46bc-979d-e23a48c6ef35 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:54.107940 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 66/128] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 11 05:15:53 2022] PUT /identity/v3/projects/199292d828144a70992f2344ae63f351/users/12f73b160732426b867094e731e1a1f8/roles/aa7ff8e0ec1e48e5811335b9eb38b448 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:15:54.108551 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0b78d9-948c-4bc4-98ad-16b5207eea20 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:54.125342 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:15:54.142864 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f575c6f7-27c1-428f-85ab-0cc3e3313a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:54.143719 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f575c6f7-27c1-428f-85ab-0cc3e3313a5f None admin] REQUEST_METHOD: `PUT` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:54.144177 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f575c6f7-27c1-428f-85ab-0cc3e3313a5f None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:54.144562 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f575c6f7-27c1-428f-85ab-0cc3e3313a5f None admin] PATH_INFO: `/v3/projects/199292d828144a70992f2344ae63f351/users/12f73b160732426b867094e731e1a1f8/roles/ada04449ee1f42599a060f4795ec1a74` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:54.147167 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f575c6f7-27c1-428f-85ab-0cc3e3313a5f None admin] RBAC: Authorizing `identity:create_grant(project_id=199292d828144a70992f2344ae63f351, user_id=12f73b160732426b867094e731e1a1f8, role_id=ada04449ee1f42599a060f4795ec1a74)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:15:54.148715 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f575c6f7-27c1-428f-85ab-0cc3e3313a5f None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:15:54.170075 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 63/129] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 11 05:15:53 2022] PUT /identity/v3/projects/199292d828144a70992f2344ae63f351/users/12f73b160732426b867094e731e1a1f8/roles/ada04449ee1f42599a060f4795ec1a74 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:15:54.172645 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f575c6f7-27c1-428f-85ab-0cc3e3313a5f None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:54.304407 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0b78d9-948c-4bc4-98ad-16b5207eea20 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:54.354091 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f575c6f7-27c1-428f-85ab-0cc3e3313a5f None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:54.357627 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:15:54.368332 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ca9b33-9ad7-4cfd-88ba-3204b99b853c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:54.369130 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca9b33-9ad7-4cfd-88ba-3204b99b853c None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:54.369522 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca9b33-9ad7-4cfd-88ba-3204b99b853c None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:54.369879 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca9b33-9ad7-4cfd-88ba-3204b99b853c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:54.385712 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ca9b33-9ad7-4cfd-88ba-3204b99b853c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:15:54.392404 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-02ca9b33-9ad7-4cfd-88ba-3204b99b853c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 05:15:54.392404 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:15:54.392404 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:15:54.392404 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:15:54.392404 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:15:54.392404 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:15:54.392404 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:15:54.392404 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:15:54.392404 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:15:54.392404 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:15:54.392404 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:15:54.392404 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:15:54.392404 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:15:54.392404 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:15:54.392404 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:15:54.392404 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:15:54.393279 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:15:54.393279 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:15:54.393279 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:15:54.393279 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:15:54.393279 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:15:54.393279 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:15:54.393279 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:15:54.393279 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:15:54.393279 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:15:54.393279 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:15:54.393279 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:15:54.393279 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:15:54.393279 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:15:54.393279 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:15:54.393279 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:15:54.393279 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:15:54.394124 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:15:54.394124 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:15:54.394124 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:15:54.394124 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:15:54.394124 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:15:54.394124 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:15:54.394124 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:15:54.394124 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:15:54.394124 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:15:54.394124 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:15:54.394124 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 05:15:54.394124 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:15:54.394709 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd81daf7-6b4a-49d0-9782-704fc8bb5017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:54.394709 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd81daf7-6b4a-49d0-9782-704fc8bb5017 None admin] REQUEST_METHOD: `PUT` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:54.394846 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 67/130] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 05:15:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:15:54.394908 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd81daf7-6b4a-49d0-9782-704fc8bb5017 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:54.394908 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd81daf7-6b4a-49d0-9782-704fc8bb5017 None admin] PATH_INFO: `/v3/projects/199292d828144a70992f2344ae63f351/users/dd85f0a5ebc14829989036033392af00/roles/5b702713e40145b49e0b42abd0a5fba9` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:54.395029 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ca9b33-9ad7-4cfd-88ba-3204b99b853c None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:54.397404 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd81daf7-6b4a-49d0-9782-704fc8bb5017 None admin] RBAC: Authorizing `identity:create_grant(project_id=199292d828144a70992f2344ae63f351, user_id=dd85f0a5ebc14829989036033392af00, role_id=5b702713e40145b49e0b42abd0a5fba9)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:15:54.398195 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd81daf7-6b4a-49d0-9782-704fc8bb5017 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:15:54.415710 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 64/131] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 11 05:15:54 2022] PUT /identity/v3/projects/199292d828144a70992f2344ae63f351/users/dd85f0a5ebc14829989036033392af00/roles/5b702713e40145b49e0b42abd0a5fba9 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:15:54.416557 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd81daf7-6b4a-49d0-9782-704fc8bb5017 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:54.461971 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:15:54.539237 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ca9b33-9ad7-4cfd-88ba-3204b99b853c None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:54.545101 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd81daf7-6b4a-49d0-9782-704fc8bb5017 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:54.576839 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b432623-fd7b-40d5-9bac-9d09a6082a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:54.577769 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b432623-fd7b-40d5-9bac-9d09a6082a7b None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:54.578101 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b432623-fd7b-40d5-9bac-9d09a6082a7b None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:54.578379 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b432623-fd7b-40d5-9bac-9d09a6082a7b None admin] PATH_INFO: `/v3/projects/199292d828144a70992f2344ae63f351` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:54.579585 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b432623-fd7b-40d5-9bac-9d09a6082a7b None admin] RBAC: Authorizing `identity:get_project(project_id=199292d828144a70992f2344ae63f351)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:15:54.581164 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b432623-fd7b-40d5-9bac-9d09a6082a7b None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:15:54.582929 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 68/132] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 05:15:54 2022] GET /identity/v3/projects/199292d828144a70992f2344ae63f351 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:15:54.591867 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0b6621-ae17-4b76-b790-10aa336d074b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:54.592939 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b432623-fd7b-40d5-9bac-9d09a6082a7b None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:54.596591 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0b6621-ae17-4b76-b790-10aa336d074b None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:54.597065 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0b6621-ae17-4b76-b790-10aa336d074b None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:54.597136 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0b6621-ae17-4b76-b790-10aa336d074b None admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:54.597829 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0b6621-ae17-4b76-b790-10aa336d074b None admin] RBAC: Adding query filter params (name=member) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:15:54.599514 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0b6621-ae17-4b76-b790-10aa336d074b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:15:54.601015 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0b6621-ae17-4b76-b790-10aa336d074b None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:15:54.621827 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 65/133] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 11 05:15:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:15:54.632128 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0b6621-ae17-4b76-b790-10aa336d074b None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:54.720742 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:15:54.772989 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b432623-fd7b-40d5-9bac-9d09a6082a7b None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:54.815067 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:15:54.820392 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4027dd-c848-4097-aa21-2d4997b5b555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:54.821032 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4027dd-c848-4097-aa21-2d4997b5b555 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:54.821307 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4027dd-c848-4097-aa21-2d4997b5b555 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:54.821583 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4027dd-c848-4097-aa21-2d4997b5b555 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:54.822331 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4027dd-c848-4097-aa21-2d4997b5b555 None admin] RBAC: Adding query filter params (role.id=6f65b7f0071d466aa6ecf94916300a38, scope.project.id=199292d828144a70992f2344ae63f351, user.id=c395bb82392343abb1eb618fa2d60676) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:15:54.822642 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4027dd-c848-4097-aa21-2d4997b5b555 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:15:54.823656 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0b6621-ae17-4b76-b790-10aa336d074b None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:54.824150 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4027dd-c848-4097-aa21-2d4997b5b555 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:15:54.830384 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 69/134] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 05:15:54 2022] GET /identity/v3/role_assignments?user.id=c395bb82392343abb1eb618fa2d60676&scope.project.id=199292d828144a70992f2344ae63f351&role.id=6f65b7f0071d466aa6ecf94916300a38 => generated 259 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:15:54.869388 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9117f667-0559-461a-afe8-911cbc9fc053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:54.870400 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9117f667-0559-461a-afe8-911cbc9fc053 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:54.870945 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9117f667-0559-461a-afe8-911cbc9fc053 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:54.871409 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9117f667-0559-461a-afe8-911cbc9fc053 None admin] PATH_INFO: `/v3/users/12f73b160732426b867094e731e1a1f8` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:54.872800 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9117f667-0559-461a-afe8-911cbc9fc053 None admin] RBAC: Authorizing `identity:get_user(user_id=12f73b160732426b867094e731e1a1f8)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:15:54.874448 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9117f667-0559-461a-afe8-911cbc9fc053 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:15:54.876277 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 66/135] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 05:15:54 2022] GET /identity/v3/users/12f73b160732426b867094e731e1a1f8 => generated 275 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:15:54.883005 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4027dd-c848-4097-aa21-2d4997b5b555 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:55.016438 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4027dd-c848-4097-aa21-2d4997b5b555 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:55.038295 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:15:55.058891 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f0b735-b5b3-40c7-8dff-1a94041ebf81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:55.059971 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0b735-b5b3-40c7-8dff-1a94041ebf81 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:55.060448 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0b735-b5b3-40c7-8dff-1a94041ebf81 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:55.060939 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0b735-b5b3-40c7-8dff-1a94041ebf81 None admin] PATH_INFO: `/v3/projects/7e503384e94e48219fa1772216cc5b53` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:55.062324 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f0b735-b5b3-40c7-8dff-1a94041ebf81 None admin] RBAC: Authorizing `identity:get_project(project_id=7e503384e94e48219fa1772216cc5b53)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:15:55.064018 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f0b735-b5b3-40c7-8dff-1a94041ebf81 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:15:55.065839 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 70/136] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 05:15:54 2022] GET /identity/v3/projects/7e503384e94e48219fa1772216cc5b53 => generated 312 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:15:55.071915 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9117f667-0559-461a-afe8-911cbc9fc053 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:55.195758 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9117f667-0559-461a-afe8-911cbc9fc053 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:55.241618 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ee4801-f29a-45d8-9be4-f166340ab18e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:55.242329 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ee4801-f29a-45d8-9be4-f166340ab18e None admin] REQUEST_METHOD: `PUT` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:55.242613 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ee4801-f29a-45d8-9be4-f166340ab18e None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:55.242887 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ee4801-f29a-45d8-9be4-f166340ab18e None admin] PATH_INFO: `/v3/projects/7e503384e94e48219fa1772216cc5b53/users/12f73b160732426b867094e731e1a1f8/roles/aa7ff8e0ec1e48e5811335b9eb38b448` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:55.245155 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ee4801-f29a-45d8-9be4-f166340ab18e None admin] RBAC: Authorizing `identity:create_grant(project_id=7e503384e94e48219fa1772216cc5b53, user_id=12f73b160732426b867094e731e1a1f8, role_id=aa7ff8e0ec1e48e5811335b9eb38b448)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:15:55.246651 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ee4801-f29a-45d8-9be4-f166340ab18e None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:15:55.275319 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 67/137] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 11 05:15:55 2022] PUT /identity/v3/projects/7e503384e94e48219fa1772216cc5b53/users/12f73b160732426b867094e731e1a1f8/roles/aa7ff8e0ec1e48e5811335b9eb38b448 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:15:55.373815 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a2237a-7e4c-4ef8-81e4-3671290f9410 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:55.374170 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a2237a-7e4c-4ef8-81e4-3671290f9410 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:55.374382 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a2237a-7e4c-4ef8-81e4-3671290f9410 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:55.376020 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 71/138] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:15:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:15:55.382384 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1553fbd-d424-43ae-8a44-90ce39920147 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:55.382679 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1553fbd-d424-43ae-8a44-90ce39920147 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:55.382960 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1553fbd-d424-43ae-8a44-90ce39920147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:55.402440 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-d1553fbd-d424-43ae-8a44-90ce39920147 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:15:55.403690 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-d1553fbd-d424-43ae-8a44-90ce39920147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:15:55.426542 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:15:55.498441 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 68/139] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:15:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 05:15:55.869401 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a2237a-7e4c-4ef8-81e4-3671290f9410 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:55.993123 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a2237a-7e4c-4ef8-81e4-3671290f9410 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:56.033891 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a834c3d-68db-4128-b8fd-6bb213fe29b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:56.034530 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a834c3d-68db-4128-b8fd-6bb213fe29b7 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:56.034808 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a834c3d-68db-4128-b8fd-6bb213fe29b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:56.035081 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a834c3d-68db-4128-b8fd-6bb213fe29b7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:56.036436 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a834c3d-68db-4128-b8fd-6bb213fe29b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:15:56.037902 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a834c3d-68db-4128-b8fd-6bb213fe29b7 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:15:56.040824 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 72/140] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:15:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:15:56.045348 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1553fbd-d424-43ae-8a44-90ce39920147 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:56.169831 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1553fbd-d424-43ae-8a44-90ce39920147 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:56.206166 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbc0bc3-48f1-4a0c-8012-94f22b5aaff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:56.207154 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc0bc3-48f1-4a0c-8012-94f22b5aaff0 None admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:56.207642 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc0bc3-48f1-4a0c-8012-94f22b5aaff0 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:56.208221 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc0bc3-48f1-4a0c-8012-94f22b5aaff0 None admin] PATH_INFO: `/v3/users` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:56.209106 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbc0bc3-48f1-4a0c-8012-94f22b5aaff0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:15:56.210782 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbc0bc3-48f1-4a0c-8012-94f22b5aaff0 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:15:56.233987 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 69/141] 10.222.0.16 () {60 vars in 1132 bytes} [Sun Sep 11 05:15:56 2022] POST /identity/v3/users => generated 283 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:15:57.432680 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3349e581-58b6-49ea-938f-400c793dbc9f None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:57.433717 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3349e581-58b6-49ea-938f-400c793dbc9f None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:57.434206 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3349e581-58b6-49ea-938f-400c793dbc9f None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:57.436052 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 73/142] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:15:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:15:57.448622 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ee9ed-5ec0-4234-93a2-ae9577a934e8 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:57.449538 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ee9ed-5ec0-4234-93a2-ae9577a934e8 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:57.450031 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ee9ed-5ec0-4234-93a2-ae9577a934e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:57.472148 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-e75ee9ed-5ec0-4234-93a2-ae9577a934e8 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:15:57.473755 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-e75ee9ed-5ec0-4234-93a2-ae9577a934e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:15:57.481968 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:15:57.557567 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 70/143] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:15:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 05:15:57.578879 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ac927-6fcf-4083-812f-e63363c14a4e None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:57.579209 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ac927-6fcf-4083-812f-e63363c14a4e None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:57.579436 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ac927-6fcf-4083-812f-e63363c14a4e None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:57.580902 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 74/144] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:15:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:15:57.586896 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12389db6-2238-4010-8da4-f8887039ac30 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:57.587216 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12389db6-2238-4010-8da4-f8887039ac30 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:57.587456 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12389db6-2238-4010-8da4-f8887039ac30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:57.608822 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-12389db6-2238-4010-8da4-f8887039ac30 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:15:57.610037 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-12389db6-2238-4010-8da4-f8887039ac30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:15:57.696178 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 71/145] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:15:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 05:15:57.732808 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e49539-bd8b-459b-b03f-66e9cf2e179b None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:57.733123 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e49539-bd8b-459b-b03f-66e9cf2e179b None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:57.733365 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e49539-bd8b-459b-b03f-66e9cf2e179b None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:57.735005 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 75/146] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:15:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:15:57.741702 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75db8f3f-2e58-4a28-afa8-f1215f971b45 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:57.742003 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75db8f3f-2e58-4a28-afa8-f1215f971b45 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:57.742290 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75db8f3f-2e58-4a28-afa8-f1215f971b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:57.769044 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-75db8f3f-2e58-4a28-afa8-f1215f971b45 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:15:57.770251 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-75db8f3f-2e58-4a28-afa8-f1215f971b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:15:57.858710 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 72/147] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:15:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 05:15:58.120726 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e49539-bd8b-459b-b03f-66e9cf2e179b None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:58.178851 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75db8f3f-2e58-4a28-afa8-f1215f971b45 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:58.181572 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:15:58.195373 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:15:58.296600 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e49539-bd8b-459b-b03f-66e9cf2e179b None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:58.319787 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75db8f3f-2e58-4a28-afa8-f1215f971b45 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:58.351563 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a698a90-8a08-46f5-9edc-ef557a0314f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:58.353881 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a698a90-8a08-46f5-9edc-ef557a0314f9 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:58.354331 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a698a90-8a08-46f5-9edc-ef557a0314f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:58.354756 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a698a90-8a08-46f5-9edc-ef557a0314f9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:58.373314 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9d1c9c-31f4-46e1-9bce-d6b1a96dde30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:58.373895 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d1c9c-31f4-46e1-9bce-d6b1a96dde30 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:58.374175 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d1c9c-31f4-46e1-9bce-d6b1a96dde30 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:58.374444 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d1c9c-31f4-46e1-9bce-d6b1a96dde30 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:58.375945 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a698a90-8a08-46f5-9edc-ef557a0314f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:15:58.382694 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-5a698a90-8a08-46f5-9edc-ef557a0314f9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 05:15:58.382694 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:15:58.382694 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:15:58.382694 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:15:58.382694 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:15:58.382694 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:15:58.382694 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:15:58.382694 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:15:58.382694 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:15:58.382694 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:15:58.382694 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:15:58.382694 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:15:58.382694 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:15:58.382694 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:15:58.382694 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:15:58.382694 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:15:58.383771 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:15:58.383771 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:15:58.383771 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:15:58.383771 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:15:58.383771 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:15:58.383771 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:15:58.383771 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:15:58.383771 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:15:58.383771 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:15:58.383771 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:15:58.383771 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:15:58.383771 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:15:58.383771 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:15:58.383771 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:15:58.383771 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:15:58.383771 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:15:58.384585 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:15:58.384585 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:15:58.384585 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:15:58.384585 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:15:58.384585 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:15:58.384585 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:15:58.384585 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:15:58.384585 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:15:58.384585 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:15:58.384585 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:15:58.384585 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 05:15:58.384585 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:15:58.394311 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9d1c9c-31f4-46e1-9bce-d6b1a96dde30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:15:58.399225 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-0e9d1c9c-31f4-46e1-9bce-d6b1a96dde30 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 05:15:58.399225 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:15:58.399225 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:15:58.399225 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:15:58.399225 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:15:58.399225 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:15:58.399225 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:15:58.399225 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:15:58.399225 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:15:58.399225 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:15:58.399225 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:15:58.399225 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:15:58.399225 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:15:58.399225 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:15:58.399225 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:15:58.399225 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:15:58.400355 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:15:58.400355 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:15:58.400355 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:15:58.400355 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:15:58.400355 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:15:58.400355 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:15:58.400355 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:15:58.400355 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:15:58.400355 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:15:58.400355 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:15:58.400355 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:15:58.400355 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:15:58.400355 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:15:58.400355 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:15:58.400355 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:15:58.400355 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:15:58.401251 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:15:58.401251 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:15:58.401251 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:15:58.401251 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:15:58.401251 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:15:58.401251 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:15:58.401251 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:15:58.401251 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:15:58.401251 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:15:58.401251 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:15:58.401251 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 05:15:58.401251 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:15:58.401919 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 76/148] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 05:15:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:15:58.401919 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b198a22-ec41-4a84-98df-7780082af26d None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:58.403833 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b198a22-ec41-4a84-98df-7780082af26d None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:58.403833 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b198a22-ec41-4a84-98df-7780082af26d None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:58.403833 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 77/149] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:15:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:15:58.404329 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 73/150] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 05:15:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 05:15:58.408544 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b198a22-ec41-4a84-98df-7780082af26d None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:58.409818 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9d1c9c-31f4-46e1-9bce-d6b1a96dde30 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:58.575704 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:15:58.599707 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b198a22-ec41-4a84-98df-7780082af26d None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:58.620568 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:15:58.647233 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9d1c9c-31f4-46e1-9bce-d6b1a96dde30 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:58.656542 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32765e8-72ce-44c6-959b-e46ed386564a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:58.657185 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32765e8-72ce-44c6-959b-e46ed386564a None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:58.657463 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32765e8-72ce-44c6-959b-e46ed386564a None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:58.657732 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32765e8-72ce-44c6-959b-e46ed386564a None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:58.658417 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32765e8-72ce-44c6-959b-e46ed386564a None admin] RBAC: Adding query filter params (name=member) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:15:58.658717 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32765e8-72ce-44c6-959b-e46ed386564a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:15:58.667706 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32765e8-72ce-44c6-959b-e46ed386564a None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:15:58.677726 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 78/151] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 11 05:15:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:15:58.677726 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32765e8-72ce-44c6-959b-e46ed386564a None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:58.701718 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f066ef-524f-4291-820e-7e4a647b09bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:58.702682 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f066ef-524f-4291-820e-7e4a647b09bd None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:58.703169 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f066ef-524f-4291-820e-7e4a647b09bd None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:58.703654 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f066ef-524f-4291-820e-7e4a647b09bd None admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:58.704551 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f066ef-524f-4291-820e-7e4a647b09bd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:15:58.705067 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f066ef-524f-4291-820e-7e4a647b09bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:15:58.706672 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f066ef-524f-4291-820e-7e4a647b09bd None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:15:58.716193 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 74/152] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 05:15:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:15:58.717740 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6968ba2e-1dd8-4c12-96e9-9624be4d13ee None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:58.718255 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6968ba2e-1dd8-4c12-96e9-9624be4d13ee None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:58.718793 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6968ba2e-1dd8-4c12-96e9-9624be4d13ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:58.739084 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-6968ba2e-1dd8-4c12-96e9-9624be4d13ee None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:15:58.741125 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-6968ba2e-1dd8-4c12-96e9-9624be4d13ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:15:58.825875 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 75/153] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:15:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 05:15:58.827469 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97109a9e-07da-4457-b05e-d88aa702de83 None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:58.827988 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97109a9e-07da-4457-b05e-d88aa702de83 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:58.828476 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97109a9e-07da-4457-b05e-d88aa702de83 None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:58.830490 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 76/154] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:15:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:15:58.831428 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97109a9e-07da-4457-b05e-d88aa702de83 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:58.903075 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:15:58.910491 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32765e8-72ce-44c6-959b-e46ed386564a None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:58.954217 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97109a9e-07da-4457-b05e-d88aa702de83 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:58.992601 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefc6d72-6c66-4886-9982-b167581b8c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:58.994472 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc6d72-6c66-4886-9982-b167581b8c14 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:58.995555 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc6d72-6c66-4886-9982-b167581b8c14 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:58.996551 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc6d72-6c66-4886-9982-b167581b8c14 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:58.997429 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161500bf-42f2-429d-873f-7fad6c8ca902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:58.998296 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161500bf-42f2-429d-873f-7fad6c8ca902 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:59.000179 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161500bf-42f2-429d-873f-7fad6c8ca902 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:59.000698 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161500bf-42f2-429d-873f-7fad6c8ca902 None admin] PATH_INFO: `/v3/users/12f73b160732426b867094e731e1a1f8` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:59.003057 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161500bf-42f2-429d-873f-7fad6c8ca902 None admin] RBAC: Authorizing `identity:get_user(user_id=12f73b160732426b867094e731e1a1f8)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:15:59.006893 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161500bf-42f2-429d-873f-7fad6c8ca902 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:15:59.009988 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 77/155] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 05:15:58 2022] GET /identity/v3/users/12f73b160732426b867094e731e1a1f8 => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:15:59.011932 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161500bf-42f2-429d-873f-7fad6c8ca902 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:59.020745 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefc6d72-6c66-4886-9982-b167581b8c14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:15:59.025722 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-aefc6d72-6c66-4886-9982-b167581b8c14 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 05:15:59.025722 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:15:59.025722 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:15:59.025722 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:15:59.025722 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:15:59.025722 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:15:59.025722 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:15:59.025722 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:15:59.025722 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:15:59.025722 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:15:59.025722 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:15:59.025722 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:15:59.025722 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:15:59.025722 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:15:59.025722 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:15:59.025722 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:15:59.026575 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:15:59.026575 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:15:59.026575 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:15:59.026575 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:15:59.026575 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:15:59.026575 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:15:59.026575 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:15:59.026575 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:15:59.026575 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:15:59.026575 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:15:59.026575 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:15:59.026575 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:15:59.026575 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:15:59.026575 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:15:59.026575 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:15:59.026575 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:15:59.027559 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:15:59.027559 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:15:59.027559 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:15:59.027559 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:15:59.027559 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:15:59.027559 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:15:59.027559 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:15:59.027559 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:15:59.027559 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:15:59.027559 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:15:59.027559 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 05:15:59.027559 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:15:59.027559 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 79/156] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 11 05:15:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:15:59.032179 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53afb168-08a5-40b0-afa0-9bea44af31c3 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:59.032463 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53afb168-08a5-40b0-afa0-9bea44af31c3 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:59.032735 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53afb168-08a5-40b0-afa0-9bea44af31c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:59.067082 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-53afb168-08a5-40b0-afa0-9bea44af31c3 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:15:59.068495 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-53afb168-08a5-40b0-afa0-9bea44af31c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:15:59.122842 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:15:59.129186 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161500bf-42f2-429d-873f-7fad6c8ca902 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:59.156718 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:15:59.169241 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49408e6f-ad86-4a0a-8209-f4ba0175f102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:59.170374 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49408e6f-ad86-4a0a-8209-f4ba0175f102 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:59.170860 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49408e6f-ad86-4a0a-8209-f4ba0175f102 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:59.171328 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49408e6f-ad86-4a0a-8209-f4ba0175f102 None admin] PATH_INFO: `/v3/users/dd85f0a5ebc14829989036033392af00` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:59.172707 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49408e6f-ad86-4a0a-8209-f4ba0175f102 None admin] RBAC: Authorizing `identity:get_user(user_id=dd85f0a5ebc14829989036033392af00)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:15:59.174651 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49408e6f-ad86-4a0a-8209-f4ba0175f102 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:15:59.176959 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 78/157] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 05:15:59 2022] GET /identity/v3/users/dd85f0a5ebc14829989036033392af00 => generated 247 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:15:59.178568 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49408e6f-ad86-4a0a-8209-f4ba0175f102 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:59.198021 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 80/158] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:15:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 05:15:59.198962 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53afb168-08a5-40b0-afa0-9bea44af31c3 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:59.329067 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49408e6f-ad86-4a0a-8209-f4ba0175f102 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:59.385292 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b89307-8748-423c-8989-9192198bba1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:59.385913 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b89307-8748-423c-8989-9192198bba1f None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:59.386188 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b89307-8748-423c-8989-9192198bba1f None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:59.386458 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b89307-8748-423c-8989-9192198bba1f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:59.391307 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53afb168-08a5-40b0-afa0-9bea44af31c3 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:59.452582 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff93a623-649a-471e-9223-7b852c73ea66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:59.453150 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff93a623-649a-471e-9223-7b852c73ea66 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:59.453435 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff93a623-649a-471e-9223-7b852c73ea66 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:59.453707 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff93a623-649a-471e-9223-7b852c73ea66 None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:59.454389 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff93a623-649a-471e-9223-7b852c73ea66 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:15:59.454697 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff93a623-649a-471e-9223-7b852c73ea66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:15:59.456130 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff93a623-649a-471e-9223-7b852c73ea66 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:15:59.465538 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 81/159] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 05:15:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:15:59.468663 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff93a623-649a-471e-9223-7b852c73ea66 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:59.472779 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:15:59.475264 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b89307-8748-423c-8989-9192198bba1f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:15:59.476928 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b89307-8748-423c-8989-9192198bba1f None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:15:59.527228 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:15:59.581575 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 79/160] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 05:15:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 05:15:59.586597 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b89307-8748-423c-8989-9192198bba1f None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:59.611615 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff93a623-649a-471e-9223-7b852c73ea66 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:59.664391 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a8b7e0-76b7-449c-b4c0-234e546363c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:59.665022 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a8b7e0-76b7-449c-b4c0-234e546363c5 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:59.665302 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a8b7e0-76b7-449c-b4c0-234e546363c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:59.665577 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a8b7e0-76b7-449c-b4c0-234e546363c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:59.702320 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b89307-8748-423c-8989-9192198bba1f None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:59.705269 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:15:59.740300 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795560cf-6fe7-40be-b25a-c70aa7198a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:59.740948 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795560cf-6fe7-40be-b25a-c70aa7198a6c None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:59.741230 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795560cf-6fe7-40be-b25a-c70aa7198a6c None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:59.741507 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795560cf-6fe7-40be-b25a-c70aa7198a6c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:59.754596 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795560cf-6fe7-40be-b25a-c70aa7198a6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:15:59.758363 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-795560cf-6fe7-40be-b25a-c70aa7198a6c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 05:15:59.758363 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:15:59.758363 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:15:59.758363 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:15:59.758363 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:15:59.758363 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:15:59.758363 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:15:59.758363 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:15:59.758363 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:15:59.758363 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:15:59.758363 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:15:59.758363 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:15:59.758363 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:15:59.758363 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:15:59.758363 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:15:59.758363 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:15:59.759289 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:15:59.759289 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:15:59.759289 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:15:59.759289 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:15:59.759289 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:15:59.759289 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:15:59.759289 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:15:59.759289 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:15:59.759289 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:15:59.759289 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:15:59.759289 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:15:59.759289 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:15:59.759289 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:15:59.759289 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:15:59.759289 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:15:59.759289 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:15:59.760148 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:15:59.760148 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:15:59.760148 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:15:59.760148 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:15:59.760148 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:15:59.760148 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:15:59.760148 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:15:59.760148 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:15:59.760148 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:15:59.760148 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:15:59.760148 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 05:15:59.760148 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:15:59.760148 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 80/161] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 05:15:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:15:59.760789 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795560cf-6fe7-40be-b25a-c70aa7198a6c None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:59.774420 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a8b7e0-76b7-449c-b4c0-234e546363c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:15:59.775943 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a8b7e0-76b7-449c-b4c0-234e546363c5 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:15:59.825157 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:15:59.873680 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795560cf-6fe7-40be-b25a-c70aa7198a6c None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:15:59.908998 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a9ddfc-5188-47ea-a650-498f1c17b6ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:15:59.910118 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a9ddfc-5188-47ea-a650-498f1c17b6ac None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:15:59.910554 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a9ddfc-5188-47ea-a650-498f1c17b6ac None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:15:59.910978 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a9ddfc-5188-47ea-a650-498f1c17b6ac None admin] PATH_INFO: `/v3/users/12f73b160732426b867094e731e1a1f8` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:15:59.912836 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a9ddfc-5188-47ea-a650-498f1c17b6ac None admin] RBAC: Authorizing `identity:get_user(user_id=12f73b160732426b867094e731e1a1f8)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:15:59.914436 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a9ddfc-5188-47ea-a650-498f1c17b6ac None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:15:59.916197 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 81/162] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 05:15:59 2022] GET /identity/v3/users/12f73b160732426b867094e731e1a1f8 => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:15:59.917107 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a9ddfc-5188-47ea-a650-498f1c17b6ac None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:15:59.937396 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:15:59.952334 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 82/163] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 05:15:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 05:15:59.957716 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a8b7e0-76b7-449c-b4c0-234e546363c5 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:00.023729 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a9ddfc-5188-47ea-a650-498f1c17b6ac None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:00.101983 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66515806-d7ea-4754-9b39-2e666b60b80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:00.102642 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66515806-d7ea-4754-9b39-2e666b60b80e None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:00.102922 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66515806-d7ea-4754-9b39-2e666b60b80e None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:00.103199 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66515806-d7ea-4754-9b39-2e666b60b80e None admin] PATH_INFO: `/v3/projects/199292d828144a70992f2344ae63f351` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:00.104874 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66515806-d7ea-4754-9b39-2e666b60b80e None admin] RBAC: Authorizing `identity:get_project(project_id=199292d828144a70992f2344ae63f351)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:00.106334 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66515806-d7ea-4754-9b39-2e666b60b80e None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:00.112228 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 82/164] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 05:15:59 2022] GET /identity/v3/projects/199292d828144a70992f2344ae63f351 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:00.113137 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66515806-d7ea-4754-9b39-2e666b60b80e None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:00.116462 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a8b7e0-76b7-449c-b4c0-234e546363c5 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:00.160168 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:00.166745 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a93eba5-74a2-4f58-9ca8-015f26c10bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:00.167347 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93eba5-74a2-4f58-9ca8-015f26c10bb9 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:00.167987 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93eba5-74a2-4f58-9ca8-015f26c10bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:00.168358 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93eba5-74a2-4f58-9ca8-015f26c10bb9 None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:00.169127 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a93eba5-74a2-4f58-9ca8-015f26c10bb9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:00.169535 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a93eba5-74a2-4f58-9ca8-015f26c10bb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:00.171034 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a93eba5-74a2-4f58-9ca8-015f26c10bb9 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:00.179959 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 83/165] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 11 05:15:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:00.180834 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a93eba5-74a2-4f58-9ca8-015f26c10bb9 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:00.237691 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:00.256014 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66515806-d7ea-4754-9b39-2e666b60b80e None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:00.289395 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a93eba5-74a2-4f58-9ca8-015f26c10bb9 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:00.305054 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bd424d-50e2-4413-91bd-3f4fb34ba7a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:00.306099 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd424d-50e2-4413-91bd-3f4fb34ba7a3 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:00.306472 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd424d-50e2-4413-91bd-3f4fb34ba7a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:00.307086 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd424d-50e2-4413-91bd-3f4fb34ba7a3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:00.321685 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bd424d-50e2-4413-91bd-3f4fb34ba7a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:16:00.325015 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7c9ce3-ff84-47df-9aff-971d22ca8286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:00.325627 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c9ce3-ff84-47df-9aff-971d22ca8286 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:00.325906 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c9ce3-ff84-47df-9aff-971d22ca8286 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:00.326179 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c9ce3-ff84-47df-9aff-971d22ca8286 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:00.328035 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-c5bd424d-50e2-4413-91bd-3f4fb34ba7a3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 05:16:00.328035 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:16:00.328035 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:16:00.328035 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:16:00.328035 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:16:00.328035 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:16:00.328035 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:16:00.328035 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:16:00.328035 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:16:00.328035 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:16:00.328035 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:16:00.328035 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:16:00.328035 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:16:00.328035 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:16:00.328035 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:16:00.328035 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:16:00.328999 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:16:00.328999 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:16:00.328999 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:16:00.328999 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:16:00.328999 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:16:00.328999 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:16:00.328999 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:16:00.328999 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:16:00.328999 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:16:00.328999 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:16:00.328999 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:16:00.328999 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:16:00.328999 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:16:00.328999 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:16:00.328999 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:16:00.328999 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:16:00.329784 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:16:00.329784 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:16:00.329784 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:16:00.329784 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:16:00.329784 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:16:00.329784 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:16:00.329784 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:16:00.329784 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:16:00.329784 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:16:00.329784 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:16:00.329784 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 05:16:00.329784 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:16:00.331148 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 83/166] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 05:16:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:16:00.332463 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bd424d-50e2-4413-91bd-3f4fb34ba7a3 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:00.394365 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:00.408901 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7c9ce3-ff84-47df-9aff-971d22ca8286 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:00.410386 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7c9ce3-ff84-47df-9aff-971d22ca8286 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:00.473653 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bd424d-50e2-4413-91bd-3f4fb34ba7a3 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:00.516253 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 84/167] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 05:16:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 05:16:00.519842 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44301a8-59a5-4034-9316-1863366578be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:00.521245 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44301a8-59a5-4034-9316-1863366578be None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:00.521799 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44301a8-59a5-4034-9316-1863366578be None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:00.521909 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7c9ce3-ff84-47df-9aff-971d22ca8286 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:00.522381 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44301a8-59a5-4034-9316-1863366578be None admin] PATH_INFO: `/v3/projects/199292d828144a70992f2344ae63f351` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:00.523762 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44301a8-59a5-4034-9316-1863366578be None admin] RBAC: Authorizing `identity:get_project(project_id=199292d828144a70992f2344ae63f351)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:00.526681 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44301a8-59a5-4034-9316-1863366578be None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:00.528600 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 84/168] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 05:16:00 2022] GET /identity/v3/projects/199292d828144a70992f2344ae63f351 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:00.529635 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44301a8-59a5-4034-9316-1863366578be None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:00.550154 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:00.626927 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:00.637364 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7c9ce3-ff84-47df-9aff-971d22ca8286 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:00.669950 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44301a8-59a5-4034-9316-1863366578be None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:00.674528 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b9886-c863-4cca-859c-3a6ac258fe81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:00.675240 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b9886-c863-4cca-859c-3a6ac258fe81 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:00.675619 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b9886-c863-4cca-859c-3a6ac258fe81 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:00.676039 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b9886-c863-4cca-859c-3a6ac258fe81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:00.676977 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262b9886-c863-4cca-859c-3a6ac258fe81 None admin] RBAC: Adding query filter params (role.id=aa7ff8e0ec1e48e5811335b9eb38b448, scope.project.id=199292d828144a70992f2344ae63f351, user.id=12f73b160732426b867094e731e1a1f8) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:00.677386 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262b9886-c863-4cca-859c-3a6ac258fe81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:00.678939 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262b9886-c863-4cca-859c-3a6ac258fe81 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:00.685668 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 85/169] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 05:16:00 2022] GET /identity/v3/role_assignments?user.id=12f73b160732426b867094e731e1a1f8&scope.project.id=199292d828144a70992f2344ae63f351&role.id=aa7ff8e0ec1e48e5811335b9eb38b448 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:00.687110 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fa7137-f0c2-4899-9638-fe7c04a59ed3 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:00.687543 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fa7137-f0c2-4899-9638-fe7c04a59ed3 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:00.687947 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fa7137-f0c2-4899-9638-fe7c04a59ed3 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:00.689434 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 86/170] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:16:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:16:00.690114 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fa7137-f0c2-4899-9638-fe7c04a59ed3 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:00.724932 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca400074-86f4-44dd-aee2-fedd631b6b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:00.725778 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca400074-86f4-44dd-aee2-fedd631b6b0b None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:00.726132 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca400074-86f4-44dd-aee2-fedd631b6b0b None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:00.726507 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca400074-86f4-44dd-aee2-fedd631b6b0b None admin] PATH_INFO: `/v3/users/c395bb82392343abb1eb618fa2d60676` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:00.727917 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca400074-86f4-44dd-aee2-fedd631b6b0b None admin] RBAC: Authorizing `identity:get_user(user_id=c395bb82392343abb1eb618fa2d60676)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:00.729665 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca400074-86f4-44dd-aee2-fedd631b6b0b None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:00.731518 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 85/171] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 05:16:00 2022] GET /identity/v3/users/c395bb82392343abb1eb618fa2d60676 => generated 289 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:00.732447 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca400074-86f4-44dd-aee2-fedd631b6b0b None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:00.885215 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fa7137-f0c2-4899-9638-fe7c04a59ed3 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:00.910691 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:00.932083 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a70902-dc7e-448d-9567-56f8ad853701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:00.932324 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca400074-86f4-44dd-aee2-fedd631b6b0b None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:00.933209 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a70902-dc7e-448d-9567-56f8ad853701 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:00.933703 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a70902-dc7e-448d-9567-56f8ad853701 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:00.934168 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a70902-dc7e-448d-9567-56f8ad853701 None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:00.935905 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a70902-dc7e-448d-9567-56f8ad853701 None admin] RBAC: Adding query filter params (name=member) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:00.936447 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a70902-dc7e-448d-9567-56f8ad853701 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:00.938094 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a70902-dc7e-448d-9567-56f8ad853701 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:00.947857 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 87/172] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 11 05:16:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:00.949093 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a70902-dc7e-448d-9567-56f8ad853701 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:00.970030 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:00.971515 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bc4b72-e160-4c00-8ed1-56c346f5a857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:00.975230 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc4b72-e160-4c00-8ed1-56c346f5a857 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:00.975803 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc4b72-e160-4c00-8ed1-56c346f5a857 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:00.976693 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc4b72-e160-4c00-8ed1-56c346f5a857 None admin] PATH_INFO: `/v3/projects/199292d828144a70992f2344ae63f351` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:00.979075 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bc4b72-e160-4c00-8ed1-56c346f5a857 None admin] RBAC: Authorizing `identity:get_project(project_id=199292d828144a70992f2344ae63f351)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:00.980936 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bc4b72-e160-4c00-8ed1-56c346f5a857 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:00.983191 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 86/173] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 05:16:00 2022] GET /identity/v3/projects/199292d828144a70992f2344ae63f351 => generated 298 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:00.985118 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3846ee44-7f98-4ea7-93e4-e2f41cbf1e96 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:00.985624 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3846ee44-7f98-4ea7-93e4-e2f41cbf1e96 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:00.986390 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3846ee44-7f98-4ea7-93e4-e2f41cbf1e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:01.012682 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-3846ee44-7f98-4ea7-93e4-e2f41cbf1e96 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:16:01.012682 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-3846ee44-7f98-4ea7-93e4-e2f41cbf1e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:16:01.083028 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a70902-dc7e-448d-9567-56f8ad853701 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:01.097398 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 87/174] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:16:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 05:16:01.099711 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3846ee44-7f98-4ea7-93e4-e2f41cbf1e96 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:01.121522 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d6bfcb-762f-4183-ac93-1f8e8914848e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:01.122105 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d6bfcb-762f-4183-ac93-1f8e8914848e None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:01.122381 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d6bfcb-762f-4183-ac93-1f8e8914848e None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:01.123170 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d6bfcb-762f-4183-ac93-1f8e8914848e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:01.123933 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d6bfcb-762f-4183-ac93-1f8e8914848e None admin] RBAC: Adding query filter params (role.id=5b702713e40145b49e0b42abd0a5fba9, scope.project.id=199292d828144a70992f2344ae63f351, user.id=dd85f0a5ebc14829989036033392af00) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:01.124372 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d6bfcb-762f-4183-ac93-1f8e8914848e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:01.126211 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d6bfcb-762f-4183-ac93-1f8e8914848e None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:01.134786 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 88/175] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 05:16:00 2022] GET /identity/v3/role_assignments?user.id=dd85f0a5ebc14829989036033392af00&scope.project.id=199292d828144a70992f2344ae63f351&role.id=5b702713e40145b49e0b42abd0a5fba9 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:01.135424 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d6bfcb-762f-4183-ac93-1f8e8914848e None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:01.227953 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:01.268904 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3846ee44-7f98-4ea7-93e4-e2f41cbf1e96 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:01.308017 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:01.341406 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d6bfcb-762f-4183-ac93-1f8e8914848e None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:01.355274 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6420a04b-bb34-4b4d-bae9-92f68e688557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:01.357361 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6420a04b-bb34-4b4d-bae9-92f68e688557 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:01.357361 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6420a04b-bb34-4b4d-bae9-92f68e688557 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:01.357361 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6420a04b-bb34-4b4d-bae9-92f68e688557 None admin] PATH_INFO: `/v3/projects/199292d828144a70992f2344ae63f351` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:01.359746 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6420a04b-bb34-4b4d-bae9-92f68e688557 None admin] RBAC: Authorizing `identity:get_project(project_id=199292d828144a70992f2344ae63f351)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:01.361366 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6420a04b-bb34-4b4d-bae9-92f68e688557 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:01.363195 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 88/176] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 05:16:01 2022] GET /identity/v3/projects/199292d828144a70992f2344ae63f351 => generated 298 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:01.364692 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6420a04b-bb34-4b4d-bae9-92f68e688557 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:01.392469 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134561e9-cdd7-4864-a943-97ba0de2c704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:01.393114 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134561e9-cdd7-4864-a943-97ba0de2c704 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:01.393395 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134561e9-cdd7-4864-a943-97ba0de2c704 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:01.393673 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134561e9-cdd7-4864-a943-97ba0de2c704 None admin] PATH_INFO: `/v3/users/12f73b160732426b867094e731e1a1f8` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:01.395730 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134561e9-cdd7-4864-a943-97ba0de2c704 None admin] RBAC: Authorizing `identity:get_user(user_id=12f73b160732426b867094e731e1a1f8)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:01.397412 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134561e9-cdd7-4864-a943-97ba0de2c704 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:01.399008 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 89/177] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 05:16:01 2022] GET /identity/v3/users/12f73b160732426b867094e731e1a1f8 => generated 275 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:01.401074 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20130799-7689-415e-ad67-826e5d3d44f5 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:01.401360 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20130799-7689-415e-ad67-826e5d3d44f5 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:01.401633 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20130799-7689-415e-ad67-826e5d3d44f5 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:01.402872 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 90/178] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:16:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:16:01.403553 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20130799-7689-415e-ad67-826e5d3d44f5 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:01.487459 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6420a04b-bb34-4b4d-bae9-92f68e688557 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:01.519551 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20130799-7689-415e-ad67-826e5d3d44f5 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:01.521821 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f04da5-c678-41de-8cf7-47de77bbe080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:01.522432 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f04da5-c678-41de-8cf7-47de77bbe080 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:01.522708 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f04da5-c678-41de-8cf7-47de77bbe080 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:01.522977 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f04da5-c678-41de-8cf7-47de77bbe080 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:01.523732 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f04da5-c678-41de-8cf7-47de77bbe080 None admin] RBAC: Adding query filter params (role.id=ada04449ee1f42599a060f4795ec1a74, scope.project.id=199292d828144a70992f2344ae63f351, user.id=12f73b160732426b867094e731e1a1f8) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:01.524049 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f04da5-c678-41de-8cf7-47de77bbe080 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:01.525485 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f04da5-c678-41de-8cf7-47de77bbe080 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:01.531314 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 89/179] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 05:16:01 2022] GET /identity/v3/role_assignments?user.id=12f73b160732426b867094e731e1a1f8&scope.project.id=199292d828144a70992f2344ae63f351&role.id=ada04449ee1f42599a060f4795ec1a74 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:01.532043 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f04da5-c678-41de-8cf7-47de77bbe080 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:01.548664 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:01.571027 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50a0d02-9bd4-43fc-92ed-5be4c8a1b14c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:01.571753 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a0d02-9bd4-43fc-92ed-5be4c8a1b14c None admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:01.572037 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a0d02-9bd4-43fc-92ed-5be4c8a1b14c None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:01.572312 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a0d02-9bd4-43fc-92ed-5be4c8a1b14c None admin] PATH_INFO: `/v3/projects/199292d828144a70992f2344ae63f351/users/c395bb82392343abb1eb618fa2d60676/roles/6f65b7f0071d466aa6ecf94916300a38` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:01.574306 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50a0d02-9bd4-43fc-92ed-5be4c8a1b14c None admin] RBAC: Authorizing `identity:create_grant(project_id=199292d828144a70992f2344ae63f351, user_id=c395bb82392343abb1eb618fa2d60676, role_id=6f65b7f0071d466aa6ecf94916300a38)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:01.575838 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50a0d02-9bd4-43fc-92ed-5be4c8a1b14c None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:01.590334 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 91/180] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 11 05:16:01 2022] PUT /identity/v3/projects/199292d828144a70992f2344ae63f351/users/c395bb82392343abb1eb618fa2d60676/roles/6f65b7f0071d466aa6ecf94916300a38 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:16:01.591317 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50a0d02-9bd4-43fc-92ed-5be4c8a1b14c None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:01.612130 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:01.680746 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f04da5-c678-41de-8cf7-47de77bbe080 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:01.728047 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50a0d02-9bd4-43fc-92ed-5be4c8a1b14c None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:01.730751 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4797d33-dee3-4614-80e7-3f6a9e4f5088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:01.732387 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4797d33-dee3-4614-80e7-3f6a9e4f5088 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:01.732859 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4797d33-dee3-4614-80e7-3f6a9e4f5088 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:01.733366 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4797d33-dee3-4614-80e7-3f6a9e4f5088 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:01.747506 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4797d33-dee3-4614-80e7-3f6a9e4f5088 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:16:01.753823 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-d4797d33-dee3-4614-80e7-3f6a9e4f5088 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 05:16:01.753823 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:16:01.753823 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:16:01.753823 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:16:01.753823 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:16:01.753823 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:16:01.753823 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:16:01.753823 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:16:01.753823 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:16:01.753823 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:16:01.753823 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:16:01.753823 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:16:01.753823 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:16:01.753823 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:16:01.753823 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:16:01.753823 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:16:01.755012 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:16:01.755012 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:16:01.755012 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:16:01.755012 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:16:01.755012 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:16:01.755012 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:16:01.755012 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:16:01.755012 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:16:01.755012 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:16:01.755012 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:16:01.755012 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:16:01.755012 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:16:01.755012 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:16:01.755012 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:16:01.755012 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:16:01.755012 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:16:01.756578 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:16:01.756578 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:16:01.756578 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:16:01.756578 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:16:01.756578 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:16:01.756578 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:16:01.756578 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:16:01.756578 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:16:01.756578 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:16:01.756578 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:16:01.756578 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 05:16:01.756578 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:16:01.759111 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 90/181] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 05:16:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:16:01.760790 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ccc1a-8603-4c90-bf4f-39a65e2f5719 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:01.761267 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ccc1a-8603-4c90-bf4f-39a65e2f5719 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:01.761760 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ccc1a-8603-4c90-bf4f-39a65e2f5719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:01.782502 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-e38ccc1a-8603-4c90-bf4f-39a65e2f5719 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:16:01.783802 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-e38ccc1a-8603-4c90-bf4f-39a65e2f5719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:16:01.791194 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ecf3e3-9ed4-4a8a-b3f3-39d0bb0dea09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:01.791194 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ecf3e3-9ed4-4a8a-b3f3-39d0bb0dea09 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:01.791194 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ecf3e3-9ed4-4a8a-b3f3-39d0bb0dea09 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:01.791194 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ecf3e3-9ed4-4a8a-b3f3-39d0bb0dea09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:01.872443 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ecf3e3-9ed4-4a8a-b3f3-39d0bb0dea09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:01.873585 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 91/182] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:16:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 05:16:01.873946 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ecf3e3-9ed4-4a8a-b3f3-39d0bb0dea09 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:01.875344 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e1289e-d027-41b3-8bb8-cd0aed76156f None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:01.876119 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e1289e-d027-41b3-8bb8-cd0aed76156f None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:01.877522 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e1289e-d027-41b3-8bb8-cd0aed76156f None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:01.879032 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 92/183] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:16:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:16:01.884520 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e1289e-d027-41b3-8bb8-cd0aed76156f None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:01.886642 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:01.890480 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:01.992834 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 92/184] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 05:16:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 05:16:01.994754 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da369ed-c98d-41dc-9641-6c65d48e16c7 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:01.995044 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da369ed-c98d-41dc-9641-6c65d48e16c7 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:01.995314 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da369ed-c98d-41dc-9641-6c65d48e16c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:02.010810 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e1289e-d027-41b3-8bb8-cd0aed76156f None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:02.017378 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-2da369ed-c98d-41dc-9641-6c65d48e16c7 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:16:02.018637 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-2da369ed-c98d-41dc-9641-6c65d48e16c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:16:02.051056 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39254b02-b7d6-4ee2-8fb9-f4f381bc9a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:02.052215 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39254b02-b7d6-4ee2-8fb9-f4f381bc9a04 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:02.052721 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39254b02-b7d6-4ee2-8fb9-f4f381bc9a04 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:02.053487 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39254b02-b7d6-4ee2-8fb9-f4f381bc9a04 None admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:02.054652 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39254b02-b7d6-4ee2-8fb9-f4f381bc9a04 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:02.055156 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39254b02-b7d6-4ee2-8fb9-f4f381bc9a04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:02.056786 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39254b02-b7d6-4ee2-8fb9-f4f381bc9a04 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:02.066579 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 93/185] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 05:16:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:02.068294 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39254b02-b7d6-4ee2-8fb9-f4f381bc9a04 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:02.105507 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 93/186] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:16:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 05:16:02.112063 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da369ed-c98d-41dc-9641-6c65d48e16c7 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:02.164741 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:02.170229 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:02.215283 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39254b02-b7d6-4ee2-8fb9-f4f381bc9a04 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:02.231813 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da369ed-c98d-41dc-9641-6c65d48e16c7 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:02.253709 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da4daf6-a02a-4353-9445-8eb99d3e2ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:02.254354 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da4daf6-a02a-4353-9445-8eb99d3e2ea1 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:02.254637 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da4daf6-a02a-4353-9445-8eb99d3e2ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:02.254912 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da4daf6-a02a-4353-9445-8eb99d3e2ea1 None admin] PATH_INFO: `/v3/projects/7e503384e94e48219fa1772216cc5b53` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:02.256277 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da4daf6-a02a-4353-9445-8eb99d3e2ea1 None admin] RBAC: Authorizing `identity:get_project(project_id=7e503384e94e48219fa1772216cc5b53)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:02.257929 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da4daf6-a02a-4353-9445-8eb99d3e2ea1 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:02.259929 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 94/187] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 05:16:02 2022] GET /identity/v3/projects/7e503384e94e48219fa1772216cc5b53 => generated 312 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:02.260642 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da4daf6-a02a-4353-9445-8eb99d3e2ea1 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:02.268237 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c61094d-5f87-4d3a-b3cc-957445767fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:02.268952 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c61094d-5f87-4d3a-b3cc-957445767fc0 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:02.269297 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c61094d-5f87-4d3a-b3cc-957445767fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:02.269634 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c61094d-5f87-4d3a-b3cc-957445767fc0 None admin] PATH_INFO: `/v3/users/aecacb74a633441ba43d62b17df57b0b` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:02.284089 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c61094d-5f87-4d3a-b3cc-957445767fc0 None admin] RBAC: Authorizing `identity:get_user(user_id=aecacb74a633441ba43d62b17df57b0b)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:02.285752 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c61094d-5f87-4d3a-b3cc-957445767fc0 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:02.288523 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 94/188] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 05:16:02 2022] GET /identity/v3/users/aecacb74a633441ba43d62b17df57b0b => generated 283 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:02.289534 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c61094d-5f87-4d3a-b3cc-957445767fc0 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:02.390431 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da4daf6-a02a-4353-9445-8eb99d3e2ea1 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:02.420740 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:02.424598 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:02.424740 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c61094d-5f87-4d3a-b3cc-957445767fc0 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:02.431236 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82895418-1841-4de3-95ec-a8a59d34d518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:02.431940 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82895418-1841-4de3-95ec-a8a59d34d518 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:02.432223 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82895418-1841-4de3-95ec-a8a59d34d518 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:02.432541 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82895418-1841-4de3-95ec-a8a59d34d518 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:02.443617 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82895418-1841-4de3-95ec-a8a59d34d518 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:16:02.448995 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-82895418-1841-4de3-95ec-a8a59d34d518 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 05:16:02.448995 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:16:02.448995 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:16:02.448995 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:16:02.448995 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:16:02.448995 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:16:02.448995 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:16:02.448995 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:16:02.448995 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:16:02.448995 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:16:02.448995 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:16:02.448995 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:16:02.448995 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:16:02.448995 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:16:02.448995 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:16:02.448995 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:16:02.449898 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:16:02.449898 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:16:02.449898 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:16:02.449898 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:16:02.449898 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:16:02.449898 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:16:02.449898 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:16:02.449898 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:16:02.449898 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:16:02.449898 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:16:02.449898 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:16:02.449898 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:16:02.449898 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:16:02.449898 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:16:02.449898 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:16:02.449898 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:16:02.451056 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:16:02.451056 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:16:02.451056 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:16:02.451056 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:16:02.451056 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:16:02.451056 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:16:02.451056 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:16:02.451056 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:16:02.451056 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:16:02.451056 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:16:02.451056 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 05:16:02.451056 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:16:02.451056 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 95/189] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 11 05:16:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:16:02.455817 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82895418-1841-4de3-95ec-a8a59d34d518 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:02.464081 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee23da2-a62a-4138-96c3-63c2525dd3d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:02.464932 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee23da2-a62a-4138-96c3-63c2525dd3d1 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:02.465387 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee23da2-a62a-4138-96c3-63c2525dd3d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:02.465835 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee23da2-a62a-4138-96c3-63c2525dd3d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:02.466746 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee23da2-a62a-4138-96c3-63c2525dd3d1 None admin] RBAC: Adding query filter params (role.id=aa7ff8e0ec1e48e5811335b9eb38b448, scope.project.id=7e503384e94e48219fa1772216cc5b53, user.id=12f73b160732426b867094e731e1a1f8) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:02.467255 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee23da2-a62a-4138-96c3-63c2525dd3d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:02.468932 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee23da2-a62a-4138-96c3-63c2525dd3d1 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:02.483542 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 95/190] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 05:16:02 2022] GET /identity/v3/role_assignments?user.id=12f73b160732426b867094e731e1a1f8&scope.project.id=7e503384e94e48219fa1772216cc5b53&role.id=aa7ff8e0ec1e48e5811335b9eb38b448 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:02.484883 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee23da2-a62a-4138-96c3-63c2525dd3d1 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:02.598817 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82895418-1841-4de3-95ec-a8a59d34d518 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:02.617724 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee23da2-a62a-4138-96c3-63c2525dd3d1 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:02.638002 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f5a7f-3c89-4697-8778-6497c02b1190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:02.638642 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f5a7f-3c89-4697-8778-6497c02b1190 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:02.638927 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f5a7f-3c89-4697-8778-6497c02b1190 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:02.639206 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f5a7f-3c89-4697-8778-6497c02b1190 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:02.665111 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1efa42-f51f-45e9-b702-3b5522aadffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:02.666182 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1efa42-f51f-45e9-b702-3b5522aadffd None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:02.666475 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1efa42-f51f-45e9-b702-3b5522aadffd None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:02.666750 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1efa42-f51f-45e9-b702-3b5522aadffd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:02.668180 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1efa42-f51f-45e9-b702-3b5522aadffd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:02.669829 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1efa42-f51f-45e9-b702-3b5522aadffd None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:02.673298 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 96/191] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:16:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:02.675883 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1efa42-f51f-45e9-b702-3b5522aadffd None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:02.710472 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:02.715029 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:02.728412 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441f5a7f-3c89-4697-8778-6497c02b1190 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:02.729902 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441f5a7f-3c89-4697-8778-6497c02b1190 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:02.800397 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1efa42-f51f-45e9-b702-3b5522aadffd None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:02.834672 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185346d1-0caf-45f6-b2e4-05fad8f095b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:02.835285 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185346d1-0caf-45f6-b2e4-05fad8f095b9 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:02.835568 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185346d1-0caf-45f6-b2e4-05fad8f095b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:02.835878 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185346d1-0caf-45f6-b2e4-05fad8f095b9 None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:02.836540 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185346d1-0caf-45f6-b2e4-05fad8f095b9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:02.836849 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185346d1-0caf-45f6-b2e4-05fad8f095b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:02.838239 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185346d1-0caf-45f6-b2e4-05fad8f095b9 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:02.851413 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 97/192] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 05:16:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:02.851413 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185346d1-0caf-45f6-b2e4-05fad8f095b9 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:02.858059 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 96/193] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 05:16:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 05:16:02.858851 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f5a7f-3c89-4697-8778-6497c02b1190 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:02.948223 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:02.957455 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185346d1-0caf-45f6-b2e4-05fad8f095b9 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:02.960238 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:02.970629 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f5a7f-3c89-4697-8778-6497c02b1190 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:02.992375 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1783504-f6d3-42d0-9699-28aec979d78b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:02.993027 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1783504-f6d3-42d0-9699-28aec979d78b None admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:02.993270 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1783504-f6d3-42d0-9699-28aec979d78b None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:02.993971 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1783504-f6d3-42d0-9699-28aec979d78b None admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:02.994709 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1783504-f6d3-42d0-9699-28aec979d78b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:02.996132 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1783504-f6d3-42d0-9699-28aec979d78b None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:03.008635 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945f2236-0696-4ee1-afa5-4c6f04a7dbf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:03.009280 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f2236-0696-4ee1-afa5-4c6f04a7dbf8 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:03.009559 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f2236-0696-4ee1-afa5-4c6f04a7dbf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:03.009861 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f2236-0696-4ee1-afa5-4c6f04a7dbf8 None admin] PATH_INFO: `/v3/users/aecacb74a633441ba43d62b17df57b0b` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:03.010969 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945f2236-0696-4ee1-afa5-4c6f04a7dbf8 None admin] RBAC: Authorizing `identity:get_user(user_id=aecacb74a633441ba43d62b17df57b0b)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:03.012463 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945f2236-0696-4ee1-afa5-4c6f04a7dbf8 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:03.014148 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 97/194] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 05:16:02 2022] GET /identity/v3/users/aecacb74a633441ba43d62b17df57b0b => generated 283 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:03.014991 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945f2236-0696-4ee1-afa5-4c6f04a7dbf8 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:03.019338 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 98/195] 10.222.0.16 () {60 vars in 1132 bytes} [Sun Sep 11 05:16:02 2022] POST /identity/v3/users => generated 297 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:16:03.023735 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1783504-f6d3-42d0-9699-28aec979d78b None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:03.144845 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945f2236-0696-4ee1-afa5-4c6f04a7dbf8 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:03.184902 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1783504-f6d3-42d0-9699-28aec979d78b None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:03.190161 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aa7d8c-0c84-49f2-89ab-7f37b9be4a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:03.190886 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa7d8c-0c84-49f2-89ab-7f37b9be4a9f None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:03.191236 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa7d8c-0c84-49f2-89ab-7f37b9be4a9f None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:03.191600 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa7d8c-0c84-49f2-89ab-7f37b9be4a9f None admin] PATH_INFO: `/v3/projects/ca0a33c848834728909bb4815ac1e8bc` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:03.193347 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aa7d8c-0c84-49f2-89ab-7f37b9be4a9f None admin] RBAC: Authorizing `identity:get_project(project_id=ca0a33c848834728909bb4815ac1e8bc)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:03.196226 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aa7d8c-0c84-49f2-89ab-7f37b9be4a9f None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:03.197015 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 98/196] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 05:16:03 2022] GET /identity/v3/projects/ca0a33c848834728909bb4815ac1e8bc => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:03.202962 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aa7d8c-0c84-49f2-89ab-7f37b9be4a9f None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:03.227724 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b167d310-8832-4626-bf33-536c31b439b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:03.228605 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b167d310-8832-4626-bf33-536c31b439b3 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:03.229185 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b167d310-8832-4626-bf33-536c31b439b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:03.229185 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b167d310-8832-4626-bf33-536c31b439b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:03.240703 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:03.252251 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:03.324682 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b167d310-8832-4626-bf33-536c31b439b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:03.326170 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b167d310-8832-4626-bf33-536c31b439b3 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:03.350571 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aa7d8c-0c84-49f2-89ab-7f37b9be4a9f None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:03.409776 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb34019-0ad3-4b06-9f7e-bafb84557296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:03.410405 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb34019-0ad3-4b06-9f7e-bafb84557296 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:03.410683 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb34019-0ad3-4b06-9f7e-bafb84557296 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:03.410958 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb34019-0ad3-4b06-9f7e-bafb84557296 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:03.414614 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb34019-0ad3-4b06-9f7e-bafb84557296 None admin] RBAC: Adding query filter params (role.id=5b702713e40145b49e0b42abd0a5fba9, scope.project.id=ca0a33c848834728909bb4815ac1e8bc, user.id=aecacb74a633441ba43d62b17df57b0b) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:03.414614 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb34019-0ad3-4b06-9f7e-bafb84557296 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:03.414614 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb34019-0ad3-4b06-9f7e-bafb84557296 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:03.420168 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 99/197] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 05:16:03 2022] GET /identity/v3/role_assignments?user.id=aecacb74a633441ba43d62b17df57b0b&scope.project.id=ca0a33c848834728909bb4815ac1e8bc&role.id=5b702713e40145b49e0b42abd0a5fba9 => generated 259 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:16:03.463905 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 99/198] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 05:16:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 05:16:03.475876 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb34019-0ad3-4b06-9f7e-bafb84557296 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:03.632347 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:03.645068 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb34019-0ad3-4b06-9f7e-bafb84557296 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:03.697942 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295e6810-fc19-48ba-92aa-a165c039742f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:03.698588 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295e6810-fc19-48ba-92aa-a165c039742f None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:03.698870 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295e6810-fc19-48ba-92aa-a165c039742f None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:03.699145 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295e6810-fc19-48ba-92aa-a165c039742f None admin] PATH_INFO: `/v3/projects/ca0a33c848834728909bb4815ac1e8bc` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:03.700368 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295e6810-fc19-48ba-92aa-a165c039742f None admin] RBAC: Authorizing `identity:get_project(project_id=ca0a33c848834728909bb4815ac1e8bc)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:03.701821 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295e6810-fc19-48ba-92aa-a165c039742f None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:03.703774 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 100/199] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 05:16:03 2022] GET /identity/v3/projects/ca0a33c848834728909bb4815ac1e8bc => generated 302 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:03.709515 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b167d310-8832-4626-bf33-536c31b439b3 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:03.763504 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:03.856155 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b167d310-8832-4626-bf33-536c31b439b3 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:03.892066 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d27a35a-f142-4375-8028-d3b3b5a2f008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:03.892679 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d27a35a-f142-4375-8028-d3b3b5a2f008 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:03.892954 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d27a35a-f142-4375-8028-d3b3b5a2f008 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:03.893221 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d27a35a-f142-4375-8028-d3b3b5a2f008 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:03.893946 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d27a35a-f142-4375-8028-d3b3b5a2f008 None admin] RBAC: Adding query filter params (role.id=ada04449ee1f42599a060f4795ec1a74, scope.project.id=ca0a33c848834728909bb4815ac1e8bc, user.id=aecacb74a633441ba43d62b17df57b0b) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:03.894249 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d27a35a-f142-4375-8028-d3b3b5a2f008 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:03.895729 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d27a35a-f142-4375-8028-d3b3b5a2f008 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:03.902196 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 100/200] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 05:16:03 2022] GET /identity/v3/role_assignments?user.id=aecacb74a633441ba43d62b17df57b0b&scope.project.id=ca0a33c848834728909bb4815ac1e8bc&role.id=ada04449ee1f42599a060f4795ec1a74 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:16:03.961396 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27854e33-2106-4508-9790-33356cfe99bc None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:03.961913 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27854e33-2106-4508-9790-33356cfe99bc None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:03.962168 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27854e33-2106-4508-9790-33356cfe99bc None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:03.963750 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 101/201] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:16:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:16:03.969006 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99797d42-ae90-4fe9-90a5-ffd4e6799422 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:03.969263 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99797d42-ae90-4fe9-90a5-ffd4e6799422 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:03.969583 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99797d42-ae90-4fe9-90a5-ffd4e6799422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:03.990363 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-99797d42-ae90-4fe9-90a5-ffd4e6799422 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:16:03.991577 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-99797d42-ae90-4fe9-90a5-ffd4e6799422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:16:04.079043 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 101/202] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:16:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 05:16:04.461953 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27854e33-2106-4508-9790-33356cfe99bc None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:04.571778 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27854e33-2106-4508-9790-33356cfe99bc None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:04.615476 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d4e482-b4e6-4040-833d-8110fd835fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:04.616146 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d4e482-b4e6-4040-833d-8110fd835fed None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:04.616427 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d4e482-b4e6-4040-833d-8110fd835fed None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:04.616699 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d4e482-b4e6-4040-833d-8110fd835fed None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:04.630549 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d4e482-b4e6-4040-833d-8110fd835fed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:16:04.637041 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-d0d4e482-b4e6-4040-833d-8110fd835fed None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 05:16:04.637041 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:16:04.637041 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:16:04.637041 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:16:04.637041 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:16:04.637041 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:16:04.637041 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:16:04.637041 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:16:04.637041 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:16:04.637041 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:16:04.637041 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:16:04.637041 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:16:04.637041 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:16:04.637041 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:16:04.637041 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:16:04.637041 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:16:04.637946 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:16:04.637946 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:16:04.637946 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:16:04.637946 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:16:04.637946 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:16:04.637946 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:16:04.637946 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:16:04.637946 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:16:04.637946 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:16:04.637946 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:16:04.637946 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:16:04.637946 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:16:04.637946 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:16:04.637946 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:16:04.637946 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:16:04.637946 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:16:04.638767 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:16:04.638767 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:16:04.638767 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:16:04.638767 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:16:04.638767 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:16:04.638767 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:16:04.638767 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:16:04.638767 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:16:04.638767 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:16:04.638767 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:16:04.638767 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 05:16:04.638767 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:16:04.638767 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 102/203] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 05:16:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:16:04.644182 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99797d42-ae90-4fe9-90a5-ffd4e6799422 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:04.700257 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:04.775481 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99797d42-ae90-4fe9-90a5-ffd4e6799422 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:04.822871 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b183b8-97b1-4051-a951-29fd5e00ab23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:04.823537 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b183b8-97b1-4051-a951-29fd5e00ab23 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:04.823847 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b183b8-97b1-4051-a951-29fd5e00ab23 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:04.824121 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b183b8-97b1-4051-a951-29fd5e00ab23 None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:04.824849 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b183b8-97b1-4051-a951-29fd5e00ab23 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:04.825156 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b183b8-97b1-4051-a951-29fd5e00ab23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:04.826543 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b183b8-97b1-4051-a951-29fd5e00ab23 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:04.837363 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 102/204] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 11 05:16:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:04.843101 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d4e482-b4e6-4040-833d-8110fd835fed None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:04.876009 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:05.009922 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d4e482-b4e6-4040-833d-8110fd835fed None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:05.081391 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fae61a4-ed5b-4555-827f-2aeafb68bcad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:05.081956 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae61a4-ed5b-4555-827f-2aeafb68bcad None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:05.082241 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae61a4-ed5b-4555-827f-2aeafb68bcad None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:05.082515 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae61a4-ed5b-4555-827f-2aeafb68bcad None admin] PATH_INFO: `/v3/users/c395bb82392343abb1eb618fa2d60676` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:05.085542 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fae61a4-ed5b-4555-827f-2aeafb68bcad None admin] RBAC: Authorizing `identity:get_user(user_id=c395bb82392343abb1eb618fa2d60676)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:05.087018 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fae61a4-ed5b-4555-827f-2aeafb68bcad None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:05.088714 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 103/205] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 05:16:04 2022] GET /identity/v3/users/c395bb82392343abb1eb618fa2d60676 => generated 289 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:05.094246 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b183b8-97b1-4051-a951-29fd5e00ab23 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:05.276771 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b183b8-97b1-4051-a951-29fd5e00ab23 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:05.283983 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:05.353054 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8490c2-9837-49c0-ba21-97160a34f076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:05.355701 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8490c2-9837-49c0-ba21-97160a34f076 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:05.355701 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8490c2-9837-49c0-ba21-97160a34f076 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:05.355701 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8490c2-9837-49c0-ba21-97160a34f076 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:05.424591 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8490c2-9837-49c0-ba21-97160a34f076 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:05.426066 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8490c2-9837-49c0-ba21-97160a34f076 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:05.595019 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 103/206] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 05:16:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 05:16:05.600565 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fae61a4-ed5b-4555-827f-2aeafb68bcad None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:05.720503 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:05.737236 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fae61a4-ed5b-4555-827f-2aeafb68bcad None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:05.781739 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccc9438-ae91-4a69-87d4-208cb8978316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:05.782668 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccc9438-ae91-4a69-87d4-208cb8978316 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:05.783119 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccc9438-ae91-4a69-87d4-208cb8978316 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:05.783581 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccc9438-ae91-4a69-87d4-208cb8978316 None admin] PATH_INFO: `/v3/projects/199292d828144a70992f2344ae63f351` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:05.784939 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccc9438-ae91-4a69-87d4-208cb8978316 None admin] RBAC: Authorizing `identity:get_project(project_id=199292d828144a70992f2344ae63f351)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:05.786697 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccc9438-ae91-4a69-87d4-208cb8978316 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:05.791712 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 104/207] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 05:16:05 2022] GET /identity/v3/projects/199292d828144a70992f2344ae63f351 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:05.796783 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8490c2-9837-49c0-ba21-97160a34f076 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:05.800011 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:05.921856 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8490c2-9837-49c0-ba21-97160a34f076 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:05.959912 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e08fdf2-8783-4419-a4df-5be3ddee5ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:05.960544 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e08fdf2-8783-4419-a4df-5be3ddee5ece None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:05.960823 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e08fdf2-8783-4419-a4df-5be3ddee5ece None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:05.961096 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e08fdf2-8783-4419-a4df-5be3ddee5ece None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:05.961901 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e08fdf2-8783-4419-a4df-5be3ddee5ece None admin] RBAC: Adding query filter params (role.id=6f65b7f0071d466aa6ecf94916300a38, scope.project.id=199292d828144a70992f2344ae63f351, user.id=c395bb82392343abb1eb618fa2d60676) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:05.962209 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e08fdf2-8783-4419-a4df-5be3ddee5ece None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:05.963736 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e08fdf2-8783-4419-a4df-5be3ddee5ece None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:05.970651 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 104/208] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 05:16:05 2022] GET /identity/v3/role_assignments?user.id=c395bb82392343abb1eb618fa2d60676&scope.project.id=199292d828144a70992f2344ae63f351&role.id=6f65b7f0071d466aa6ecf94916300a38 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:06.103104 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc0cf7b-7b92-4ae0-a076-e17229d34068 None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:06.104050 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc0cf7b-7b92-4ae0-a076-e17229d34068 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:06.104774 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc0cf7b-7b92-4ae0-a076-e17229d34068 None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:06.106836 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 105/209] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:16:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:16:06.112490 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d0272f-0933-4b51-a63a-582b6d3e9c01 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:06.112971 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d0272f-0933-4b51-a63a-582b6d3e9c01 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:06.113076 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d0272f-0933-4b51-a63a-582b6d3e9c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:06.140841 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-d2d0272f-0933-4b51-a63a-582b6d3e9c01 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:16:06.142078 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-d2d0272f-0933-4b51-a63a-582b6d3e9c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:16:06.190191 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f2da0d-dae4-4041-88fe-12922042b503 None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:06.190810 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f2da0d-dae4-4041-88fe-12922042b503 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:06.191337 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f2da0d-dae4-4041-88fe-12922042b503 None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:06.193312 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 106/210] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:16:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:16:06.198546 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc61105f-b42a-47e3-9a23-1f6fb1a59bad None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:06.199087 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc61105f-b42a-47e3-9a23-1f6fb1a59bad None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:06.199557 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc61105f-b42a-47e3-9a23-1f6fb1a59bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:06.218265 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:06.224295 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 105/211] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:16:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 05:16:06.233379 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-bc61105f-b42a-47e3-9a23-1f6fb1a59bad None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:16:06.234803 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-bc61105f-b42a-47e3-9a23-1f6fb1a59bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:16:06.309184 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 107/212] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:16:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 05:16:06.415162 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494393d1-21f9-4bbe-aec3-144e45c01511 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:06.415513 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494393d1-21f9-4bbe-aec3-144e45c01511 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:06.415740 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494393d1-21f9-4bbe-aec3-144e45c01511 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:06.417397 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 106/213] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:16:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:16:06.422789 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf6a5c-c8a1-4e36-b181-7338a8aef509 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:06.423078 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf6a5c-c8a1-4e36-b181-7338a8aef509 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:06.423364 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf6a5c-c8a1-4e36-b181-7338a8aef509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:06.443648 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-42bf6a5c-c8a1-4e36-b181-7338a8aef509 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:16:06.444874 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-42bf6a5c-c8a1-4e36-b181-7338a8aef509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:16:06.531320 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494393d1-21f9-4bbe-aec3-144e45c01511 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:06.534248 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 108/214] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:16:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 05:16:06.608710 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf6a5c-c8a1-4e36-b181-7338a8aef509 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:06.628099 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:06.652184 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494393d1-21f9-4bbe-aec3-144e45c01511 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:06.699346 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60474f5-7f10-458f-8546-fcc2761ab378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:06.700609 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60474f5-7f10-458f-8546-fcc2761ab378 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:06.701115 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60474f5-7f10-458f-8546-fcc2761ab378 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:06.701788 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60474f5-7f10-458f-8546-fcc2761ab378 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:06.703665 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60474f5-7f10-458f-8546-fcc2761ab378 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:06.705692 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60474f5-7f10-458f-8546-fcc2761ab378 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:06.708176 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 107/215] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:16:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:06.713705 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60474f5-7f10-458f-8546-fcc2761ab378 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:06.726095 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf6a5c-c8a1-4e36-b181-7338a8aef509 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:06.767453 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2a67e1-5393-44ba-a37a-20318e5da293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:06.768422 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a67e1-5393-44ba-a37a-20318e5da293 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:06.768871 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a67e1-5393-44ba-a37a-20318e5da293 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:06.769338 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a67e1-5393-44ba-a37a-20318e5da293 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:06.780668 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2a67e1-5393-44ba-a37a-20318e5da293 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:16:06.786997 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-ab2a67e1-5393-44ba-a37a-20318e5da293 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 05:16:06.786997 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:16:06.786997 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:16:06.786997 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:16:06.786997 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:16:06.786997 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:16:06.786997 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:16:06.786997 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:16:06.786997 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:16:06.786997 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:16:06.786997 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:16:06.786997 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:16:06.786997 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:16:06.786997 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:16:06.786997 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:16:06.786997 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:16:06.787939 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:16:06.787939 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:16:06.787939 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:16:06.787939 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:16:06.787939 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:16:06.787939 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:16:06.787939 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:16:06.787939 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:16:06.787939 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:16:06.787939 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:16:06.787939 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:16:06.787939 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:16:06.787939 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:16:06.787939 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:16:06.787939 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:16:06.787939 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:16:06.788709 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:16:06.788709 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:16:06.788709 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:16:06.788709 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:16:06.788709 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:16:06.788709 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:16:06.788709 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:16:06.788709 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:16:06.788709 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:16:06.788709 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:16:06.788709 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 05:16:06.788709 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:16:06.791278 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 109/216] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 05:16:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 05:16:06.792768 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0856f904-b338-4629-9642-d2f247ef2376 None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:06.793203 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0856f904-b338-4629-9642-d2f247ef2376 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:06.793612 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0856f904-b338-4629-9642-d2f247ef2376 None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:06.795001 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 110/217] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:16:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:16:06.796745 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0856f904-b338-4629-9642-d2f247ef2376 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:06.807269 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:06.843801 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60474f5-7f10-458f-8546-fcc2761ab378 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:06.879749 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc51804f-9a96-4886-96c5-7ec1592de003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:06.880367 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc51804f-9a96-4886-96c5-7ec1592de003 None admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:06.880651 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc51804f-9a96-4886-96c5-7ec1592de003 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:06.880930 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc51804f-9a96-4886-96c5-7ec1592de003 None admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:06.881507 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:06.881614 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc51804f-9a96-4886-96c5-7ec1592de003 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:06.883531 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc51804f-9a96-4886-96c5-7ec1592de003 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:06.904162 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 108/218] 10.222.0.16 () {60 vars in 1132 bytes} [Sun Sep 11 05:16:06 2022] POST /identity/v3/users => generated 297 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 05:16:06.905752 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf25cf-dc9f-44a0-94fd-7ac9d8e4ec8c None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:06.906087 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf25cf-dc9f-44a0-94fd-7ac9d8e4ec8c None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:06.906428 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf25cf-dc9f-44a0-94fd-7ac9d8e4ec8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:06.913991 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0856f904-b338-4629-9642-d2f247ef2376 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:06.937169 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-7faf25cf-dc9f-44a0-94fd-7ac9d8e4ec8c None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:16:06.938399 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-7faf25cf-dc9f-44a0-94fd-7ac9d8e4ec8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:16:06.955260 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1da181f-0899-4e39-9b2b-99f3f0afa347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:06.955919 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1da181f-0899-4e39-9b2b-99f3f0afa347 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:06.956299 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1da181f-0899-4e39-9b2b-99f3f0afa347 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:06.956583 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1da181f-0899-4e39-9b2b-99f3f0afa347 None admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:06.957304 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1da181f-0899-4e39-9b2b-99f3f0afa347 None admin] RBAC: Adding query filter params (name=member) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:06.957614 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1da181f-0899-4e39-9b2b-99f3f0afa347 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:06.959572 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1da181f-0899-4e39-9b2b-99f3f0afa347 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:06.969328 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 111/219] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 11 05:16:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:06.970209 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1da181f-0899-4e39-9b2b-99f3f0afa347 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:07.019908 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 109/220] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:16:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 05:16:07.023962 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faf25cf-dc9f-44a0-94fd-7ac9d8e4ec8c None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:07.093985 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1da181f-0899-4e39-9b2b-99f3f0afa347 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:07.107409 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:07.142357 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0773693c-e7ce-49b7-811e-506e5e3dda50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:07.143183 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0773693c-e7ce-49b7-811e-506e5e3dda50 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:07.143355 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0773693c-e7ce-49b7-811e-506e5e3dda50 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:07.143633 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0773693c-e7ce-49b7-811e-506e5e3dda50 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:07.157795 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:07.163962 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0773693c-e7ce-49b7-811e-506e5e3dda50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:16:07.169136 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-0773693c-e7ce-49b7-811e-506e5e3dda50 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 05:16:07.169136 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:16:07.169136 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:16:07.169136 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:16:07.169136 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:16:07.169136 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:16:07.169136 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:16:07.169136 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:16:07.169136 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:16:07.169136 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:16:07.169136 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:16:07.169136 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:16:07.169136 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:16:07.169136 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:16:07.169136 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:16:07.169136 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:16:07.170005 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:16:07.170005 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:16:07.170005 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:16:07.170005 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:16:07.170005 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:16:07.170005 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:16:07.170005 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:16:07.170005 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:16:07.170005 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:16:07.170005 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:16:07.170005 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:16:07.170005 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:16:07.170005 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:16:07.170005 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:16:07.170005 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:16:07.170005 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:16:07.170781 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:16:07.170781 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:16:07.170781 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:16:07.170781 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:16:07.170781 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:16:07.170781 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:16:07.170781 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:16:07.170781 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:16:07.170781 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:16:07.170781 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:16:07.170781 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 05:16:07.170781 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:16:07.173284 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 112/221] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 05:16:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:16:07.179167 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faf25cf-dc9f-44a0-94fd-7ac9d8e4ec8c None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:07.179960 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0773693c-e7ce-49b7-811e-506e5e3dda50 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:07.221727 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5038cbc-1009-491b-8202-3d208a48a5ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:07.222365 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5038cbc-1009-491b-8202-3d208a48a5ad None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:07.222642 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5038cbc-1009-491b-8202-3d208a48a5ad None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:07.222911 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5038cbc-1009-491b-8202-3d208a48a5ad None admin] PATH_INFO: `/v3/users/eabe71d49b03411aa65a66a3c3dfa7a2` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:07.238236 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5038cbc-1009-491b-8202-3d208a48a5ad None admin] RBAC: Authorizing `identity:get_user(user_id=eabe71d49b03411aa65a66a3c3dfa7a2)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:07.240565 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5038cbc-1009-491b-8202-3d208a48a5ad None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:07.244256 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 110/222] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 05:16:07 2022] GET /identity/v3/users/eabe71d49b03411aa65a66a3c3dfa7a2 => generated 297 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:07.249131 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5038cbc-1009-491b-8202-3d208a48a5ad None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:07.315365 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0773693c-e7ce-49b7-811e-506e5e3dda50 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:07.360253 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfab9eb-ce2f-4b0e-a66b-b4310b897130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:07.361207 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfab9eb-ce2f-4b0e-a66b-b4310b897130 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:07.361817 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfab9eb-ce2f-4b0e-a66b-b4310b897130 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:07.362155 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfab9eb-ce2f-4b0e-a66b-b4310b897130 None admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:07.362833 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfab9eb-ce2f-4b0e-a66b-b4310b897130 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:07.363184 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfab9eb-ce2f-4b0e-a66b-b4310b897130 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:07.365627 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfab9eb-ce2f-4b0e-a66b-b4310b897130 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:07.374857 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 113/223] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 05:16:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:16:07.375665 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfab9eb-ce2f-4b0e-a66b-b4310b897130 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:07.375935 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5038cbc-1009-491b-8202-3d208a48a5ad None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:07.390171 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:07.417101 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140b7905-328a-4ba8-9a0f-36d4bd5dc18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:07.418134 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b7905-328a-4ba8-9a0f-36d4bd5dc18f None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:07.418672 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b7905-328a-4ba8-9a0f-36d4bd5dc18f None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:07.419141 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b7905-328a-4ba8-9a0f-36d4bd5dc18f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:07.443154 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:07.488103 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfab9eb-ce2f-4b0e-a66b-b4310b897130 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:07.496437 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140b7905-328a-4ba8-9a0f-36d4bd5dc18f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:07.498510 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140b7905-328a-4ba8-9a0f-36d4bd5dc18f None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:07.528416 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989292f8-8e9d-4bc6-8a4f-b82f7464d6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:07.529116 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989292f8-8e9d-4bc6-8a4f-b82f7464d6d4 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:07.529390 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989292f8-8e9d-4bc6-8a4f-b82f7464d6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:07.529657 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989292f8-8e9d-4bc6-8a4f-b82f7464d6d4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:07.540908 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989292f8-8e9d-4bc6-8a4f-b82f7464d6d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:16:07.546556 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-989292f8-8e9d-4bc6-8a4f-b82f7464d6d4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 05:16:07.546556 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:16:07.546556 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:16:07.546556 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:16:07.546556 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:16:07.546556 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:16:07.546556 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:16:07.546556 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:16:07.546556 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:16:07.546556 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:16:07.546556 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:16:07.546556 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:16:07.546556 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:16:07.546556 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:16:07.546556 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:16:07.546556 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:16:07.547443 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:16:07.547443 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:16:07.547443 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:16:07.547443 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:16:07.547443 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:16:07.547443 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:16:07.547443 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:16:07.547443 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:16:07.547443 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:16:07.547443 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:16:07.547443 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:16:07.547443 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:16:07.547443 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:16:07.547443 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:16:07.547443 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:16:07.547443 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:16:07.548285 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:16:07.548285 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:16:07.548285 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:16:07.548285 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:16:07.548285 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:16:07.548285 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:16:07.548285 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:16:07.548285 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:16:07.548285 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:16:07.548285 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:16:07.548285 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 05:16:07.548285 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:16:07.548285 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 114/224] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 11 05:16:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:16:07.548948 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989292f8-8e9d-4bc6-8a4f-b82f7464d6d4 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:07.620004 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 111/225] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 05:16:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 11 05:16:07.621237 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140b7905-328a-4ba8-9a0f-36d4bd5dc18f None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:07.634484 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:07.660017 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989292f8-8e9d-4bc6-8a4f-b82f7464d6d4 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:07.681573 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:07.702641 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18156b2-e590-4bd8-af00-86e113ce8bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:07.703634 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18156b2-e590-4bd8-af00-86e113ce8bae None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:07.704122 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18156b2-e590-4bd8-af00-86e113ce8bae None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:07.704539 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18156b2-e590-4bd8-af00-86e113ce8bae None admin] PATH_INFO: `/v3/users/aecacb74a633441ba43d62b17df57b0b` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:07.706352 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18156b2-e590-4bd8-af00-86e113ce8bae None admin] RBAC: Authorizing `identity:get_user(user_id=aecacb74a633441ba43d62b17df57b0b)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:07.709077 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18156b2-e590-4bd8-af00-86e113ce8bae None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:07.711583 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 115/226] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 05:16:07 2022] GET /identity/v3/users/aecacb74a633441ba43d62b17df57b0b => generated 283 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:07.712768 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18156b2-e590-4bd8-af00-86e113ce8bae None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:07.732779 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140b7905-328a-4ba8-9a0f-36d4bd5dc18f None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:07.774907 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92266d3-26c2-4595-9b80-cb04cebc2a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:07.775538 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92266d3-26c2-4595-9b80-cb04cebc2a9d None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:07.776088 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92266d3-26c2-4595-9b80-cb04cebc2a9d None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:07.776088 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92266d3-26c2-4595-9b80-cb04cebc2a9d None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:07.776724 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92266d3-26c2-4595-9b80-cb04cebc2a9d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:07.777030 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92266d3-26c2-4595-9b80-cb04cebc2a9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:07.778404 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92266d3-26c2-4595-9b80-cb04cebc2a9d None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:07.794290 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 112/227] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 05:16:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:07.794290 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92266d3-26c2-4595-9b80-cb04cebc2a9d None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:07.849560 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18156b2-e590-4bd8-af00-86e113ce8bae None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:07.868540 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:07.891890 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff1b3b0-d483-4376-9902-e45f65660e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:07.892894 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff1b3b0-d483-4376-9902-e45f65660e4d None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:07.893371 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff1b3b0-d483-4376-9902-e45f65660e4d None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:07.893855 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff1b3b0-d483-4376-9902-e45f65660e4d None admin] PATH_INFO: `/v3/projects/ca0a33c848834728909bb4815ac1e8bc` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:07.895192 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff1b3b0-d483-4376-9902-e45f65660e4d None admin] RBAC: Authorizing `identity:get_project(project_id=ca0a33c848834728909bb4815ac1e8bc)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:07.897673 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff1b3b0-d483-4376-9902-e45f65660e4d None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:07.899859 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 116/228] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 05:16:07 2022] GET /identity/v3/projects/ca0a33c848834728909bb4815ac1e8bc => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:07.900825 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff1b3b0-d483-4376-9902-e45f65660e4d None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:07.902426 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92266d3-26c2-4595-9b80-cb04cebc2a9d None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:07.939033 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dcfca3-4d88-4074-b0cf-6eab44847878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:07.939626 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dcfca3-4d88-4074-b0cf-6eab44847878 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:07.939970 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dcfca3-4d88-4074-b0cf-6eab44847878 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:07.940253 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dcfca3-4d88-4074-b0cf-6eab44847878 None admin] PATH_INFO: `/v3/projects/ca0a33c848834728909bb4815ac1e8bc` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:07.941421 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dcfca3-4d88-4074-b0cf-6eab44847878 None admin] RBAC: Authorizing `identity:get_project(project_id=ca0a33c848834728909bb4815ac1e8bc)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:07.942996 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dcfca3-4d88-4074-b0cf-6eab44847878 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:07.944861 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 113/229] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 05:16:07 2022] GET /identity/v3/projects/ca0a33c848834728909bb4815ac1e8bc => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:07.945629 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dcfca3-4d88-4074-b0cf-6eab44847878 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:07.970230 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:08.023470 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff1b3b0-d483-4376-9902-e45f65660e4d None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:08.051523 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dcfca3-4d88-4074-b0cf-6eab44847878 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:08.063054 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d66caf-a951-4393-b256-af7bb5a2997c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:08.064210 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d66caf-a951-4393-b256-af7bb5a2997c None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:08.064705 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d66caf-a951-4393-b256-af7bb5a2997c None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:08.065176 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d66caf-a951-4393-b256-af7bb5a2997c None admin] PATH_INFO: `/v3/users/aecacb74a633441ba43d62b17df57b0b` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:08.066679 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d66caf-a951-4393-b256-af7bb5a2997c None admin] RBAC: Authorizing `identity:get_user(user_id=aecacb74a633441ba43d62b17df57b0b)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:08.069535 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d66caf-a951-4393-b256-af7bb5a2997c None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:08.075987 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 117/230] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 05:16:07 2022] GET /identity/v3/users/aecacb74a633441ba43d62b17df57b0b => generated 283 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:08.077460 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d66caf-a951-4393-b256-af7bb5a2997c None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:08.090977 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8bc227-0ae6-4e02-810f-b2e20f2d9ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:08.091645 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8bc227-0ae6-4e02-810f-b2e20f2d9ca9 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:08.091955 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8bc227-0ae6-4e02-810f-b2e20f2d9ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:08.092226 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8bc227-0ae6-4e02-810f-b2e20f2d9ca9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:08.092961 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8bc227-0ae6-4e02-810f-b2e20f2d9ca9 None admin] RBAC: Adding query filter params (role.id=aa7ff8e0ec1e48e5811335b9eb38b448, scope.project.id=ca0a33c848834728909bb4815ac1e8bc, user.id=eabe71d49b03411aa65a66a3c3dfa7a2) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:08.093269 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8bc227-0ae6-4e02-810f-b2e20f2d9ca9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:08.094734 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8bc227-0ae6-4e02-810f-b2e20f2d9ca9 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:08.101288 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 114/231] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 05:16:07 2022] GET /identity/v3/role_assignments?user.id=eabe71d49b03411aa65a66a3c3dfa7a2&scope.project.id=ca0a33c848834728909bb4815ac1e8bc&role.id=aa7ff8e0ec1e48e5811335b9eb38b448 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:08.102192 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8bc227-0ae6-4e02-810f-b2e20f2d9ca9 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:08.105897 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:08.238279 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d66caf-a951-4393-b256-af7bb5a2997c None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:08.283735 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8bc227-0ae6-4e02-810f-b2e20f2d9ca9 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:08.300573 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:08.319765 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070cf9c4-fadf-4b38-8cf6-38144f8930f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:08.320436 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070cf9c4-fadf-4b38-8cf6-38144f8930f5 None admin] REQUEST_METHOD: `PUT` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:08.320712 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070cf9c4-fadf-4b38-8cf6-38144f8930f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:08.320984 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070cf9c4-fadf-4b38-8cf6-38144f8930f5 None admin] PATH_INFO: `/v3/projects/ca0a33c848834728909bb4815ac1e8bc/users/aecacb74a633441ba43d62b17df57b0b/roles/5b702713e40145b49e0b42abd0a5fba9` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:08.323712 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070cf9c4-fadf-4b38-8cf6-38144f8930f5 None admin] RBAC: Authorizing `identity:create_grant(project_id=ca0a33c848834728909bb4815ac1e8bc, user_id=aecacb74a633441ba43d62b17df57b0b, role_id=5b702713e40145b49e0b42abd0a5fba9)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:08.325093 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070cf9c4-fadf-4b38-8cf6-38144f8930f5 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:08.337111 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67312b9c-10e7-4e57-89e8-e59a6f648241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:08.338164 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67312b9c-10e7-4e57-89e8-e59a6f648241 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:08.338646 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67312b9c-10e7-4e57-89e8-e59a6f648241 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:08.339123 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67312b9c-10e7-4e57-89e8-e59a6f648241 None admin] PATH_INFO: `/v3/projects/ca0a33c848834728909bb4815ac1e8bc` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:08.340448 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 118/232] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 11 05:16:08 2022] PUT /identity/v3/projects/ca0a33c848834728909bb4815ac1e8bc/users/aecacb74a633441ba43d62b17df57b0b/roles/5b702713e40145b49e0b42abd0a5fba9 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:16:08.340692 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67312b9c-10e7-4e57-89e8-e59a6f648241 None admin] RBAC: Authorizing `identity:get_project(project_id=ca0a33c848834728909bb4815ac1e8bc)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:08.342160 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67312b9c-10e7-4e57-89e8-e59a6f648241 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:08.344654 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 115/233] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 05:16:08 2022] GET /identity/v3/projects/ca0a33c848834728909bb4815ac1e8bc => generated 302 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:08.352209 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070cf9c4-fadf-4b38-8cf6-38144f8930f5 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:08.511589 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070cf9c4-fadf-4b38-8cf6-38144f8930f5 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:08.565863 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2653a969-65b6-4230-9e45-2f9b6fc6f8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:08.566548 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2653a969-65b6-4230-9e45-2f9b6fc6f8e1 None admin] REQUEST_METHOD: `PUT` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:08.566825 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2653a969-65b6-4230-9e45-2f9b6fc6f8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:08.567098 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2653a969-65b6-4230-9e45-2f9b6fc6f8e1 None admin] PATH_INFO: `/v3/projects/ca0a33c848834728909bb4815ac1e8bc/users/aecacb74a633441ba43d62b17df57b0b/roles/ada04449ee1f42599a060f4795ec1a74` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:08.569374 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2653a969-65b6-4230-9e45-2f9b6fc6f8e1 None admin] RBAC: Authorizing `identity:create_grant(project_id=ca0a33c848834728909bb4815ac1e8bc, user_id=aecacb74a633441ba43d62b17df57b0b, role_id=ada04449ee1f42599a060f4795ec1a74)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:08.570879 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2653a969-65b6-4230-9e45-2f9b6fc6f8e1 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:08.591194 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 119/234] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 11 05:16:08 2022] PUT /identity/v3/projects/ca0a33c848834728909bb4815ac1e8bc/users/aecacb74a633441ba43d62b17df57b0b/roles/ada04449ee1f42599a060f4795ec1a74 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:16:09.511072 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d4941d-c849-4312-9f40-eddaa4c17b5a None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:09.512140 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d4941d-c849-4312-9f40-eddaa4c17b5a None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:09.512617 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d4941d-c849-4312-9f40-eddaa4c17b5a None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:09.514387 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 116/235] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:16:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:16:09.520521 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea59222-c4eb-4f37-a490-603c93db477d None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:09.522025 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea59222-c4eb-4f37-a490-603c93db477d None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:09.522523 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea59222-c4eb-4f37-a490-603c93db477d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:09.541972 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-9ea59222-c4eb-4f37-a490-603c93db477d None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:16:09.543723 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-9ea59222-c4eb-4f37-a490-603c93db477d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:16:09.588380 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:09.619383 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 120/236] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:16:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 05:16:09.648848 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f65e33-afca-48a4-a850-6b91db6d5df7 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:09.649140 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f65e33-afca-48a4-a850-6b91db6d5df7 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:09.649401 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f65e33-afca-48a4-a850-6b91db6d5df7 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:09.651029 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 117/237] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:16:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:16:09.656332 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33253077-eed1-4237-96c3-dc8ea1f7363a None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:09.656623 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33253077-eed1-4237-96c3-dc8ea1f7363a None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:09.656902 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33253077-eed1-4237-96c3-dc8ea1f7363a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:09.688283 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-33253077-eed1-4237-96c3-dc8ea1f7363a None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:16:09.689494 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-33253077-eed1-4237-96c3-dc8ea1f7363a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:16:09.788426 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 121/238] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:16:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 05:16:09.919836 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f65e33-afca-48a4-a850-6b91db6d5df7 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:09.994783 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:10.029016 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f65e33-afca-48a4-a850-6b91db6d5df7 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:10.076441 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3464fa-80c3-4ff4-9904-bfa72d6333c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:10.077444 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3464fa-80c3-4ff4-9904-bfa72d6333c1 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:10.077948 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3464fa-80c3-4ff4-9904-bfa72d6333c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:10.078465 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3464fa-80c3-4ff4-9904-bfa72d6333c1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:10.090091 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3464fa-80c3-4ff4-9904-bfa72d6333c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:16:10.095801 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-7e3464fa-80c3-4ff4-9904-bfa72d6333c1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 05:16:10.095801 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:16:10.095801 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:16:10.095801 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:16:10.095801 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:16:10.095801 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:16:10.095801 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:16:10.095801 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:16:10.095801 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:16:10.095801 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:16:10.095801 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:16:10.095801 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:16:10.095801 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:16:10.095801 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:16:10.095801 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:16:10.095801 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:16:10.096674 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:16:10.096674 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:16:10.096674 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:16:10.096674 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:16:10.096674 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:16:10.096674 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:16:10.096674 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:16:10.096674 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:16:10.096674 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:16:10.096674 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:16:10.096674 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:16:10.096674 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:16:10.096674 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:16:10.096674 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:16:10.096674 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:16:10.096674 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:16:10.097451 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:16:10.097451 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:16:10.097451 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:16:10.097451 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:16:10.097451 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:16:10.097451 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:16:10.097451 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:16:10.097451 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:16:10.097451 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:16:10.097451 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:16:10.097451 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 05:16:10.097451 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:16:10.100158 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 118/239] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 05:16:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:16:10.106161 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33253077-eed1-4237-96c3-dc8ea1f7363a None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:10.228614 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33253077-eed1-4237-96c3-dc8ea1f7363a None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:10.236676 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:10.280950 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed17f8-34f6-48c3-8ba0-943fc8ec1f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:10.281580 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed17f8-34f6-48c3-8ba0-943fc8ec1f72 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:10.281864 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed17f8-34f6-48c3-8ba0-943fc8ec1f72 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:10.282136 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed17f8-34f6-48c3-8ba0-943fc8ec1f72 None admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:10.282813 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ed17f8-34f6-48c3-8ba0-943fc8ec1f72 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:10.283114 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ed17f8-34f6-48c3-8ba0-943fc8ec1f72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:10.284542 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ed17f8-34f6-48c3-8ba0-943fc8ec1f72 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:10.295236 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 122/240] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 11 05:16:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:10.300773 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3464fa-80c3-4ff4-9904-bfa72d6333c1 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:10.426682 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3464fa-80c3-4ff4-9904-bfa72d6333c1 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:10.427963 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed17f8-34f6-48c3-8ba0-943fc8ec1f72 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:10.473677 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:10.480978 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5fa88c-44e4-4ec8-ad62-a228952c8d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:10.481672 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5fa88c-44e4-4ec8-ad62-a228952c8d2d None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:10.481953 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5fa88c-44e4-4ec8-ad62-a228952c8d2d None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:10.482225 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5fa88c-44e4-4ec8-ad62-a228952c8d2d None admin] PATH_INFO: `/v3/users/b933e65201ba421a81082eac6b88f3df` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:10.496796 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5fa88c-44e4-4ec8-ad62-a228952c8d2d None admin] RBAC: Authorizing `identity:get_user(user_id=b933e65201ba421a81082eac6b88f3df)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:10.498057 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5fa88c-44e4-4ec8-ad62-a228952c8d2d None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:10.499707 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 119/241] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 05:16:10 2022] GET /identity/v3/users/b933e65201ba421a81082eac6b88f3df => generated 297 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:10.506475 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5fa88c-44e4-4ec8-ad62-a228952c8d2d None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:10.614012 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5fa88c-44e4-4ec8-ad62-a228952c8d2d None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:10.614910 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed17f8-34f6-48c3-8ba0-943fc8ec1f72 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:10.648250 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310b4164-9ba4-4e4d-babd-8a096f5af298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:10.648889 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b4164-9ba4-4e4d-babd-8a096f5af298 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:10.649486 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b4164-9ba4-4e4d-babd-8a096f5af298 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:10.649776 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b4164-9ba4-4e4d-babd-8a096f5af298 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:10.650941 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310b4164-9ba4-4e4d-babd-8a096f5af298 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:10.652732 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310b4164-9ba4-4e4d-babd-8a096f5af298 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:10.654786 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 123/242] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:16:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:16:10.657308 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f302c-5886-44a5-812a-c2caf1d96146 None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:10.657588 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f302c-5886-44a5-812a-c2caf1d96146 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:10.657854 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f302c-5886-44a5-812a-c2caf1d96146 None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:10.659076 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 124/243] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:16:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:16:10.664193 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7f302c-5886-44a5-812a-c2caf1d96146 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:10.665979 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef47cd2e-0336-4fa5-8c2b-36197633bb8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:10.666596 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47cd2e-0336-4fa5-8c2b-36197633bb8b None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:10.666872 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47cd2e-0336-4fa5-8c2b-36197633bb8b None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:10.667140 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47cd2e-0336-4fa5-8c2b-36197633bb8b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:10.704207 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:10.734411 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:10.747753 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef47cd2e-0336-4fa5-8c2b-36197633bb8b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:10.749634 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef47cd2e-0336-4fa5-8c2b-36197633bb8b None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:10.789451 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7f302c-5886-44a5-812a-c2caf1d96146 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:10.831696 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f7d824-e5d7-4eef-a110-fa13edf81b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:10.832552 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7d824-e5d7-4eef-a110-fa13edf81b5e None admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:10.832932 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7d824-e5d7-4eef-a110-fa13edf81b5e None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:10.833974 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7d824-e5d7-4eef-a110-fa13edf81b5e None admin] PATH_INFO: `/v3/users` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:10.835225 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f7d824-e5d7-4eef-a110-fa13edf81b5e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:10.837086 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f7d824-e5d7-4eef-a110-fa13edf81b5e None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:10.867875 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 125/244] 10.222.0.16 () {60 vars in 1132 bytes} [Sun Sep 11 05:16:10 2022] POST /identity/v3/users => generated 293 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:16:10.869226 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6795c9-579d-478b-90ab-6992d47c29aa None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:10.870034 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6795c9-579d-478b-90ab-6992d47c29aa None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:10.870490 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6795c9-579d-478b-90ab-6992d47c29aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:10.893571 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 120/245] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 05:16:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 11 05:16:10.901065 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef47cd2e-0336-4fa5-8c2b-36197633bb8b None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:10.915163 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-7b6795c9-579d-478b-90ab-6992d47c29aa None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:16:10.916432 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-7b6795c9-579d-478b-90ab-6992d47c29aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:16:11.014184 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 126/246] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:16:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 05:16:11.080566 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:11.090748 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef47cd2e-0336-4fa5-8c2b-36197633bb8b None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:11.126755 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dfc08d-99ef-4e76-8c42-ebf1afd9b4eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:11.127401 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dfc08d-99ef-4e76-8c42-ebf1afd9b4eb None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:11.127696 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dfc08d-99ef-4e76-8c42-ebf1afd9b4eb None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:11.127978 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dfc08d-99ef-4e76-8c42-ebf1afd9b4eb None admin] PATH_INFO: `/v3/projects/ca0a33c848834728909bb4815ac1e8bc` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:11.129112 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dfc08d-99ef-4e76-8c42-ebf1afd9b4eb None admin] RBAC: Authorizing `identity:get_project(project_id=ca0a33c848834728909bb4815ac1e8bc)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:11.131124 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dfc08d-99ef-4e76-8c42-ebf1afd9b4eb None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:11.132914 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 121/247] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 05:16:10 2022] GET /identity/v3/projects/ca0a33c848834728909bb4815ac1e8bc => generated 302 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:11.138911 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6795c9-579d-478b-90ab-6992d47c29aa None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:11.167715 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:11.265679 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6795c9-579d-478b-90ab-6992d47c29aa None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:11.302553 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e92b27a-d1cf-4dba-b5dd-0000888814e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:11.303549 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e92b27a-d1cf-4dba-b5dd-0000888814e2 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:11.304051 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e92b27a-d1cf-4dba-b5dd-0000888814e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:11.304542 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e92b27a-d1cf-4dba-b5dd-0000888814e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:11.305469 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e92b27a-d1cf-4dba-b5dd-0000888814e2 None admin] RBAC: Adding query filter params (role.id=6f65b7f0071d466aa6ecf94916300a38, scope.project.id=ca0a33c848834728909bb4815ac1e8bc, user.id=b933e65201ba421a81082eac6b88f3df) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:11.305995 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e92b27a-d1cf-4dba-b5dd-0000888814e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:11.307861 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d51842-7ec1-40bd-a2c3-850632ddcb49 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:11.308349 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d51842-7ec1-40bd-a2c3-850632ddcb49 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:11.308830 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d51842-7ec1-40bd-a2c3-850632ddcb49 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:11.309258 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e92b27a-d1cf-4dba-b5dd-0000888814e2 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:11.310847 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 122/248] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:16:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:16:11.315569 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 127/249] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 05:16:11 2022] GET /identity/v3/role_assignments?user.id=b933e65201ba421a81082eac6b88f3df&scope.project.id=ca0a33c848834728909bb4815ac1e8bc&role.id=6f65b7f0071d466aa6ecf94916300a38 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:11.316485 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d76cf-64dd-4e4f-ac11-2de80c939e17 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:11.316839 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d76cf-64dd-4e4f-ac11-2de80c939e17 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:11.317181 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d76cf-64dd-4e4f-ac11-2de80c939e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:11.329524 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d724350-625d-4091-bbd4-db1bb1798c72 None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:11.329808 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d724350-625d-4091-bbd4-db1bb1798c72 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:11.330086 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d724350-625d-4091-bbd4-db1bb1798c72 None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:11.332572 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 128/250] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:16:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 05:16:11.337676 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd828f-3043-407d-8bb7-65f941dac23c None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:11.337947 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd828f-3043-407d-8bb7-65f941dac23c None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:11.338222 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd828f-3043-407d-8bb7-65f941dac23c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:11.352951 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-3a1d76cf-64dd-4e4f-ac11-2de80c939e17 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:16:11.354188 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-3a1d76cf-64dd-4e4f-ac11-2de80c939e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:16:11.369414 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-f5bd828f-3043-407d-8bb7-65f941dac23c None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:16:11.370920 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-f5bd828f-3043-407d-8bb7-65f941dac23c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:16:11.449798 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 123/251] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:16:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 05:16:11.450592 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1d76cf-64dd-4e4f-ac11-2de80c939e17 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:11.461641 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 129/252] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:16:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 05:16:11.553798 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:11.570811 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1d76cf-64dd-4e4f-ac11-2de80c939e17 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:11.608585 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b01c70e-769f-4cf9-8a3c-32dd856f1316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:11.609233 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b01c70e-769f-4cf9-8a3c-32dd856f1316 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:11.609516 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b01c70e-769f-4cf9-8a3c-32dd856f1316 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:11.609793 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b01c70e-769f-4cf9-8a3c-32dd856f1316 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:11.622194 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b01c70e-769f-4cf9-8a3c-32dd856f1316 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:16:11.627078 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-6b01c70e-769f-4cf9-8a3c-32dd856f1316 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 05:16:11.627078 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:16:11.627078 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:16:11.627078 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:16:11.627078 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:16:11.627078 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:16:11.627078 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:16:11.627078 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:16:11.627078 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:16:11.627078 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:16:11.627078 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:16:11.627078 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:16:11.627078 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:16:11.627078 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:16:11.627078 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:16:11.627078 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:16:11.627988 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:16:11.627988 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:16:11.627988 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:16:11.627988 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:16:11.627988 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:16:11.627988 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:16:11.627988 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:16:11.627988 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:16:11.627988 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:16:11.627988 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:16:11.627988 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:16:11.627988 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:16:11.627988 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:16:11.627988 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:16:11.627988 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:16:11.627988 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:16:11.628781 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:16:11.628781 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:16:11.628781 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:16:11.628781 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:16:11.628781 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:16:11.628781 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:16:11.628781 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:16:11.628781 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:16:11.628781 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:16:11.628781 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:16:11.628781 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 05:16:11.628781 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:16:11.628781 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 124/253] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 05:16:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:16:11.635939 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bd828f-3043-407d-8bb7-65f941dac23c None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:11.655030 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:11.741827 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b01c70e-769f-4cf9-8a3c-32dd856f1316 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:11.753567 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bd828f-3043-407d-8bb7-65f941dac23c None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:11.799562 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d88287d-e14a-41ed-b019-d1c97a93f343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:11.800219 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d88287d-e14a-41ed-b019-d1c97a93f343 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:11.800498 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d88287d-e14a-41ed-b019-d1c97a93f343 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:11.800770 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d88287d-e14a-41ed-b019-d1c97a93f343 None admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:11.801445 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d88287d-e14a-41ed-b019-d1c97a93f343 None admin] RBAC: Adding query filter params (name=member) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:11.801746 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d88287d-e14a-41ed-b019-d1c97a93f343 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:11.806085 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d88287d-e14a-41ed-b019-d1c97a93f343 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:11.818843 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 130/254] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 11 05:16:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:11.824757 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d88287d-e14a-41ed-b019-d1c97a93f343 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:11.947216 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b01c70e-769f-4cf9-8a3c-32dd856f1316 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:11.964484 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:11.990518 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a225d67-c897-43ba-a1f0-4d10eaf36f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:11.991510 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a225d67-c897-43ba-a1f0-4d10eaf36f3d None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:11.992033 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a225d67-c897-43ba-a1f0-4d10eaf36f3d None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:11.992985 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a225d67-c897-43ba-a1f0-4d10eaf36f3d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:12.005767 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a225d67-c897-43ba-a1f0-4d10eaf36f3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:16:12.010498 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d88287d-e14a-41ed-b019-d1c97a93f343 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:12.011475 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-0a225d67-c897-43ba-a1f0-4d10eaf36f3d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 05:16:12.011475 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:16:12.011475 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:16:12.011475 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:16:12.011475 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:16:12.011475 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:16:12.011475 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:16:12.011475 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:16:12.011475 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:16:12.011475 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:16:12.011475 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:16:12.011475 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:16:12.011475 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:16:12.011475 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:16:12.011475 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:16:12.011475 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:16:12.012383 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:16:12.012383 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:16:12.012383 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:16:12.012383 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:16:12.012383 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:16:12.012383 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:16:12.012383 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:16:12.012383 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:16:12.012383 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:16:12.012383 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:16:12.012383 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:16:12.012383 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:16:12.012383 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:16:12.012383 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:16:12.012383 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:16:12.012383 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:16:12.013188 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:16:12.013188 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:16:12.013188 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:16:12.013188 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:16:12.013188 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:16:12.013188 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:16:12.013188 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:16:12.013188 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:16:12.013188 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:16:12.013188 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:16:12.013188 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 05:16:12.013188 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:16:12.015715 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 125/255] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 11 05:16:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:16:12.017723 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a225d67-c897-43ba-a1f0-4d10eaf36f3d None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:12.040083 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:12.066748 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613e83b0-b6b0-4895-bd76-ad7d3d042149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:12.068265 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e83b0-b6b0-4895-bd76-ad7d3d042149 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:12.068747 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e83b0-b6b0-4895-bd76-ad7d3d042149 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:12.069216 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e83b0-b6b0-4895-bd76-ad7d3d042149 None admin] PATH_INFO: `/v3/users/eabe71d49b03411aa65a66a3c3dfa7a2` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:12.070586 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613e83b0-b6b0-4895-bd76-ad7d3d042149 None admin] RBAC: Authorizing `identity:get_user(user_id=eabe71d49b03411aa65a66a3c3dfa7a2)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:12.072289 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613e83b0-b6b0-4895-bd76-ad7d3d042149 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:12.074374 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 131/256] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 05:16:11 2022] GET /identity/v3/users/eabe71d49b03411aa65a66a3c3dfa7a2 => generated 297 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:16:12.075337 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613e83b0-b6b0-4895-bd76-ad7d3d042149 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:12.150418 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a225d67-c897-43ba-a1f0-4d10eaf36f3d None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:12.186804 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951b7bfa-d686-4d3f-a454-bf2090e84b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:12.187450 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951b7bfa-d686-4d3f-a454-bf2090e84b0d None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:12.187758 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951b7bfa-d686-4d3f-a454-bf2090e84b0d None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:12.188035 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951b7bfa-d686-4d3f-a454-bf2090e84b0d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:12.198709 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951b7bfa-d686-4d3f-a454-bf2090e84b0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:16:12.203662 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-951b7bfa-d686-4d3f-a454-bf2090e84b0d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 05:16:12.203662 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:16:12.203662 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:16:12.203662 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:16:12.203662 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:16:12.203662 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:16:12.203662 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:16:12.203662 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:16:12.203662 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:16:12.203662 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:16:12.203662 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:16:12.203662 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:16:12.203662 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:16:12.203662 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:16:12.203662 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:16:12.203662 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:16:12.204552 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:16:12.204552 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:16:12.204552 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:16:12.204552 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:16:12.204552 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:16:12.204552 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:16:12.204552 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:16:12.204552 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:16:12.204552 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:16:12.204552 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:16:12.204552 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:16:12.204552 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:16:12.204552 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:16:12.204552 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:16:12.204552 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:16:12.204552 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:16:12.205341 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:16:12.205341 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:16:12.205341 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:16:12.205341 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:16:12.205341 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:16:12.205341 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:16:12.205341 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:16:12.205341 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:16:12.205341 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:16:12.205341 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:16:12.205341 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 05:16:12.205341 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:16:12.205341 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 126/257] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 05:16:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:16:12.205990 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951b7bfa-d686-4d3f-a454-bf2090e84b0d None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:12.280056 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:12.313256 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951b7bfa-d686-4d3f-a454-bf2090e84b0d None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:12.350714 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1314ed-7403-473c-bf53-a28c38b22b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:12.351276 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1314ed-7403-473c-bf53-a28c38b22b05 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:12.351558 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1314ed-7403-473c-bf53-a28c38b22b05 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:12.351865 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1314ed-7403-473c-bf53-a28c38b22b05 None admin] PATH_INFO: `/v3/projects/ca0a33c848834728909bb4815ac1e8bc` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:12.353384 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1314ed-7403-473c-bf53-a28c38b22b05 None admin] RBAC: Authorizing `identity:get_project(project_id=ca0a33c848834728909bb4815ac1e8bc)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:12.355124 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1314ed-7403-473c-bf53-a28c38b22b05 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:12.357325 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 127/258] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 05:16:12 2022] GET /identity/v3/projects/ca0a33c848834728909bb4815ac1e8bc => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:12.363092 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1314ed-7403-473c-bf53-a28c38b22b05 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:12.430002 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613e83b0-b6b0-4895-bd76-ad7d3d042149 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:12.484230 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1314ed-7403-473c-bf53-a28c38b22b05 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:12.521900 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb94e07f-e8e1-495c-8fd2-a08a2594ac0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:12.522654 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb94e07f-e8e1-495c-8fd2-a08a2594ac0f None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:12.522942 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb94e07f-e8e1-495c-8fd2-a08a2594ac0f None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:12.523220 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb94e07f-e8e1-495c-8fd2-a08a2594ac0f None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:12.523957 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb94e07f-e8e1-495c-8fd2-a08a2594ac0f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:12.524267 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb94e07f-e8e1-495c-8fd2-a08a2594ac0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:12.525914 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb94e07f-e8e1-495c-8fd2-a08a2594ac0f None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:12.532055 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:12.537755 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 128/259] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 05:16:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:12.538929 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb94e07f-e8e1-495c-8fd2-a08a2594ac0f None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:12.568934 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbf02d2-dab3-4bb3-a4a3-2860256550ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:12.569814 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf02d2-dab3-4bb3-a4a3-2860256550ae None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:12.570433 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf02d2-dab3-4bb3-a4a3-2860256550ae None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:12.570843 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf02d2-dab3-4bb3-a4a3-2860256550ae None admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:12.571654 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbf02d2-dab3-4bb3-a4a3-2860256550ae None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:12.572154 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbf02d2-dab3-4bb3-a4a3-2860256550ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:12.573659 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbf02d2-dab3-4bb3-a4a3-2860256550ae None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:12.601717 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 132/260] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 05:16:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 527 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:12.602786 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbf02d2-dab3-4bb3-a4a3-2860256550ae None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:12.625031 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:12.674597 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb94e07f-e8e1-495c-8fd2-a08a2594ac0f None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:12.713684 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71deb77-0214-4dd7-bf6a-c5876cdd1d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:12.714680 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71deb77-0214-4dd7-bf6a-c5876cdd1d43 None admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:12.715267 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71deb77-0214-4dd7-bf6a-c5876cdd1d43 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:12.715784 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71deb77-0214-4dd7-bf6a-c5876cdd1d43 None admin] PATH_INFO: `/v3/projects/ca0a33c848834728909bb4815ac1e8bc/users/eabe71d49b03411aa65a66a3c3dfa7a2/roles/aa7ff8e0ec1e48e5811335b9eb38b448` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:12.717928 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71deb77-0214-4dd7-bf6a-c5876cdd1d43 None admin] RBAC: Authorizing `identity:create_grant(project_id=ca0a33c848834728909bb4815ac1e8bc, user_id=eabe71d49b03411aa65a66a3c3dfa7a2, role_id=aa7ff8e0ec1e48e5811335b9eb38b448)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:12.719644 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71deb77-0214-4dd7-bf6a-c5876cdd1d43 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:12.737820 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 129/261] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 11 05:16:12 2022] PUT /identity/v3/projects/ca0a33c848834728909bb4815ac1e8bc/users/eabe71d49b03411aa65a66a3c3dfa7a2/roles/aa7ff8e0ec1e48e5811335b9eb38b448 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:16:12.746338 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71deb77-0214-4dd7-bf6a-c5876cdd1d43 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:12.890601 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbf02d2-dab3-4bb3-a4a3-2860256550ae None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:12.912425 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:12.985832 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76104b0-14a8-4a75-a9d7-4e8ec11900eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:12.986465 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76104b0-14a8-4a75-a9d7-4e8ec11900eb None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:12.986783 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76104b0-14a8-4a75-a9d7-4e8ec11900eb None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:12.987128 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76104b0-14a8-4a75-a9d7-4e8ec11900eb None admin] PATH_INFO: `/v3/users/aecacb74a633441ba43d62b17df57b0b` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:12.988749 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76104b0-14a8-4a75-a9d7-4e8ec11900eb None admin] RBAC: Authorizing `identity:get_user(user_id=aecacb74a633441ba43d62b17df57b0b)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:12.991021 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76104b0-14a8-4a75-a9d7-4e8ec11900eb None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:12.997365 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 133/262] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 05:16:12 2022] GET /identity/v3/users/aecacb74a633441ba43d62b17df57b0b => generated 283 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:13.002755 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76104b0-14a8-4a75-a9d7-4e8ec11900eb None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:13.031497 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71deb77-0214-4dd7-bf6a-c5876cdd1d43 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:13.102877 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e76913-4e0d-493f-a072-dc714b371db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:13.103523 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e76913-4e0d-493f-a072-dc714b371db1 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:13.103833 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e76913-4e0d-493f-a072-dc714b371db1 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:13.104107 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e76913-4e0d-493f-a072-dc714b371db1 None admin] PATH_INFO: `/v3/users/aecacb74a633441ba43d62b17df57b0b` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:13.105257 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e76913-4e0d-493f-a072-dc714b371db1 None admin] RBAC: Authorizing `identity:get_user(user_id=aecacb74a633441ba43d62b17df57b0b)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:13.106841 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e76913-4e0d-493f-a072-dc714b371db1 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:13.108625 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 130/263] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 05:16:12 2022] GET /identity/v3/users/aecacb74a633441ba43d62b17df57b0b => generated 283 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:13.116800 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e76913-4e0d-493f-a072-dc714b371db1 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:13.144389 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:13.177022 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76104b0-14a8-4a75-a9d7-4e8ec11900eb None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:13.235198 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722eb0ee-e163-4f4f-b6ef-86c295e73b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:13.236220 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722eb0ee-e163-4f4f-b6ef-86c295e73b9c None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:13.236723 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722eb0ee-e163-4f4f-b6ef-86c295e73b9c None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:13.237005 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722eb0ee-e163-4f4f-b6ef-86c295e73b9c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:13.311082 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e76913-4e0d-493f-a072-dc714b371db1 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:13.362486 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:13.384692 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722eb0ee-e163-4f4f-b6ef-86c295e73b9c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:13.386397 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722eb0ee-e163-4f4f-b6ef-86c295e73b9c None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:13.393208 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0ba3d1-51c9-4b91-81ae-8aa25f3a0e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:13.393550 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0ba3d1-51c9-4b91-81ae-8aa25f3a0e99 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:13.393828 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0ba3d1-51c9-4b91-81ae-8aa25f3a0e99 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:13.394103 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0ba3d1-51c9-4b91-81ae-8aa25f3a0e99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:13.551670 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0ba3d1-51c9-4b91-81ae-8aa25f3a0e99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:13.553260 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0ba3d1-51c9-4b91-81ae-8aa25f3a0e99 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:13.598400 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:13.674909 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 134/264] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 05:16:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 672 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 05:16:13.681062 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722eb0ee-e163-4f4f-b6ef-86c295e73b9c None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:13.684216 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 131/265] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 05:16:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 05:16:13.692676 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0ba3d1-51c9-4b91-81ae-8aa25f3a0e99 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:13.741484 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:13.841825 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0ba3d1-51c9-4b91-81ae-8aa25f3a0e99 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:13.898718 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828ea396-5624-4afd-8f46-6ceb088b6458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:13.899741 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ea396-5624-4afd-8f46-6ceb088b6458 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:13.900217 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ea396-5624-4afd-8f46-6ceb088b6458 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:13.900710 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ea396-5624-4afd-8f46-6ceb088b6458 None admin] PATH_INFO: `/v3/projects/ca0a33c848834728909bb4815ac1e8bc` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:13.904367 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828ea396-5624-4afd-8f46-6ceb088b6458 None admin] RBAC: Authorizing `identity:get_project(project_id=ca0a33c848834728909bb4815ac1e8bc)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:13.907282 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828ea396-5624-4afd-8f46-6ceb088b6458 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:13.910452 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 132/266] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 05:16:13 2022] GET /identity/v3/projects/ca0a33c848834728909bb4815ac1e8bc => generated 302 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:13.916794 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828ea396-5624-4afd-8f46-6ceb088b6458 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:13.999597 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722eb0ee-e163-4f4f-b6ef-86c295e73b9c None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:14.076100 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:14.091278 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828ea396-5624-4afd-8f46-6ceb088b6458 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:14.113645 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643fff22-657f-4831-9d76-752b14cfcf18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:14.114889 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643fff22-657f-4831-9d76-752b14cfcf18 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:14.115321 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643fff22-657f-4831-9d76-752b14cfcf18 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:14.115789 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643fff22-657f-4831-9d76-752b14cfcf18 None admin] PATH_INFO: `/v3/projects/ca0a33c848834728909bb4815ac1e8bc` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:14.117251 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643fff22-657f-4831-9d76-752b14cfcf18 None admin] RBAC: Authorizing `identity:get_project(project_id=ca0a33c848834728909bb4815ac1e8bc)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:14.118929 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643fff22-657f-4831-9d76-752b14cfcf18 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:14.128291 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 135/267] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 05:16:13 2022] GET /identity/v3/projects/ca0a33c848834728909bb4815ac1e8bc => generated 302 bytes in 447 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:16:14.135213 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643fff22-657f-4831-9d76-752b14cfcf18 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:14.166988 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a2f215-800b-435d-9075-0be8b79bbe4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:14.167622 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a2f215-800b-435d-9075-0be8b79bbe4c None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:14.167927 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a2f215-800b-435d-9075-0be8b79bbe4c None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:14.168203 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a2f215-800b-435d-9075-0be8b79bbe4c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:14.169695 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a2f215-800b-435d-9075-0be8b79bbe4c None admin] RBAC: Adding query filter params (role.id=ada04449ee1f42599a060f4795ec1a74, scope.project.id=ca0a33c848834728909bb4815ac1e8bc, user.id=aecacb74a633441ba43d62b17df57b0b) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:14.170039 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a2f215-800b-435d-9075-0be8b79bbe4c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:14.171858 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a2f215-800b-435d-9075-0be8b79bbe4c None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:14.185430 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 133/268] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 05:16:13 2022] GET /identity/v3/role_assignments?user.id=aecacb74a633441ba43d62b17df57b0b&scope.project.id=ca0a33c848834728909bb4815ac1e8bc&role.id=ada04449ee1f42599a060f4795ec1a74 => generated 608 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:16:14.236002 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:14.288136 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef43fa-c5fd-40aa-b3ca-ee6f33ce2b30 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:14.288655 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef43fa-c5fd-40aa-b3ca-ee6f33ce2b30 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:14.289105 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef43fa-c5fd-40aa-b3ca-ee6f33ce2b30 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:14.290835 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 134/269] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:16:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 05:16:14.296692 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362511b-b14a-4561-9117-ad7e629ba51c None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:14.297113 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362511b-b14a-4561-9117-ad7e629ba51c None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:14.297604 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362511b-b14a-4561-9117-ad7e629ba51c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:14.324930 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643fff22-657f-4831-9d76-752b14cfcf18 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:14.332798 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-5362511b-b14a-4561-9117-ad7e629ba51c None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:16:14.334520 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-5362511b-b14a-4561-9117-ad7e629ba51c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:16:14.398393 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ed431-0187-4c1d-b90f-35235aef40f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:14.399041 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ed431-0187-4c1d-b90f-35235aef40f2 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:14.399322 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ed431-0187-4c1d-b90f-35235aef40f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:14.399599 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ed431-0187-4c1d-b90f-35235aef40f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:14.400411 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5ed431-0187-4c1d-b90f-35235aef40f2 None admin] RBAC: Adding query filter params (role.id=5b702713e40145b49e0b42abd0a5fba9, scope.project.id=ca0a33c848834728909bb4815ac1e8bc, user.id=aecacb74a633441ba43d62b17df57b0b) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:14.400723 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5ed431-0187-4c1d-b90f-35235aef40f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:14.402269 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5ed431-0187-4c1d-b90f-35235aef40f2 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:14.420540 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 136/270] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 05:16:14 2022] GET /identity/v3/role_assignments?user.id=aecacb74a633441ba43d62b17df57b0b&scope.project.id=ca0a33c848834728909bb4815ac1e8bc&role.id=5b702713e40145b49e0b42abd0a5fba9 => generated 608 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:16:14.421872 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ffee3b-72e4-4a49-a1a9-877c20d3f5e0 None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:14.422157 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ffee3b-72e4-4a49-a1a9-877c20d3f5e0 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:14.422426 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ffee3b-72e4-4a49-a1a9-877c20d3f5e0 None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:14.423739 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 137/271] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:16:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:16:14.432876 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0134c31-6d41-4341-9d59-043c8cfda64b None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:14.433175 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0134c31-6d41-4341-9d59-043c8cfda64b None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:14.433420 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0134c31-6d41-4341-9d59-043c8cfda64b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:14.466327 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 135/272] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:16:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 05:16:14.467317 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-a0134c31-6d41-4341-9d59-043c8cfda64b None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:16:14.472973 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-a0134c31-6d41-4341-9d59-043c8cfda64b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:16:14.576187 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 138/273] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:16:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 05:16:14.680847 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d5ccb3-1666-4d0d-b676-ba6ba87c01b9 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:14.681133 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d5ccb3-1666-4d0d-b676-ba6ba87c01b9 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:14.681331 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d5ccb3-1666-4d0d-b676-ba6ba87c01b9 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:14.682701 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 136/274] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:16:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:16:14.689698 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ee9b2-c4ee-4307-92fc-66fe5a9c599f None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:14.690154 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ee9b2-c4ee-4307-92fc-66fe5a9c599f None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:14.690567 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ee9b2-c4ee-4307-92fc-66fe5a9c599f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:14.716399 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-b42ee9b2-c4ee-4307-92fc-66fe5a9c599f None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:16:14.717885 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-b42ee9b2-c4ee-4307-92fc-66fe5a9c599f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:16:14.757502 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:14.782547 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d5ccb3-1666-4d0d-b676-ba6ba87c01b9 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:14.802068 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 139/275] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:16:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 05:16:14.886813 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:14.901264 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d5ccb3-1666-4d0d-b676-ba6ba87c01b9 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:14.936875 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671631a4-029f-4a52-822c-f9a19f61c7af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:14.937997 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671631a4-029f-4a52-822c-f9a19f61c7af None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:14.938478 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671631a4-029f-4a52-822c-f9a19f61c7af None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:14.938700 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ee9b2-c4ee-4307-92fc-66fe5a9c599f None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:14.938995 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671631a4-029f-4a52-822c-f9a19f61c7af None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:14.951509 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671631a4-029f-4a52-822c-f9a19f61c7af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:16:14.956939 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-671631a4-029f-4a52-822c-f9a19f61c7af None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 05:16:14.956939 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:16:14.956939 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:16:14.956939 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:16:14.956939 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:16:14.956939 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:16:14.956939 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:16:14.956939 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:16:14.956939 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:16:14.956939 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:16:14.956939 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:16:14.956939 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:16:14.956939 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:16:14.956939 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:16:14.956939 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:16:14.956939 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:16:14.957835 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:16:14.957835 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:16:14.957835 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:16:14.957835 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:16:14.957835 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:16:14.957835 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:16:14.957835 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:16:14.957835 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:16:14.957835 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:16:14.957835 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:16:14.957835 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:16:14.957835 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:16:14.957835 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:16:14.957835 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:16:14.957835 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:16:14.957835 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:16:14.958801 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:16:14.958801 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:16:14.958801 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:16:14.958801 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:16:14.958801 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:16:14.958801 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:16:14.958801 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:16:14.958801 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:16:14.958801 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:16:14.958801 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:16:14.958801 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 05:16:14.958801 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:16:14.962146 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 137/276] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 05:16:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:16:14.964704 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671631a4-029f-4a52-822c-f9a19f61c7af None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:15.058931 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ee9b2-c4ee-4307-92fc-66fe5a9c599f None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:15.072434 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671631a4-029f-4a52-822c-f9a19f61c7af None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:15.099886 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111cedc8-1bed-4688-866d-699d111f0b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:15.100538 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111cedc8-1bed-4688-866d-699d111f0b56 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:15.100812 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111cedc8-1bed-4688-866d-699d111f0b56 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:15.101326 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111cedc8-1bed-4688-866d-699d111f0b56 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:15.108979 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65670271-fd61-4c14-83f7-d805fe0c5a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:15.109589 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65670271-fd61-4c14-83f7-d805fe0c5a9d None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:15.109871 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65670271-fd61-4c14-83f7-d805fe0c5a9d None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:15.110149 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65670271-fd61-4c14-83f7-d805fe0c5a9d None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:15.110826 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65670271-fd61-4c14-83f7-d805fe0c5a9d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:15.111134 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65670271-fd61-4c14-83f7-d805fe0c5a9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:15.112557 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65670271-fd61-4c14-83f7-d805fe0c5a9d None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:15.113401 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111cedc8-1bed-4688-866d-699d111f0b56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:16:15.119065 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-111cedc8-1bed-4688-866d-699d111f0b56 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 05:16:15.119065 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:16:15.119065 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:16:15.119065 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:16:15.119065 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:16:15.119065 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:16:15.119065 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:16:15.119065 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:16:15.119065 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:16:15.119065 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:16:15.119065 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:16:15.119065 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:16:15.119065 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:16:15.119065 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:16:15.119065 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:16:15.119065 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:16:15.120217 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:16:15.120217 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:16:15.120217 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:16:15.120217 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:16:15.120217 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:16:15.120217 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:16:15.120217 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:16:15.120217 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:16:15.120217 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:16:15.120217 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:16:15.120217 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:16:15.120217 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:16:15.120217 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:16:15.120217 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:16:15.120217 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:16:15.120217 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:16:15.121020 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:16:15.121020 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:16:15.121020 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:16:15.121020 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:16:15.121020 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:16:15.121020 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:16:15.121020 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:16:15.121020 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:16:15.121020 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:16:15.121020 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:16:15.121020 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 05:16:15.121020 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:16:15.121020 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 140/277] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 05:16:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 05:16:15.121020 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111cedc8-1bed-4688-866d-699d111f0b56 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:15.131885 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 138/278] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 11 05:16:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:15.131885 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65670271-fd61-4c14-83f7-d805fe0c5a9d None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:15.140910 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:15.156588 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:15.237354 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65670271-fd61-4c14-83f7-d805fe0c5a9d None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:15.241388 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111cedc8-1bed-4688-866d-699d111f0b56 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:15.273208 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f83e66-4c56-4942-8bd4-4671e6caba93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:15.273839 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f83e66-4c56-4942-8bd4-4671e6caba93 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:15.274099 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f83e66-4c56-4942-8bd4-4671e6caba93 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:15.274431 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f83e66-4c56-4942-8bd4-4671e6caba93 None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:15.275320 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f83e66-4c56-4942-8bd4-4671e6caba93 None admin] RBAC: Adding query filter params (name=member) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:15.275761 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f83e66-4c56-4942-8bd4-4671e6caba93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:15.277266 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f83e66-4c56-4942-8bd4-4671e6caba93 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:15.277514 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59c5c3f-53d0-4b3d-9392-55cf17e4db71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:15.278139 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c5c3f-53d0-4b3d-9392-55cf17e4db71 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:15.278509 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c5c3f-53d0-4b3d-9392-55cf17e4db71 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:15.278677 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c5c3f-53d0-4b3d-9392-55cf17e4db71 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:15.279804 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59c5c3f-53d0-4b3d-9392-55cf17e4db71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:15.281242 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59c5c3f-53d0-4b3d-9392-55cf17e4db71 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:15.282801 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 141/279] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:16:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:15.283546 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59c5c3f-53d0-4b3d-9392-55cf17e4db71 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:15.294443 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 139/280] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 11 05:16:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:15.294443 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f83e66-4c56-4942-8bd4-4671e6caba93 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:15.364211 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:15.394980 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f83e66-4c56-4942-8bd4-4671e6caba93 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:15.395713 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:15.404775 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59c5c3f-53d0-4b3d-9392-55cf17e4db71 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:15.433881 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36783d7b-5fbf-4af5-8ebc-1d9b63429aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:15.434516 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36783d7b-5fbf-4af5-8ebc-1d9b63429aad None admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:15.434790 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36783d7b-5fbf-4af5-8ebc-1d9b63429aad None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:15.435063 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36783d7b-5fbf-4af5-8ebc-1d9b63429aad None admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:15.435745 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36783d7b-5fbf-4af5-8ebc-1d9b63429aad None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:15.437266 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36783d7b-5fbf-4af5-8ebc-1d9b63429aad None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:15.445855 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430e3b35-d233-4829-ba45-c447058a390f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:15.446701 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e3b35-d233-4829-ba45-c447058a390f None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:15.447242 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e3b35-d233-4829-ba45-c447058a390f None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:15.447767 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e3b35-d233-4829-ba45-c447058a390f None admin] PATH_INFO: `/v3/users/b933e65201ba421a81082eac6b88f3df` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:15.449359 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430e3b35-d233-4829-ba45-c447058a390f None admin] RBAC: Authorizing `identity:get_user(user_id=b933e65201ba421a81082eac6b88f3df)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:15.451289 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430e3b35-d233-4829-ba45-c447058a390f None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:15.453328 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 142/281] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 05:16:15 2022] GET /identity/v3/users/b933e65201ba421a81082eac6b88f3df => generated 297 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:15.454095 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430e3b35-d233-4829-ba45-c447058a390f None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:15.461507 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 140/282] 10.222.0.16 () {60 vars in 1132 bytes} [Sun Sep 11 05:16:15 2022] POST /identity/v3/users => generated 293 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:16:15.462543 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36783d7b-5fbf-4af5-8ebc-1d9b63429aad None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:15.593245 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430e3b35-d233-4829-ba45-c447058a390f None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:15.596194 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36783d7b-5fbf-4af5-8ebc-1d9b63429aad None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:15.626916 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:15.633969 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97753f5-c862-4f0f-b466-548ef4eded9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:15.634626 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97753f5-c862-4f0f-b466-548ef4eded9a None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:15.634934 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97753f5-c862-4f0f-b466-548ef4eded9a None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:15.635754 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97753f5-c862-4f0f-b466-548ef4eded9a None admin] PATH_INFO: `/v3/users/57e659dee3ac459caf785cca1fba87a2` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:15.637922 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3ea2c5-10ee-49c2-a5e0-51e2e54bd8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:15.638842 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ea2c5-10ee-49c2-a5e0-51e2e54bd8e5 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:15.638842 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ea2c5-10ee-49c2-a5e0-51e2e54bd8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:15.639111 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ea2c5-10ee-49c2-a5e0-51e2e54bd8e5 None admin] PATH_INFO: `/v3/projects/ca0a33c848834728909bb4815ac1e8bc` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:15.640337 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3ea2c5-10ee-49c2-a5e0-51e2e54bd8e5 None admin] RBAC: Authorizing `identity:get_project(project_id=ca0a33c848834728909bb4815ac1e8bc)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:15.642316 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3ea2c5-10ee-49c2-a5e0-51e2e54bd8e5 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:15.644505 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 141/283] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 05:16:15 2022] GET /identity/v3/projects/ca0a33c848834728909bb4815ac1e8bc => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:15.644683 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52927c1-b4a6-4708-a8b5-56bc71531491 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:15.644965 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52927c1-b4a6-4708-a8b5-56bc71531491 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:15.645242 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52927c1-b4a6-4708-a8b5-56bc71531491 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:15.646540 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 142/284] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:16:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:16:15.651662 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52927c1-b4a6-4708-a8b5-56bc71531491 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:15.653359 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97753f5-c862-4f0f-b466-548ef4eded9a None admin] RBAC: Authorizing `identity:get_user(user_id=57e659dee3ac459caf785cca1fba87a2)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:15.654834 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97753f5-c862-4f0f-b466-548ef4eded9a None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:15.656564 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 143/285] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 05:16:15 2022] GET /identity/v3/users/57e659dee3ac459caf785cca1fba87a2 => generated 293 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:15.662984 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d6b3c7-1825-4db6-a4e6-b73bc5701308 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:15.663271 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d6b3c7-1825-4db6-a4e6-b73bc5701308 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:15.663553 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d6b3c7-1825-4db6-a4e6-b73bc5701308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:15.684351 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-e8d6b3c7-1825-4db6-a4e6-b73bc5701308 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:16:15.685545 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-e8d6b3c7-1825-4db6-a4e6-b73bc5701308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:16:15.701021 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:15.772585 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 144/286] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:16:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 05:16:15.773298 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d6b3c7-1825-4db6-a4e6-b73bc5701308 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:15.781325 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52927c1-b4a6-4708-a8b5-56bc71531491 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:15.824666 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddfefc9-6118-4517-b6fe-c380ded13ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:15.825695 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddfefc9-6118-4517-b6fe-c380ded13ea7 None admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:15.825972 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddfefc9-6118-4517-b6fe-c380ded13ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:15.827620 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddfefc9-6118-4517-b6fe-c380ded13ea7 None admin] PATH_INFO: `/v3/projects/ca0a33c848834728909bb4815ac1e8bc/users/b933e65201ba421a81082eac6b88f3df/roles/6f65b7f0071d466aa6ecf94916300a38` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:15.829354 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddfefc9-6118-4517-b6fe-c380ded13ea7 None admin] RBAC: Authorizing `identity:create_grant(project_id=ca0a33c848834728909bb4815ac1e8bc, user_id=b933e65201ba421a81082eac6b88f3df, role_id=6f65b7f0071d466aa6ecf94916300a38)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:15.831171 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddfefc9-6118-4517-b6fe-c380ded13ea7 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:15.850763 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 143/287] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 11 05:16:15 2022] PUT /identity/v3/projects/ca0a33c848834728909bb4815ac1e8bc/users/b933e65201ba421a81082eac6b88f3df/roles/6f65b7f0071d466aa6ecf94916300a38 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:16:15.907637 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d6b3c7-1825-4db6-a4e6-b73bc5701308 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:15.949868 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf262f7b-e1da-403e-b41d-3c56d02f6935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:15.950502 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf262f7b-e1da-403e-b41d-3c56d02f6935 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:15.950791 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf262f7b-e1da-403e-b41d-3c56d02f6935 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:15.951066 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf262f7b-e1da-403e-b41d-3c56d02f6935 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:15.951910 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf262f7b-e1da-403e-b41d-3c56d02f6935 None admin] RBAC: Adding query filter params (role.id=aa7ff8e0ec1e48e5811335b9eb38b448, user.id=57e659dee3ac459caf785cca1fba87a2, scope.system=all) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:15.952287 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf262f7b-e1da-403e-b41d-3c56d02f6935 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:15.953845 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf262f7b-e1da-403e-b41d-3c56d02f6935 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:15.961530 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 145/288] 10.222.0.16 () {56 vars in 1308 bytes} [Sun Sep 11 05:16:15 2022] GET /identity/v3/role_assignments?user.id=57e659dee3ac459caf785cca1fba87a2&scope.system=all&role.id=aa7ff8e0ec1e48e5811335b9eb38b448 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:16.139026 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddfefc9-6118-4517-b6fe-c380ded13ea7 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:16.210608 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:16.268487 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddfefc9-6118-4517-b6fe-c380ded13ea7 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:16.316631 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc77c31-50b7-49b2-a391-81de686849be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:16.317273 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc77c31-50b7-49b2-a391-81de686849be None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:16.317555 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc77c31-50b7-49b2-a391-81de686849be None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:16.318359 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc77c31-50b7-49b2-a391-81de686849be None admin] PATH_INFO: `/v3/roles/member` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:16.336610 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc77c31-50b7-49b2-a391-81de686849be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:16:16.342036 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-7fc77c31-50b7-49b2-a391-81de686849be None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 05:16:16.342036 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:16:16.342036 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:16:16.342036 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:16:16.342036 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:16:16.342036 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:16:16.342036 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:16:16.342036 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:16:16.342036 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:16:16.342036 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:16:16.342036 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:16:16.342036 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:16:16.342036 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:16:16.342036 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:16:16.342036 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:16:16.342036 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:16:16.342918 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:16:16.342918 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:16:16.342918 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:16:16.342918 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:16:16.342918 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:16:16.342918 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:16:16.342918 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:16:16.342918 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:16:16.342918 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:16:16.342918 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:16:16.342918 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:16:16.342918 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:16:16.342918 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:16:16.342918 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:16:16.342918 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:16:16.342918 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:16:16.344245 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:16:16.344245 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:16:16.344245 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:16:16.344245 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:16:16.344245 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:16:16.344245 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:16:16.344245 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:16:16.344245 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:16:16.344245 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:16:16.344245 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:16:16.344245 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 05:16:16.344245 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:16:16.344245 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 144/289] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 05:16:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:16:16.351641 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf262f7b-e1da-403e-b41d-3c56d02f6935 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:16.372593 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:16.483832 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf262f7b-e1da-403e-b41d-3c56d02f6935 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:16.519856 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73739eca-a406-47cd-88ff-67b90bf64cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:16.520473 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73739eca-a406-47cd-88ff-67b90bf64cb3 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:16.520747 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73739eca-a406-47cd-88ff-67b90bf64cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:16.521091 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73739eca-a406-47cd-88ff-67b90bf64cb3 None admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:16.521762 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73739eca-a406-47cd-88ff-67b90bf64cb3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:16.522063 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73739eca-a406-47cd-88ff-67b90bf64cb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:16.523442 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73739eca-a406-47cd-88ff-67b90bf64cb3 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:16.532272 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 146/290] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 11 05:16:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:16.538671 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc77c31-50b7-49b2-a391-81de686849be None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:16.707770 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc77c31-50b7-49b2-a391-81de686849be None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:16.733741 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:16.765110 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b42b42-b928-4f68-87be-b2131b6fe60f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:16.765663 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b42b42-b928-4f68-87be-b2131b6fe60f None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:16.765945 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b42b42-b928-4f68-87be-b2131b6fe60f None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:16.766223 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b42b42-b928-4f68-87be-b2131b6fe60f None admin] PATH_INFO: `/v3/users/eabe71d49b03411aa65a66a3c3dfa7a2` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:16.772377 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b42b42-b928-4f68-87be-b2131b6fe60f None admin] RBAC: Authorizing `identity:get_user(user_id=eabe71d49b03411aa65a66a3c3dfa7a2)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:16.773878 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b42b42-b928-4f68-87be-b2131b6fe60f None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:16.775820 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 145/291] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 05:16:16 2022] GET /identity/v3/users/eabe71d49b03411aa65a66a3c3dfa7a2 => generated 297 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:16.781398 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73739eca-a406-47cd-88ff-67b90bf64cb3 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:16.879172 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:16.903323 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73739eca-a406-47cd-88ff-67b90bf64cb3 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:16.937636 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb81bd8-608b-4112-9c6f-ce92352bb035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:16.938258 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb81bd8-608b-4112-9c6f-ce92352bb035 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:16.938535 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb81bd8-608b-4112-9c6f-ce92352bb035 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:16.938809 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb81bd8-608b-4112-9c6f-ce92352bb035 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:17.013193 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb81bd8-608b-4112-9c6f-ce92352bb035 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:17.014671 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb81bd8-608b-4112-9c6f-ce92352bb035 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:17.092170 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:17.116828 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 147/292] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 05:16:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 05:16:17.122519 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b42b42-b928-4f68-87be-b2131b6fe60f None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:17.266643 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b42b42-b928-4f68-87be-b2131b6fe60f None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:17.305466 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead4606a-7cd8-4116-9c40-53571ddf1ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:17.306094 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead4606a-7cd8-4116-9c40-53571ddf1ff3 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:17.306370 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead4606a-7cd8-4116-9c40-53571ddf1ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:17.306640 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead4606a-7cd8-4116-9c40-53571ddf1ff3 None admin] PATH_INFO: `/v3/projects/ca0a33c848834728909bb4815ac1e8bc` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:17.312394 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead4606a-7cd8-4116-9c40-53571ddf1ff3 None admin] RBAC: Authorizing `identity:get_project(project_id=ca0a33c848834728909bb4815ac1e8bc)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:17.313840 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead4606a-7cd8-4116-9c40-53571ddf1ff3 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:17.315781 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 146/293] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 05:16:17 2022] GET /identity/v3/projects/ca0a33c848834728909bb4815ac1e8bc => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:17.321984 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb81bd8-608b-4112-9c6f-ce92352bb035 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:17.435089 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb81bd8-608b-4112-9c6f-ce92352bb035 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:17.470761 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddff50f4-f394-4c14-94cc-9ff62b3f33d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:17.471661 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddff50f4-f394-4c14-94cc-9ff62b3f33d6 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:17.472147 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddff50f4-f394-4c14-94cc-9ff62b3f33d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:17.472597 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddff50f4-f394-4c14-94cc-9ff62b3f33d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:17.473531 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddff50f4-f394-4c14-94cc-9ff62b3f33d6 None admin] RBAC: Adding query filter params (role.id=aa7ff8e0ec1e48e5811335b9eb38b448, scope.project.id=ca0a33c848834728909bb4815ac1e8bc, user.id=eabe71d49b03411aa65a66a3c3dfa7a2) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:17.474016 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddff50f4-f394-4c14-94cc-9ff62b3f33d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:17.475715 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddff50f4-f394-4c14-94cc-9ff62b3f33d6 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:17.482221 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 148/294] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 05:16:17 2022] GET /identity/v3/role_assignments?user.id=eabe71d49b03411aa65a66a3c3dfa7a2&scope.project.id=ca0a33c848834728909bb4815ac1e8bc&role.id=aa7ff8e0ec1e48e5811335b9eb38b448 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:18.154708 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d7c3e-c8dd-4a1c-a537-e170b4d450b3 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:18.155214 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d7c3e-c8dd-4a1c-a537-e170b4d450b3 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:18.155507 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d7c3e-c8dd-4a1c-a537-e170b4d450b3 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:18.156956 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 147/295] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:16:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:16:18.163133 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d2151a-3e72-4c09-873d-a489b5cbe3a5 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:18.163662 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d2151a-3e72-4c09-873d-a489b5cbe3a5 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:18.164159 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d2151a-3e72-4c09-873d-a489b5cbe3a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:18.183344 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-38d2151a-3e72-4c09-873d-a489b5cbe3a5 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:16:18.184876 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-38d2151a-3e72-4c09-873d-a489b5cbe3a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:16:18.225898 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:18.261579 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 149/296] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:16:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 05:16:18.466503 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc5d4a-0670-40fc-9787-3c899ff1a95b None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:18.466826 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc5d4a-0670-40fc-9787-3c899ff1a95b None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:18.466997 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc5d4a-0670-40fc-9787-3c899ff1a95b None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:18.468631 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 148/297] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:16:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:16:18.473888 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1627dc-c5e7-4769-9959-29d4f8b19488 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:18.474422 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1627dc-c5e7-4769-9959-29d4f8b19488 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:18.474500 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1627dc-c5e7-4769-9959-29d4f8b19488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:18.494075 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-fa1627dc-c5e7-4769-9959-29d4f8b19488 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:16:18.495311 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-fa1627dc-c5e7-4769-9959-29d4f8b19488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:16:18.497774 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d1db4-bd5b-4248-a5e1-55beb0b6a7cf None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:18.498092 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d1db4-bd5b-4248-a5e1-55beb0b6a7cf None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:18.498329 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d1db4-bd5b-4248-a5e1-55beb0b6a7cf None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:18.500054 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 149/298] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:16:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:16:18.507363 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c2a565-9280-41c5-bd97-b52a9c438815 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:18.507674 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c2a565-9280-41c5-bd97-b52a9c438815 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:18.507963 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c2a565-9280-41c5-bd97-b52a9c438815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:18.529507 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-49c2a565-9280-41c5-bd97-b52a9c438815 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:16:18.531531 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-49c2a565-9280-41c5-bd97-b52a9c438815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:16:18.583182 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 150/299] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:16:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 05:16:18.584465 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1627dc-c5e7-4769-9959-29d4f8b19488 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:18.593180 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:18.627704 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 150/300] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:16:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 05:16:18.627704 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44b2770-caa7-4a00-af2d-cb9a127421ac None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:18.627704 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44b2770-caa7-4a00-af2d-cb9a127421ac None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:18.627704 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44b2770-caa7-4a00-af2d-cb9a127421ac None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:18.627704 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 151/301] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:16:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:16:18.633202 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19fb2e8-93ae-45a4-a769-b57091602224 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:18.633487 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19fb2e8-93ae-45a4-a769-b57091602224 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:18.633760 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19fb2e8-93ae-45a4-a769-b57091602224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:18.655766 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-c19fb2e8-93ae-45a4-a769-b57091602224 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:16:18.657562 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-c19fb2e8-93ae-45a4-a769-b57091602224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:16:18.695559 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:18.699467 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1627dc-c5e7-4769-9959-29d4f8b19488 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:18.738557 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d823a9bd-1fe6-4b5b-949e-3b247296114f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:18.739210 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823a9bd-1fe6-4b5b-949e-3b247296114f None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:18.739828 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823a9bd-1fe6-4b5b-949e-3b247296114f None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:18.740237 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823a9bd-1fe6-4b5b-949e-3b247296114f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:18.743813 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 152/302] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:16:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 05:16:18.761488 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d823a9bd-1fe6-4b5b-949e-3b247296114f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:16:18.766514 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-d823a9bd-1fe6-4b5b-949e-3b247296114f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 05:16:18.766514 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:16:18.766514 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:16:18.766514 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:16:18.766514 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:16:18.766514 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:16:18.766514 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:16:18.766514 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:16:18.766514 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:16:18.766514 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:16:18.766514 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:16:18.766514 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:16:18.766514 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:16:18.766514 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:16:18.766514 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:16:18.766514 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:16:18.767596 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:16:18.767596 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:16:18.767596 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:16:18.767596 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:16:18.767596 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:16:18.767596 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:16:18.767596 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:16:18.767596 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:16:18.767596 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:16:18.767596 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:16:18.767596 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:16:18.767596 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:16:18.767596 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:16:18.767596 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:16:18.767596 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:16:18.767596 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:16:18.768611 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:16:18.768611 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:16:18.768611 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:16:18.768611 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:16:18.768611 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:16:18.768611 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:16:18.768611 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:16:18.768611 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:16:18.768611 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:16:18.768611 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:16:18.768611 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 05:16:18.768611 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:16:18.770841 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 151/303] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 05:16:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:16:18.776870 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19fb2e8-93ae-45a4-a769-b57091602224 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:18.858488 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d823a9bd-1fe6-4b5b-949e-3b247296114f None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:18.888047 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19fb2e8-93ae-45a4-a769-b57091602224 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:18.904298 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:18.931262 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32003e6-7599-44f4-a54c-f9fc759ff809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:18.931962 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32003e6-7599-44f4-a54c-f9fc759ff809 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:18.932242 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32003e6-7599-44f4-a54c-f9fc759ff809 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:18.932515 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32003e6-7599-44f4-a54c-f9fc759ff809 None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:18.933179 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32003e6-7599-44f4-a54c-f9fc759ff809 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:18.933484 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32003e6-7599-44f4-a54c-f9fc759ff809 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:18.934864 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32003e6-7599-44f4-a54c-f9fc759ff809 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:18.947667 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 153/304] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 11 05:16:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:18.947667 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32003e6-7599-44f4-a54c-f9fc759ff809 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:18.973245 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d823a9bd-1fe6-4b5b-949e-3b247296114f None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:19.014501 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70546dec-75dd-4cca-9799-dad629d7dc83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:19.015057 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70546dec-75dd-4cca-9799-dad629d7dc83 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:19.015337 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70546dec-75dd-4cca-9799-dad629d7dc83 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:19.015609 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70546dec-75dd-4cca-9799-dad629d7dc83 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:19.026284 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70546dec-75dd-4cca-9799-dad629d7dc83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:16:19.031626 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-70546dec-75dd-4cca-9799-dad629d7dc83 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 05:16:19.031626 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:16:19.031626 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:16:19.031626 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:16:19.031626 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:16:19.031626 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:16:19.031626 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:16:19.031626 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:16:19.031626 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:16:19.031626 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:16:19.031626 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:16:19.031626 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:16:19.031626 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:16:19.031626 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:16:19.031626 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:16:19.031626 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:16:19.032555 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:16:19.032555 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:16:19.032555 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:16:19.032555 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:16:19.032555 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:16:19.032555 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:16:19.032555 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:16:19.032555 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:16:19.032555 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:16:19.032555 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:16:19.032555 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:16:19.032555 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:16:19.032555 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:16:19.032555 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:16:19.032555 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:16:19.032555 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:16:19.033433 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:16:19.033433 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:16:19.033433 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:16:19.033433 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:16:19.033433 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:16:19.033433 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:16:19.033433 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:16:19.033433 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:16:19.033433 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:16:19.033433 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:16:19.033433 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 05:16:19.033433 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:16:19.035984 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 152/305] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 05:16:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 05:16:19.036759 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70546dec-75dd-4cca-9799-dad629d7dc83 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:19.053777 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32003e6-7599-44f4-a54c-f9fc759ff809 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:19.058231 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:19.087762 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437c0971-4aee-456f-b7df-573699734bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:19.088388 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437c0971-4aee-456f-b7df-573699734bf5 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:19.088661 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437c0971-4aee-456f-b7df-573699734bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:19.088926 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437c0971-4aee-456f-b7df-573699734bf5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:19.098978 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437c0971-4aee-456f-b7df-573699734bf5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:16:19.104287 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-437c0971-4aee-456f-b7df-573699734bf5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 05:16:19.104287 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:16:19.104287 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:16:19.104287 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:16:19.104287 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:16:19.104287 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:16:19.104287 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:16:19.104287 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:16:19.104287 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:16:19.104287 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:16:19.104287 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:16:19.104287 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:16:19.104287 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:16:19.104287 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:16:19.104287 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:16:19.104287 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:16:19.105155 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:16:19.105155 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:16:19.105155 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:16:19.105155 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:16:19.105155 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:16:19.105155 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:16:19.105155 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:16:19.105155 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:16:19.105155 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:16:19.105155 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:16:19.105155 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:16:19.105155 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:16:19.105155 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:16:19.105155 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:16:19.105155 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:16:19.105155 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:16:19.105941 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:16:19.105941 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:16:19.105941 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:16:19.105941 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:16:19.105941 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:16:19.105941 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:16:19.105941 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:16:19.105941 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:16:19.105941 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:16:19.105941 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:16:19.105941 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 05:16:19.105941 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:16:19.105941 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 154/306] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 05:16:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:16:19.106587 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437c0971-4aee-456f-b7df-573699734bf5 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:19.137931 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70546dec-75dd-4cca-9799-dad629d7dc83 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:19.140173 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:19.172650 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbd394d-c1de-4005-a43f-c84302b7c8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:19.173287 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd394d-c1de-4005-a43f-c84302b7c8c4 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:19.173568 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd394d-c1de-4005-a43f-c84302b7c8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:19.173866 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd394d-c1de-4005-a43f-c84302b7c8c4 None admin] PATH_INFO: `/v3/users/d6ace53cfb7542398bfc1b0575f666c4` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:19.187248 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbd394d-c1de-4005-a43f-c84302b7c8c4 None admin] RBAC: Authorizing `identity:get_user(user_id=d6ace53cfb7542398bfc1b0575f666c4)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:19.188733 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbd394d-c1de-4005-a43f-c84302b7c8c4 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:19.190332 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 153/307] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 05:16:19 2022] GET /identity/v3/users/d6ace53cfb7542398bfc1b0575f666c4 => generated 293 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:19.195407 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbd394d-c1de-4005-a43f-c84302b7c8c4 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:19.206005 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437c0971-4aee-456f-b7df-573699734bf5 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:19.238784 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154013d4-5c22-4d91-b363-03391e494b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:19.239415 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154013d4-5c22-4d91-b363-03391e494b4d None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:19.240018 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154013d4-5c22-4d91-b363-03391e494b4d None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:19.240570 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154013d4-5c22-4d91-b363-03391e494b4d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:19.241669 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154013d4-5c22-4d91-b363-03391e494b4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:19.243108 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154013d4-5c22-4d91-b363-03391e494b4d None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:19.244689 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 155/308] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:16:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:19.245438 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154013d4-5c22-4d91-b363-03391e494b4d None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:19.272573 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:19.294748 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbd394d-c1de-4005-a43f-c84302b7c8c4 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:19.327339 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f162fc-a093-4176-b127-64dad863034c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:19.327979 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f162fc-a093-4176-b127-64dad863034c None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:19.328252 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f162fc-a093-4176-b127-64dad863034c None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:19.328521 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f162fc-a093-4176-b127-64dad863034c None admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:19.329181 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f162fc-a093-4176-b127-64dad863034c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:19.329483 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f162fc-a093-4176-b127-64dad863034c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:19.330852 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f162fc-a093-4176-b127-64dad863034c None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:19.338997 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 154/309] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 11 05:16:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:19.339806 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f162fc-a093-4176-b127-64dad863034c None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:19.341479 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154013d4-5c22-4d91-b363-03391e494b4d None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:19.343000 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:19.376278 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0e687e-cdf5-4a48-b811-712e5684f4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:19.376876 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e687e-cdf5-4a48-b811-712e5684f4c7 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:19.377153 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e687e-cdf5-4a48-b811-712e5684f4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:19.377423 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e687e-cdf5-4a48-b811-712e5684f4c7 None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:19.378078 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0e687e-cdf5-4a48-b811-712e5684f4c7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:19.378376 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0e687e-cdf5-4a48-b811-712e5684f4c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:19.379769 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0e687e-cdf5-4a48-b811-712e5684f4c7 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:19.388275 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 156/310] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 11 05:16:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:19.389067 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0e687e-cdf5-4a48-b811-712e5684f4c7 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:19.444836 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f162fc-a093-4176-b127-64dad863034c None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:19.477742 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbfb3c5-f18b-4880-a841-9c16c31dc336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:19.478335 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbfb3c5-f18b-4880-a841-9c16c31dc336 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:19.478599 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbfb3c5-f18b-4880-a841-9c16c31dc336 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:19.478866 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbfb3c5-f18b-4880-a841-9c16c31dc336 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:19.479585 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbfb3c5-f18b-4880-a841-9c16c31dc336 None admin] RBAC: Adding query filter params (role.id=6f65b7f0071d466aa6ecf94916300a38, user.id=d6ace53cfb7542398bfc1b0575f666c4, scope.system=all) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:19.479921 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbfb3c5-f18b-4880-a841-9c16c31dc336 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:19.481357 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbfb3c5-f18b-4880-a841-9c16c31dc336 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:19.485859 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0e687e-cdf5-4a48-b811-712e5684f4c7 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:19.486247 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 155/311] 10.222.0.16 () {56 vars in 1308 bytes} [Sun Sep 11 05:16:19 2022] GET /identity/v3/role_assignments?user.id=d6ace53cfb7542398bfc1b0575f666c4&scope.system=all&role.id=6f65b7f0071d466aa6ecf94916300a38 => generated 226 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:19.487007 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbfb3c5-f18b-4880-a841-9c16c31dc336 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:19.491456 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:19.525680 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5a5cea-7d74-42c6-9127-b9edf815f2b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:19.526222 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a5cea-7d74-42c6-9127-b9edf815f2b3 None admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:19.526501 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a5cea-7d74-42c6-9127-b9edf815f2b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:19.526891 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a5cea-7d74-42c6-9127-b9edf815f2b3 None admin] PATH_INFO: `/v3/groups` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:19.527672 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5a5cea-7d74-42c6-9127-b9edf815f2b3 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:19.529204 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5a5cea-7d74-42c6-9127-b9edf815f2b3 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:19.556158 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 157/312] 10.222.0.16 () {60 vars in 1134 bytes} [Sun Sep 11 05:16:19 2022] POST /identity/v3/groups => generated 229 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:16:19.556965 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5a5cea-7d74-42c6-9127-b9edf815f2b3 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:19.592030 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:19.613203 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbfb3c5-f18b-4880-a841-9c16c31dc336 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:19.657100 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d6ca1f-06d0-421b-b7f0-a01e11edb534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:19.657766 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d6ca1f-06d0-421b-b7f0-a01e11edb534 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:19.658042 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d6ca1f-06d0-421b-b7f0-a01e11edb534 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:19.658310 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d6ca1f-06d0-421b-b7f0-a01e11edb534 None admin] PATH_INFO: `/v3/users/b933e65201ba421a81082eac6b88f3df` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:19.659571 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d6ca1f-06d0-421b-b7f0-a01e11edb534 None admin] RBAC: Authorizing `identity:get_user(user_id=b933e65201ba421a81082eac6b88f3df)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:19.661351 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d6ca1f-06d0-421b-b7f0-a01e11edb534 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:19.664270 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 156/313] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 05:16:19 2022] GET /identity/v3/users/b933e65201ba421a81082eac6b88f3df => generated 297 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:19.669873 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d6ca1f-06d0-421b-b7f0-a01e11edb534 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:19.697987 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5a5cea-7d74-42c6-9127-b9edf815f2b3 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:19.744576 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0691ba2f-8145-407d-9369-48634e9d8c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:19.745608 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0691ba2f-8145-407d-9369-48634e9d8c0d None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:19.746224 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0691ba2f-8145-407d-9369-48634e9d8c0d None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:19.747005 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0691ba2f-8145-407d-9369-48634e9d8c0d None admin] PATH_INFO: `/v3/users/57e659dee3ac459caf785cca1fba87a2` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:19.748632 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0691ba2f-8145-407d-9369-48634e9d8c0d None admin] RBAC: Authorizing `identity:get_user(user_id=57e659dee3ac459caf785cca1fba87a2)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:19.750836 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0691ba2f-8145-407d-9369-48634e9d8c0d None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:19.753305 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 158/314] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 05:16:19 2022] GET /identity/v3/users/57e659dee3ac459caf785cca1fba87a2 => generated 293 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:19.759326 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:19.760674 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0691ba2f-8145-407d-9369-48634e9d8c0d None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:19.798143 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d6ca1f-06d0-421b-b7f0-a01e11edb534 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:19.844158 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf4a3a6-95d3-4b09-b386-8c74afcdd67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:19.844958 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf4a3a6-95d3-4b09-b386-8c74afcdd67a None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:19.845445 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf4a3a6-95d3-4b09-b386-8c74afcdd67a None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:19.845722 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf4a3a6-95d3-4b09-b386-8c74afcdd67a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:19.872259 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:19.884094 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0691ba2f-8145-407d-9369-48634e9d8c0d None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:19.923133 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44b00e7-cbdf-46f9-a3ad-a891c6831d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:19.924170 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44b00e7-cbdf-46f9-a3ad-a891c6831d73 None admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:19.924670 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44b00e7-cbdf-46f9-a3ad-a891c6831d73 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:19.925163 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44b00e7-cbdf-46f9-a3ad-a891c6831d73 None admin] PATH_INFO: `/v3/system/users/57e659dee3ac459caf785cca1fba87a2/roles/aa7ff8e0ec1e48e5811335b9eb38b448` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:19.926965 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44b00e7-cbdf-46f9-a3ad-a891c6831d73 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=57e659dee3ac459caf785cca1fba87a2, role_id=aa7ff8e0ec1e48e5811335b9eb38b448)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:19.929111 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44b00e7-cbdf-46f9-a3ad-a891c6831d73 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:19.934004 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf4a3a6-95d3-4b09-b386-8c74afcdd67a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:19.935827 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf4a3a6-95d3-4b09-b386-8c74afcdd67a None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:19.941249 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 159/315] 10.222.0.16 () {58 vars in 1334 bytes} [Sun Sep 11 05:16:19 2022] PUT /identity/v3/system/users/57e659dee3ac459caf785cca1fba87a2/roles/aa7ff8e0ec1e48e5811335b9eb38b448 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:16:20.024987 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:20.063219 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 157/316] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 05:16:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 05:16:20.069494 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44b00e7-cbdf-46f9-a3ad-a891c6831d73 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:20.183767 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44b00e7-cbdf-46f9-a3ad-a891c6831d73 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:20.218893 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53551008-90f4-4411-8bec-2275cc614c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:20.219544 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53551008-90f4-4411-8bec-2275cc614c96 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:20.219833 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53551008-90f4-4411-8bec-2275cc614c96 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:20.220108 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53551008-90f4-4411-8bec-2275cc614c96 None admin] PATH_INFO: `/v3/projects/ca0a33c848834728909bb4815ac1e8bc` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:20.221243 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53551008-90f4-4411-8bec-2275cc614c96 None admin] RBAC: Authorizing `identity:get_project(project_id=ca0a33c848834728909bb4815ac1e8bc)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:20.222712 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53551008-90f4-4411-8bec-2275cc614c96 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:20.225262 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 160/317] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 05:16:20 2022] GET /identity/v3/projects/ca0a33c848834728909bb4815ac1e8bc => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:20.231109 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf4a3a6-95d3-4b09-b386-8c74afcdd67a None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:20.335315 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf4a3a6-95d3-4b09-b386-8c74afcdd67a None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:20.370804 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472081d2-9b22-40f3-ba06-10f6622a287b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:20.371426 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472081d2-9b22-40f3-ba06-10f6622a287b None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:20.371722 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472081d2-9b22-40f3-ba06-10f6622a287b None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:20.372005 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472081d2-9b22-40f3-ba06-10f6622a287b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:20.372739 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472081d2-9b22-40f3-ba06-10f6622a287b None admin] RBAC: Adding query filter params (role.id=6f65b7f0071d466aa6ecf94916300a38, scope.project.id=ca0a33c848834728909bb4815ac1e8bc, user.id=b933e65201ba421a81082eac6b88f3df) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:20.373049 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472081d2-9b22-40f3-ba06-10f6622a287b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:20.374502 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472081d2-9b22-40f3-ba06-10f6622a287b None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:20.381463 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 158/318] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 05:16:20 2022] GET /identity/v3/role_assignments?user.id=b933e65201ba421a81082eac6b88f3df&scope.project.id=ca0a33c848834728909bb4815ac1e8bc&role.id=6f65b7f0071d466aa6ecf94916300a38 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:21.779882 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b7b93-0f20-4be8-a446-99657b903a4a None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:21.780451 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b7b93-0f20-4be8-a446-99657b903a4a None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:21.780451 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b7b93-0f20-4be8-a446-99657b903a4a None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:21.781961 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 161/319] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:16:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:16:21.787782 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3ec098-399e-42fe-8451-b170b94941ea None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:21.788197 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3ec098-399e-42fe-8451-b170b94941ea None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:21.788372 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3ec098-399e-42fe-8451-b170b94941ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:21.807281 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-9a3ec098-399e-42fe-8451-b170b94941ea None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:16:21.808586 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-9a3ec098-399e-42fe-8451-b170b94941ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:16:21.809668 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5451ae5e-b128-4760-a159-1f541b59df58 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:21.809953 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5451ae5e-b128-4760-a159-1f541b59df58 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:21.810225 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5451ae5e-b128-4760-a159-1f541b59df58 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:21.811742 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 162/320] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:16:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 05:16:21.816371 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2996f-1792-4b05-bf08-ea6788919405 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:21.816665 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2996f-1792-4b05-bf08-ea6788919405 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:21.816937 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2996f-1792-4b05-bf08-ea6788919405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:21.837263 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-79a2996f-1792-4b05-bf08-ea6788919405 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:16:21.838437 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-79a2996f-1792-4b05-bf08-ea6788919405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:16:21.839034 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:21.859837 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:21.883988 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 159/321] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:16:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 05:16:21.917201 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 163/322] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:16:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 05:16:22.129683 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34723d-38b6-45a2-b258-24be5ccabef9 None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:22.130018 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34723d-38b6-45a2-b258-24be5ccabef9 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:22.130205 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34723d-38b6-45a2-b258-24be5ccabef9 None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:22.132275 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 160/323] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:16:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:16:22.137223 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48129b23-acbd-4a8a-8ca5-0043eb976988 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:22.137511 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48129b23-acbd-4a8a-8ca5-0043eb976988 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:22.137787 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48129b23-acbd-4a8a-8ca5-0043eb976988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:22.150191 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d34723d-38b6-45a2-b258-24be5ccabef9 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:22.156255 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-48129b23-acbd-4a8a-8ca5-0043eb976988 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:16:22.157442 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-48129b23-acbd-4a8a-8ca5-0043eb976988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:16:22.224055 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 164/324] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:16:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 05:16:22.225034 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48129b23-acbd-4a8a-8ca5-0043eb976988 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:22.265607 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d34723d-38b6-45a2-b258-24be5ccabef9 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:22.309008 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e554f5-c9a8-4892-a10c-2f7274c2e239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:22.309685 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e554f5-c9a8-4892-a10c-2f7274c2e239 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:22.309962 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e554f5-c9a8-4892-a10c-2f7274c2e239 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:22.310234 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e554f5-c9a8-4892-a10c-2f7274c2e239 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:22.317491 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:22.322324 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e554f5-c9a8-4892-a10c-2f7274c2e239 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:16:22.327256 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-23e554f5-c9a8-4892-a10c-2f7274c2e239 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 05:16:22.327256 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:16:22.327256 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:16:22.327256 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:16:22.327256 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:16:22.327256 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:16:22.327256 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:16:22.327256 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:16:22.327256 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:16:22.327256 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:16:22.327256 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:16:22.327256 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:16:22.327256 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:16:22.327256 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:16:22.327256 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:16:22.327256 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:16:22.328161 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:16:22.328161 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:16:22.328161 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:16:22.328161 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:16:22.328161 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:16:22.328161 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:16:22.328161 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:16:22.328161 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:16:22.328161 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:16:22.328161 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:16:22.328161 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:16:22.328161 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:16:22.328161 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:16:22.328161 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:16:22.328161 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:16:22.328161 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:16:22.329182 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:16:22.329182 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:16:22.329182 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:16:22.329182 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:16:22.329182 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:16:22.329182 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:16:22.329182 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:16:22.329182 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:16:22.329182 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:16:22.329182 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:16:22.329182 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 05:16:22.329182 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:16:22.329182 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 161/325] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 05:16:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 05:16:22.334610 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e554f5-c9a8-4892-a10c-2f7274c2e239 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:22.336903 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48129b23-acbd-4a8a-8ca5-0043eb976988 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:22.366831 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:22.375302 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf54b0b-d589-41bd-85d2-aca212ca5b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:22.375959 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf54b0b-d589-41bd-85d2-aca212ca5b23 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:22.376240 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf54b0b-d589-41bd-85d2-aca212ca5b23 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:22.376507 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf54b0b-d589-41bd-85d2-aca212ca5b23 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:22.377612 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf54b0b-d589-41bd-85d2-aca212ca5b23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:22.379084 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf54b0b-d589-41bd-85d2-aca212ca5b23 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:22.381388 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 165/326] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:16:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:22.386492 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf54b0b-d589-41bd-85d2-aca212ca5b23 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:22.447517 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e554f5-c9a8-4892-a10c-2f7274c2e239 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:22.484710 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65cbea3-32e0-499d-ba7d-0d56bd4a3b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:22.485323 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65cbea3-32e0-499d-ba7d-0d56bd4a3b5e None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:22.485609 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65cbea3-32e0-499d-ba7d-0d56bd4a3b5e None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:22.485881 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65cbea3-32e0-499d-ba7d-0d56bd4a3b5e None admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:22.486549 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65cbea3-32e0-499d-ba7d-0d56bd4a3b5e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:22.486854 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65cbea3-32e0-499d-ba7d-0d56bd4a3b5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:22.488270 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65cbea3-32e0-499d-ba7d-0d56bd4a3b5e None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:22.490388 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf54b0b-d589-41bd-85d2-aca212ca5b23 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:22.496960 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 162/327] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 11 05:16:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:16:22.500327 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65cbea3-32e0-499d-ba7d-0d56bd4a3b5e None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:22.525943 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2af279-34a7-4943-b660-4d9a38a02d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:22.526554 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2af279-34a7-4943-b660-4d9a38a02d7f None admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:22.526830 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2af279-34a7-4943-b660-4d9a38a02d7f None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:22.527100 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2af279-34a7-4943-b660-4d9a38a02d7f None admin] PATH_INFO: `/v3/groups` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:22.527770 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2af279-34a7-4943-b660-4d9a38a02d7f None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:22.529226 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2af279-34a7-4943-b660-4d9a38a02d7f None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:22.544041 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 166/328] 10.222.0.16 () {60 vars in 1134 bytes} [Sun Sep 11 05:16:22 2022] POST /identity/v3/groups => generated 226 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:16:22.544725 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2af279-34a7-4943-b660-4d9a38a02d7f None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:22.560434 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:22.600291 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:22.615810 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65cbea3-32e0-499d-ba7d-0d56bd4a3b5e None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:22.653171 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58a5b67-3f66-429f-8e8c-bd095ccd27a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:22.653826 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a5b67-3f66-429f-8e8c-bd095ccd27a1 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:22.654105 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a5b67-3f66-429f-8e8c-bd095ccd27a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:22.654381 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a5b67-3f66-429f-8e8c-bd095ccd27a1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:22.664241 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2af279-34a7-4943-b660-4d9a38a02d7f None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:22.667549 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58a5b67-3f66-429f-8e8c-bd095ccd27a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:16:22.673264 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-f58a5b67-3f66-429f-8e8c-bd095ccd27a1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 05:16:22.673264 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:16:22.673264 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:16:22.673264 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:16:22.673264 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:16:22.673264 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:16:22.673264 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:16:22.673264 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:16:22.673264 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:16:22.673264 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:16:22.673264 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:16:22.673264 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:16:22.673264 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:16:22.673264 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:16:22.673264 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:16:22.673264 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:16:22.674266 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:16:22.674266 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:16:22.674266 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:16:22.674266 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:16:22.674266 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:16:22.674266 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:16:22.674266 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:16:22.674266 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:16:22.674266 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:16:22.674266 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:16:22.674266 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:16:22.674266 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:16:22.674266 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:16:22.674266 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:16:22.674266 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:16:22.674266 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:16:22.675425 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:16:22.675425 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:16:22.675425 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:16:22.675425 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:16:22.675425 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:16:22.675425 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:16:22.675425 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:16:22.675425 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:16:22.675425 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:16:22.675425 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:16:22.675425 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 05:16:22.675425 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:16:22.675425 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 163/329] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 05:16:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:16:22.681988 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58a5b67-3f66-429f-8e8c-bd095ccd27a1 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:22.709387 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dea4010-6263-4524-aa14-5dfd112f0e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:22.710034 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea4010-6263-4524-aa14-5dfd112f0e9b None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:22.710306 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea4010-6263-4524-aa14-5dfd112f0e9b None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:22.710576 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea4010-6263-4524-aa14-5dfd112f0e9b None admin] PATH_INFO: `/v3/users/d6ace53cfb7542398bfc1b0575f666c4` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:22.711758 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dea4010-6263-4524-aa14-5dfd112f0e9b None admin] RBAC: Authorizing `identity:get_user(user_id=d6ace53cfb7542398bfc1b0575f666c4)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:22.713246 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dea4010-6263-4524-aa14-5dfd112f0e9b None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:22.715000 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 167/330] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 05:16:22 2022] GET /identity/v3/users/d6ace53cfb7542398bfc1b0575f666c4 => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:22.720538 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dea4010-6263-4524-aa14-5dfd112f0e9b None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:22.806568 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58a5b67-3f66-429f-8e8c-bd095ccd27a1 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:22.821779 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:22.848683 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dea4010-6263-4524-aa14-5dfd112f0e9b None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:22.849246 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e77af0-d540-4220-a016-3e80e0871744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:22.850034 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e77af0-d540-4220-a016-3e80e0871744 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:22.850485 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e77af0-d540-4220-a016-3e80e0871744 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:22.850900 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e77af0-d540-4220-a016-3e80e0871744 None admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:22.851778 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e77af0-d540-4220-a016-3e80e0871744 None admin] RBAC: Adding query filter params (name=member) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:22.852222 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e77af0-d540-4220-a016-3e80e0871744 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:22.853746 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e77af0-d540-4220-a016-3e80e0871744 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:22.863278 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 164/331] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 11 05:16:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:16:22.869939 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e77af0-d540-4220-a016-3e80e0871744 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:22.886315 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:22.891744 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b342a3-0d46-4067-a77e-22e13a36073f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:22.892413 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b342a3-0d46-4067-a77e-22e13a36073f None admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:22.892696 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b342a3-0d46-4067-a77e-22e13a36073f None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:22.892969 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b342a3-0d46-4067-a77e-22e13a36073f None admin] PATH_INFO: `/v3/system/users/d6ace53cfb7542398bfc1b0575f666c4/roles/6f65b7f0071d466aa6ecf94916300a38` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:22.894428 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b342a3-0d46-4067-a77e-22e13a36073f None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d6ace53cfb7542398bfc1b0575f666c4, role_id=6f65b7f0071d466aa6ecf94916300a38)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:22.895861 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b342a3-0d46-4067-a77e-22e13a36073f None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:22.906873 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 168/332] 10.222.0.16 () {58 vars in 1334 bytes} [Sun Sep 11 05:16:22 2022] PUT /identity/v3/system/users/d6ace53cfb7542398bfc1b0575f666c4/roles/6f65b7f0071d466aa6ecf94916300a38 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:16:23.000488 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e77af0-d540-4220-a016-3e80e0871744 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:23.040201 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c5ec10-c638-41f3-9b9a-d2a362c80f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:23.040923 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c5ec10-c638-41f3-9b9a-d2a362c80f70 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:23.042150 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c5ec10-c638-41f3-9b9a-d2a362c80f70 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:23.042428 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c5ec10-c638-41f3-9b9a-d2a362c80f70 None admin] PATH_INFO: `/v3/users/57e659dee3ac459caf785cca1fba87a2` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:23.043886 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c5ec10-c638-41f3-9b9a-d2a362c80f70 None admin] RBAC: Authorizing `identity:get_user(user_id=57e659dee3ac459caf785cca1fba87a2)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:23.045513 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c5ec10-c638-41f3-9b9a-d2a362c80f70 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:23.047599 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 165/333] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 05:16:22 2022] GET /identity/v3/users/57e659dee3ac459caf785cca1fba87a2 => generated 293 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:16:23.054047 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b342a3-0d46-4067-a77e-22e13a36073f None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:23.182445 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b342a3-0d46-4067-a77e-22e13a36073f None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:23.220071 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc5a0be-368f-43a3-b603-e9583f34e8ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:23.220694 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc5a0be-368f-43a3-b603-e9583f34e8ab None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:23.220971 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc5a0be-368f-43a3-b603-e9583f34e8ab None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:23.221242 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc5a0be-368f-43a3-b603-e9583f34e8ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:23.221974 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc5a0be-368f-43a3-b603-e9583f34e8ab None admin] RBAC: Adding query filter params (role.id=aa7ff8e0ec1e48e5811335b9eb38b448, user.id=57e659dee3ac459caf785cca1fba87a2, scope.system=all) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:23.222282 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc5a0be-368f-43a3-b603-e9583f34e8ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:23.223874 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc5a0be-368f-43a3-b603-e9583f34e8ab None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:23.239067 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 169/334] 10.222.0.16 () {56 vars in 1308 bytes} [Sun Sep 11 05:16:23 2022] GET /identity/v3/role_assignments?user.id=57e659dee3ac459caf785cca1fba87a2&scope.system=all&role.id=aa7ff8e0ec1e48e5811335b9eb38b448 => generated 510 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:24.911633 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077cfae-d95f-4030-bfbb-7fa70d014586 None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:24.912679 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077cfae-d95f-4030-bfbb-7fa70d014586 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:24.912755 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077cfae-d95f-4030-bfbb-7fa70d014586 None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:24.914080 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 166/335] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:16:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:16:24.919345 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71336ab-b0fe-4116-9b60-425dae373aeb None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:24.919758 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71336ab-b0fe-4116-9b60-425dae373aeb None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:24.919959 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71336ab-b0fe-4116-9b60-425dae373aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:24.926983 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:24.942406 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-f71336ab-b0fe-4116-9b60-425dae373aeb None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:16:24.944375 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-f71336ab-b0fe-4116-9b60-425dae373aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:16:25.020231 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 170/336] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:16:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 05:16:25.306649 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f077cfae-d95f-4030-bfbb-7fa70d014586 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:25.403550 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:25.430076 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f077cfae-d95f-4030-bfbb-7fa70d014586 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:25.464625 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a3e424-d14c-4d97-9c10-1dbb7f24619f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:25.465624 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3e424-d14c-4d97-9c10-1dbb7f24619f None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:25.466099 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3e424-d14c-4d97-9c10-1dbb7f24619f None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:25.466586 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3e424-d14c-4d97-9c10-1dbb7f24619f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:25.480396 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a3e424-d14c-4d97-9c10-1dbb7f24619f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:16:25.485951 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-12a3e424-d14c-4d97-9c10-1dbb7f24619f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 05:16:25.485951 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:16:25.485951 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:16:25.485951 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:16:25.485951 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:16:25.485951 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:16:25.485951 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:16:25.485951 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:16:25.485951 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:16:25.485951 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:16:25.485951 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:16:25.485951 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:16:25.485951 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:16:25.485951 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:16:25.485951 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:16:25.485951 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:16:25.486834 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:16:25.486834 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:16:25.486834 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:16:25.486834 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:16:25.486834 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:16:25.486834 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:16:25.486834 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:16:25.486834 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:16:25.486834 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:16:25.486834 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:16:25.486834 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:16:25.486834 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:16:25.486834 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:16:25.486834 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:16:25.486834 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:16:25.486834 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:16:25.487610 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:16:25.487610 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:16:25.487610 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:16:25.487610 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:16:25.487610 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:16:25.487610 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:16:25.487610 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:16:25.487610 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:16:25.487610 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:16:25.487610 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:16:25.487610 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 05:16:25.487610 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:16:25.490250 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 167/337] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 05:16:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:16:25.496416 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71336ab-b0fe-4116-9b60-425dae373aeb None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:25.580726 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eaa406-095f-4649-9f7c-bfcd2767fc0f None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:25.581363 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eaa406-095f-4649-9f7c-bfcd2767fc0f None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:25.581830 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eaa406-095f-4649-9f7c-bfcd2767fc0f None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:25.583395 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 168/338] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:16:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:16:25.596486 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56408f6d-d09e-4135-9988-9b0d11031767 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:25.597047 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56408f6d-d09e-4135-9988-9b0d11031767 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:25.597510 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56408f6d-d09e-4135-9988-9b0d11031767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:25.635012 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-56408f6d-d09e-4135-9988-9b0d11031767 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:16:25.636605 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-56408f6d-d09e-4135-9988-9b0d11031767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:16:25.659469 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71336ab-b0fe-4116-9b60-425dae373aeb None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:25.712049 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:25.715132 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f933e4f8-406e-42fc-8aa0-e5a67f04c066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:25.716348 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f933e4f8-406e-42fc-8aa0-e5a67f04c066 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:25.716627 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f933e4f8-406e-42fc-8aa0-e5a67f04c066 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:25.716895 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f933e4f8-406e-42fc-8aa0-e5a67f04c066 None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:25.717567 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f933e4f8-406e-42fc-8aa0-e5a67f04c066 None admin] RBAC: Adding query filter params (name=member) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:25.717869 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f933e4f8-406e-42fc-8aa0-e5a67f04c066 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:25.719245 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f933e4f8-406e-42fc-8aa0-e5a67f04c066 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:25.738518 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 171/339] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 11 05:16:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:25.740988 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53844b01-0616-42df-bac4-e4e9deb5fad6 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:25.741274 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53844b01-0616-42df-bac4-e4e9deb5fad6 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:25.741618 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53844b01-0616-42df-bac4-e4e9deb5fad6 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:25.745491 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 172/340] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:16:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:16:25.748282 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53844b01-0616-42df-bac4-e4e9deb5fad6 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:25.790957 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 169/341] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:16:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 05:16:25.792205 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d6b45e-8b6d-4851-92ba-579ae3bbf2c1 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:25.792205 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d6b45e-8b6d-4851-92ba-579ae3bbf2c1 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:25.792453 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d6b45e-8b6d-4851-92ba-579ae3bbf2c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:25.830531 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-d4d6b45e-8b6d-4851-92ba-579ae3bbf2c1 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:16:25.834258 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-d4d6b45e-8b6d-4851-92ba-579ae3bbf2c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:16:25.937522 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:25.946186 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 170/342] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:16:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 05:16:25.969063 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53844b01-0616-42df-bac4-e4e9deb5fad6 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:26.018056 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad203ce3-7307-47ac-b4aa-53bfbf09ec34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:26.018687 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad203ce3-7307-47ac-b4aa-53bfbf09ec34 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:26.018964 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad203ce3-7307-47ac-b4aa-53bfbf09ec34 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:26.019241 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad203ce3-7307-47ac-b4aa-53bfbf09ec34 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:26.096746 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:26.106571 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad203ce3-7307-47ac-b4aa-53bfbf09ec34 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:26.108084 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad203ce3-7307-47ac-b4aa-53bfbf09ec34 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:26.216705 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 173/343] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 05:16:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 05:16:26.222292 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d6b45e-8b6d-4851-92ba-579ae3bbf2c1 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:26.332283 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d6b45e-8b6d-4851-92ba-579ae3bbf2c1 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:26.342859 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad203ce3-7307-47ac-b4aa-53bfbf09ec34 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:26.410943 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61db2084-683c-451b-a06b-35aca454a77a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:26.411596 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db2084-683c-451b-a06b-35aca454a77a None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:26.411931 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db2084-683c-451b-a06b-35aca454a77a None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:26.412199 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db2084-683c-451b-a06b-35aca454a77a None admin] PATH_INFO: `/v3/projects/199292d828144a70992f2344ae63f351` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:26.415566 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61db2084-683c-451b-a06b-35aca454a77a None admin] RBAC: Authorizing `identity:get_project(project_id=199292d828144a70992f2344ae63f351)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:26.417046 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61db2084-683c-451b-a06b-35aca454a77a None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:26.418691 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 171/344] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 05:16:26 2022] GET /identity/v3/projects/199292d828144a70992f2344ae63f351 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:26.425900 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61db2084-683c-451b-a06b-35aca454a77a None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:26.535646 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:26.547945 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad203ce3-7307-47ac-b4aa-53bfbf09ec34 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:26.562275 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:26.615933 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a041cc2-35bb-4714-830d-55228fef0a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:26.618356 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a041cc2-35bb-4714-830d-55228fef0a71 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:26.618797 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a041cc2-35bb-4714-830d-55228fef0a71 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:26.619314 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a041cc2-35bb-4714-830d-55228fef0a71 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:26.624472 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61db2084-683c-451b-a06b-35aca454a77a None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:26.642199 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a041cc2-35bb-4714-830d-55228fef0a71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:16:26.649755 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-3a041cc2-35bb-4714-830d-55228fef0a71 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 05:16:26.649755 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:16:26.649755 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:16:26.649755 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:16:26.649755 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:16:26.649755 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:16:26.649755 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:16:26.649755 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:16:26.649755 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:16:26.649755 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:16:26.649755 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:16:26.649755 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:16:26.649755 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:16:26.649755 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:16:26.649755 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:16:26.649755 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:16:26.650853 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:16:26.650853 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:16:26.650853 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:16:26.650853 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:16:26.650853 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:16:26.650853 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:16:26.650853 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:16:26.650853 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:16:26.650853 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:16:26.650853 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:16:26.650853 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:16:26.650853 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:16:26.650853 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:16:26.650853 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:16:26.650853 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:16:26.650853 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:16:26.651639 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:16:26.651639 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:16:26.651639 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:16:26.651639 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:16:26.651639 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:16:26.651639 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:16:26.651639 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:16:26.651639 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:16:26.651639 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:16:26.651639 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:16:26.651639 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 05:16:26.651639 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:16:26.654799 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 174/345] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 11 05:16:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 05:16:26.655832 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a041cc2-35bb-4714-830d-55228fef0a71 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:26.677093 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffd278f-8f8a-49f8-967d-b7253569cfb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:26.678605 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd278f-8f8a-49f8-967d-b7253569cfb4 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:26.679076 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd278f-8f8a-49f8-967d-b7253569cfb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:26.679539 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd278f-8f8a-49f8-967d-b7253569cfb4 None admin] PATH_INFO: `/v3/groups/cbf562a50e194986adfef41d4a7805d7` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:26.691304 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffd278f-8f8a-49f8-967d-b7253569cfb4 None admin] RBAC: Authorizing `identity:get_group(group_id=cbf562a50e194986adfef41d4a7805d7)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:26.693302 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffd278f-8f8a-49f8-967d-b7253569cfb4 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:26.695551 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 172/346] 10.222.0.16 () {56 vars in 1180 bytes} [Sun Sep 11 05:16:26 2022] GET /identity/v3/groups/cbf562a50e194986adfef41d4a7805d7 => generated 226 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:26.697241 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d3009-d662-4911-90c6-c2dbaa65786a None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:26.697729 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d3009-d662-4911-90c6-c2dbaa65786a None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:26.698204 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d3009-d662-4911-90c6-c2dbaa65786a None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:26.699949 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 173/347] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:16:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:16:26.700927 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967d3009-d662-4911-90c6-c2dbaa65786a None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:26.799710 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a041cc2-35bb-4714-830d-55228fef0a71 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:26.837935 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0fbb37-3a51-40ea-a48b-047fb0db9520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:26.838952 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0fbb37-3a51-40ea-a48b-047fb0db9520 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:26.839443 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0fbb37-3a51-40ea-a48b-047fb0db9520 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:26.839948 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0fbb37-3a51-40ea-a48b-047fb0db9520 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:26.845730 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967d3009-d662-4911-90c6-c2dbaa65786a None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:26.851930 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0fbb37-3a51-40ea-a48b-047fb0db9520 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:16:26.856930 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-6d0fbb37-3a51-40ea-a48b-047fb0db9520 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 05:16:26.856930 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:16:26.856930 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:16:26.856930 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:16:26.856930 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:16:26.856930 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:16:26.856930 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:16:26.856930 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:16:26.856930 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:16:26.856930 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:16:26.856930 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:16:26.856930 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:16:26.856930 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:16:26.856930 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:16:26.856930 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:16:26.856930 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:16:26.858161 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:16:26.858161 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:16:26.858161 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:16:26.858161 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:16:26.858161 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:16:26.858161 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:16:26.858161 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:16:26.858161 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:16:26.858161 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:16:26.858161 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:16:26.858161 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:16:26.858161 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:16:26.858161 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:16:26.858161 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:16:26.858161 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:16:26.858161 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:16:26.859047 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:16:26.859047 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:16:26.859047 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:16:26.859047 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:16:26.859047 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:16:26.859047 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:16:26.859047 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:16:26.859047 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:16:26.859047 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:16:26.859047 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:16:26.859047 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 05:16:26.859047 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:16:26.861296 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 175/348] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 05:16:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:16:26.862646 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa250754-99b7-485b-b75a-1edbf169522d None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:26.863145 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa250754-99b7-485b-b75a-1edbf169522d None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:26.863632 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa250754-99b7-485b-b75a-1edbf169522d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:26.882091 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:26.887722 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-fa250754-99b7-485b-b75a-1edbf169522d None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:16:26.889255 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-fa250754-99b7-485b-b75a-1edbf169522d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:16:26.889872 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3aba10-eada-48dc-a1f9-c6215491c3b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:26.890490 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3aba10-eada-48dc-a1f9-c6215491c3b4 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:26.890772 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3aba10-eada-48dc-a1f9-c6215491c3b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:26.891043 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3aba10-eada-48dc-a1f9-c6215491c3b4 None admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:26.891734 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3aba10-eada-48dc-a1f9-c6215491c3b4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:26.892043 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3aba10-eada-48dc-a1f9-c6215491c3b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:26.893557 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3aba10-eada-48dc-a1f9-c6215491c3b4 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:26.902260 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:26.904426 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 174/349] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 05:16:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:26.906915 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3aba10-eada-48dc-a1f9-c6215491c3b4 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:26.970180 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 176/350] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:16:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 05:16:26.972117 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa250754-99b7-485b-b75a-1edbf169522d None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:27.022945 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3aba10-eada-48dc-a1f9-c6215491c3b4 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:27.062317 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e52dff-b1eb-49b5-9e40-bfa0c9d3a62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:27.062936 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e52dff-b1eb-49b5-9e40-bfa0c9d3a62e None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:27.063213 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e52dff-b1eb-49b5-9e40-bfa0c9d3a62e None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:27.063492 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e52dff-b1eb-49b5-9e40-bfa0c9d3a62e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:27.064289 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e52dff-b1eb-49b5-9e40-bfa0c9d3a62e None admin] RBAC: Adding query filter params (group.id=cbf562a50e194986adfef41d4a7805d7, role.id=aa7ff8e0ec1e48e5811335b9eb38b448, scope.project.id=199292d828144a70992f2344ae63f351) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:27.065707 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e52dff-b1eb-49b5-9e40-bfa0c9d3a62e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:27.066560 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e52dff-b1eb-49b5-9e40-bfa0c9d3a62e None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:27.075701 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 175/351] 10.222.0.16 () {56 vars in 1376 bytes} [Sun Sep 11 05:16:26 2022] GET /identity/v3/role_assignments?group.id=cbf562a50e194986adfef41d4a7805d7&scope.project.id=199292d828144a70992f2344ae63f351&role.id=aa7ff8e0ec1e48e5811335b9eb38b448 => generated 260 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:27.076673 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e52dff-b1eb-49b5-9e40-bfa0c9d3a62e None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:27.122751 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa250754-99b7-485b-b75a-1edbf169522d None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:27.178313 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:27.195759 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809fddfb-00e3-47b9-b277-e3f696162f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:27.196399 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809fddfb-00e3-47b9-b277-e3f696162f59 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:27.196678 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809fddfb-00e3-47b9-b277-e3f696162f59 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:27.196954 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809fddfb-00e3-47b9-b277-e3f696162f59 None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:27.197638 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809fddfb-00e3-47b9-b277-e3f696162f59 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:27.197940 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809fddfb-00e3-47b9-b277-e3f696162f59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:27.199353 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809fddfb-00e3-47b9-b277-e3f696162f59 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:27.215744 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 177/352] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 11 05:16:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:27.215744 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10436976-e388-4e8a-b738-a3b7ed8c62f3 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:27.215744 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10436976-e388-4e8a-b738-a3b7ed8c62f3 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:27.215744 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10436976-e388-4e8a-b738-a3b7ed8c62f3 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:27.215744 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 178/353] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:16:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:16:27.218895 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10436976-e388-4e8a-b738-a3b7ed8c62f3 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:27.245702 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e52dff-b1eb-49b5-9e40-bfa0c9d3a62e None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:27.246867 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:27.290871 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622e8a77-9faf-41b1-9f5c-1a973237121a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:27.291897 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e8a77-9faf-41b1-9f5c-1a973237121a None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:27.292456 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e8a77-9faf-41b1-9f5c-1a973237121a None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:27.293479 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e8a77-9faf-41b1-9f5c-1a973237121a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:27.349971 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10436976-e388-4e8a-b738-a3b7ed8c62f3 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:27.378472 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622e8a77-9faf-41b1-9f5c-1a973237121a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:27.381282 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622e8a77-9faf-41b1-9f5c-1a973237121a None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:27.393052 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df3fc75-dd63-41b3-83e5-18c04c2c345c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:27.393901 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df3fc75-dd63-41b3-83e5-18c04c2c345c None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:27.394091 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df3fc75-dd63-41b3-83e5-18c04c2c345c None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:27.394335 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df3fc75-dd63-41b3-83e5-18c04c2c345c None admin] PATH_INFO: `/v3/users/d6ace53cfb7542398bfc1b0575f666c4` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:27.395479 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df3fc75-dd63-41b3-83e5-18c04c2c345c None admin] RBAC: Authorizing `identity:get_user(user_id=d6ace53cfb7542398bfc1b0575f666c4)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:27.397649 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df3fc75-dd63-41b3-83e5-18c04c2c345c None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:27.401164 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 179/354] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 05:16:27 2022] GET /identity/v3/users/d6ace53cfb7542398bfc1b0575f666c4 => generated 293 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:27.402363 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f23e76-c462-4819-bdbd-2a6dc4b347d2 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:27.402643 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f23e76-c462-4819-bdbd-2a6dc4b347d2 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:27.402917 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f23e76-c462-4819-bdbd-2a6dc4b347d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:27.422839 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-e6f23e76-c462-4819-bdbd-2a6dc4b347d2 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:16:27.424109 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-e6f23e76-c462-4819-bdbd-2a6dc4b347d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:16:27.456931 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:27.501621 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 180/355] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:16:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 05:16:27.502785 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f23e76-c462-4819-bdbd-2a6dc4b347d2 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:27.504893 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 176/356] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 05:16:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 05:16:27.506421 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622e8a77-9faf-41b1-9f5c-1a973237121a None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:27.507323 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:27.613354 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622e8a77-9faf-41b1-9f5c-1a973237121a None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:27.628956 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f23e76-c462-4819-bdbd-2a6dc4b347d2 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:27.649770 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07482247-125f-4c1f-a4fb-3ded015a1b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:27.650645 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07482247-125f-4c1f-a4fb-3ded015a1b8b None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:27.651098 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07482247-125f-4c1f-a4fb-3ded015a1b8b None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:27.651508 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07482247-125f-4c1f-a4fb-3ded015a1b8b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:27.662861 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07482247-125f-4c1f-a4fb-3ded015a1b8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:16:27.668041 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-07482247-125f-4c1f-a4fb-3ded015a1b8b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 05:16:27.668041 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:16:27.668041 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:16:27.668041 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:16:27.668041 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:16:27.668041 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:16:27.668041 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:16:27.668041 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:16:27.668041 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:16:27.668041 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:16:27.668041 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:16:27.668041 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:16:27.668041 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:16:27.668041 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:16:27.668041 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:16:27.668041 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:16:27.668912 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:16:27.668912 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:16:27.668912 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:16:27.668912 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:16:27.668912 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:16:27.668912 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:16:27.668912 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:16:27.668912 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:16:27.668912 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:16:27.668912 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:16:27.668912 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:16:27.668912 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:16:27.668912 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:16:27.668912 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:16:27.668912 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:16:27.668912 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:16:27.669690 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:16:27.669690 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:16:27.669690 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:16:27.669690 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:16:27.669690 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:16:27.669690 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:16:27.669690 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:16:27.669690 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:16:27.669690 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:16:27.669690 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:16:27.669690 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 05:16:27.669690 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:16:27.671946 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 177/357] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 05:16:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:16:27.672996 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07482247-125f-4c1f-a4fb-3ded015a1b8b None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:27.688481 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02830be9-a0fc-45b5-875d-aac0d3b57b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:27.689096 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02830be9-a0fc-45b5-875d-aac0d3b57b4b None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:27.689374 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02830be9-a0fc-45b5-875d-aac0d3b57b4b None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:27.689655 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02830be9-a0fc-45b5-875d-aac0d3b57b4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:27.696096 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02830be9-a0fc-45b5-875d-aac0d3b57b4b None admin] RBAC: Adding query filter params (role.id=6f65b7f0071d466aa6ecf94916300a38, user.id=d6ace53cfb7542398bfc1b0575f666c4, scope.system=all) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:27.696406 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02830be9-a0fc-45b5-875d-aac0d3b57b4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:27.697986 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02830be9-a0fc-45b5-875d-aac0d3b57b4b None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:27.700247 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:27.718033 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 181/358] 10.222.0.16 () {56 vars in 1308 bytes} [Sun Sep 11 05:16:27 2022] GET /identity/v3/role_assignments?user.id=d6ace53cfb7542398bfc1b0575f666c4&scope.system=all&role.id=6f65b7f0071d466aa6ecf94916300a38 => generated 510 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:27.718891 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02830be9-a0fc-45b5-875d-aac0d3b57b4b None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:27.800415 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07482247-125f-4c1f-a4fb-3ded015a1b8b None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:27.842189 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dae157-b3c7-493e-818e-583200e3aa39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:27.843071 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:27.843508 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dae157-b3c7-493e-818e-583200e3aa39 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:27.844554 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dae157-b3c7-493e-818e-583200e3aa39 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:27.845344 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dae157-b3c7-493e-818e-583200e3aa39 None admin] PATH_INFO: `/v3/projects/199292d828144a70992f2344ae63f351` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:27.846902 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dae157-b3c7-493e-818e-583200e3aa39 None admin] RBAC: Authorizing `identity:get_project(project_id=199292d828144a70992f2344ae63f351)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:27.848879 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dae157-b3c7-493e-818e-583200e3aa39 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:27.851812 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 178/359] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 05:16:27 2022] GET /identity/v3/projects/199292d828144a70992f2344ae63f351 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:27.860887 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dae157-b3c7-493e-818e-583200e3aa39 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:27.907776 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02830be9-a0fc-45b5-875d-aac0d3b57b4b None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:27.965160 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af4e1c1-595c-4d9c-a29b-8d582829fec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:27.966704 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af4e1c1-595c-4d9c-a29b-8d582829fec5 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:27.967660 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af4e1c1-595c-4d9c-a29b-8d582829fec5 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:27.968857 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af4e1c1-595c-4d9c-a29b-8d582829fec5 None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:27.969920 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af4e1c1-595c-4d9c-a29b-8d582829fec5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:27.972014 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af4e1c1-595c-4d9c-a29b-8d582829fec5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:27.974123 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af4e1c1-595c-4d9c-a29b-8d582829fec5 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:27.988464 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 182/360] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 11 05:16:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:27.989711 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af4e1c1-595c-4d9c-a29b-8d582829fec5 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:28.006728 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:28.036298 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dae157-b3c7-493e-818e-583200e3aa39 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:28.083402 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9d8d3b-d133-47b4-9720-a209983df216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:28.084125 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d8d3b-d133-47b4-9720-a209983df216 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:28.084408 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d8d3b-d133-47b4-9720-a209983df216 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:28.084795 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d8d3b-d133-47b4-9720-a209983df216 None admin] PATH_INFO: `/v3/groups/cbf562a50e194986adfef41d4a7805d7` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:28.085926 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9d8d3b-d133-47b4-9720-a209983df216 None admin] RBAC: Authorizing `identity:get_group(group_id=cbf562a50e194986adfef41d4a7805d7)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:28.087353 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9d8d3b-d133-47b4-9720-a209983df216 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:28.094487 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 179/361] 10.222.0.16 () {56 vars in 1180 bytes} [Sun Sep 11 05:16:27 2022] GET /identity/v3/groups/cbf562a50e194986adfef41d4a7805d7 => generated 226 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:28.096182 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a8f788-c5c6-4d6a-8534-faafb5099239 None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:28.096476 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a8f788-c5c6-4d6a-8534-faafb5099239 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:28.096749 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a8f788-c5c6-4d6a-8534-faafb5099239 None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:28.098188 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 180/362] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:16:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:16:28.098825 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a8f788-c5c6-4d6a-8534-faafb5099239 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:28.136304 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af4e1c1-595c-4d9c-a29b-8d582829fec5 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:28.166481 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:28.187751 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb38864-84cd-4fcb-9131-a4112c15dcb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:28.188395 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb38864-84cd-4fcb-9131-a4112c15dcb2 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:28.188673 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb38864-84cd-4fcb-9131-a4112c15dcb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:28.188942 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb38864-84cd-4fcb-9131-a4112c15dcb2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:28.200743 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb38864-84cd-4fcb-9131-a4112c15dcb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:16:28.206100 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-afb38864-84cd-4fcb-9131-a4112c15dcb2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 05:16:28.206100 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:16:28.206100 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:16:28.206100 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:16:28.206100 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:16:28.206100 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:16:28.206100 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:16:28.206100 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:16:28.206100 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:16:28.206100 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:16:28.206100 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:16:28.206100 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:16:28.206100 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:16:28.206100 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:16:28.206100 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:16:28.206100 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:16:28.207005 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:16:28.207005 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:16:28.207005 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:16:28.207005 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:16:28.207005 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:16:28.207005 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:16:28.207005 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:16:28.207005 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:16:28.207005 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:16:28.207005 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:16:28.207005 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:16:28.207005 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:16:28.207005 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:16:28.207005 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:16:28.207005 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:16:28.207005 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:16:28.208410 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:16:28.208410 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:16:28.208410 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:16:28.208410 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:16:28.208410 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:16:28.208410 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:16:28.208410 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:16:28.208410 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:16:28.208410 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:16:28.208410 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:16:28.208410 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 05:16:28.208410 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:16:28.208410 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 183/363] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 11 05:16:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:16:28.208410 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb38864-84cd-4fcb-9131-a4112c15dcb2 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:28.239036 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a8f788-c5c6-4d6a-8534-faafb5099239 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:28.284478 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64f2b63-0801-44ab-b15e-03cf7951ea23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:28.285091 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64f2b63-0801-44ab-b15e-03cf7951ea23 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:28.285369 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64f2b63-0801-44ab-b15e-03cf7951ea23 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:28.285634 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64f2b63-0801-44ab-b15e-03cf7951ea23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:28.315872 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:28.335070 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb38864-84cd-4fcb-9131-a4112c15dcb2 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:28.374872 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64f2b63-0801-44ab-b15e-03cf7951ea23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:28.376366 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64f2b63-0801-44ab-b15e-03cf7951ea23 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:28.380199 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35559143-ebfd-4253-8da7-9f0c939ac2c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:28.381368 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35559143-ebfd-4253-8da7-9f0c939ac2c4 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:28.382512 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35559143-ebfd-4253-8da7-9f0c939ac2c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:28.382512 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35559143-ebfd-4253-8da7-9f0c939ac2c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:28.382696 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35559143-ebfd-4253-8da7-9f0c939ac2c4 None admin] RBAC: Adding query filter params (group.id=cbf562a50e194986adfef41d4a7805d7, role.id=ada04449ee1f42599a060f4795ec1a74, scope.project.id=199292d828144a70992f2344ae63f351) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:28.382898 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35559143-ebfd-4253-8da7-9f0c939ac2c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:28.384365 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35559143-ebfd-4253-8da7-9f0c939ac2c4 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:28.391163 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 184/364] 10.222.0.16 () {56 vars in 1376 bytes} [Sun Sep 11 05:16:28 2022] GET /identity/v3/role_assignments?group.id=cbf562a50e194986adfef41d4a7805d7&scope.project.id=199292d828144a70992f2344ae63f351&role.id=ada04449ee1f42599a060f4795ec1a74 => generated 260 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:28.401160 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d052651-1f74-4beb-98e3-67779bbc37bd None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:28.401483 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d052651-1f74-4beb-98e3-67779bbc37bd None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:28.401720 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d052651-1f74-4beb-98e3-67779bbc37bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:28.424875 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-5d052651-1f74-4beb-98e3-67779bbc37bd None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:16:28.426271 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-5d052651-1f74-4beb-98e3-67779bbc37bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:16:28.491756 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:28.519031 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 181/365] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 05:16:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 05:16:28.520258 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64f2b63-0801-44ab-b15e-03cf7951ea23 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:28.525703 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 185/366] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:16:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 05:16:28.528160 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d052651-1f74-4beb-98e3-67779bbc37bd None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:28.597003 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:28.657870 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64f2b63-0801-44ab-b15e-03cf7951ea23 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:28.672590 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d052651-1f74-4beb-98e3-67779bbc37bd None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:28.718069 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87276624-76e6-4cee-87f8-ff2ccba17cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:28.719030 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a06bc-cde1-4494-9331-cb6fdb1fec33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:28.719955 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87276624-76e6-4cee-87f8-ff2ccba17cef None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:28.720822 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a06bc-cde1-4494-9331-cb6fdb1fec33 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:28.721287 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a06bc-cde1-4494-9331-cb6fdb1fec33 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:28.721755 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87276624-76e6-4cee-87f8-ff2ccba17cef None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:28.722455 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87276624-76e6-4cee-87f8-ff2ccba17cef None admin] PATH_INFO: `/v3/projects/ca0a33c848834728909bb4815ac1e8bc` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:28.722756 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a06bc-cde1-4494-9331-cb6fdb1fec33 None admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:28.724220 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2a06bc-cde1-4494-9331-cb6fdb1fec33 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:28.725051 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87276624-76e6-4cee-87f8-ff2ccba17cef None admin] RBAC: Authorizing `identity:get_project(project_id=ca0a33c848834728909bb4815ac1e8bc)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:28.725560 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2a06bc-cde1-4494-9331-cb6fdb1fec33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:28.728299 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2a06bc-cde1-4494-9331-cb6fdb1fec33 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:28.728956 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87276624-76e6-4cee-87f8-ff2ccba17cef None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:28.733830 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 186/367] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 05:16:28 2022] GET /identity/v3/projects/ca0a33c848834728909bb4815ac1e8bc => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:16:28.738229 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87276624-76e6-4cee-87f8-ff2ccba17cef None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:28.749683 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 182/368] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 05:16:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:28.754968 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a06bc-cde1-4494-9331-cb6fdb1fec33 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:28.852263 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:28.877341 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a06bc-cde1-4494-9331-cb6fdb1fec33 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:28.893421 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:28.921519 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216c65b9-99f2-4b2e-886d-78e53701d59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:28.922708 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c65b9-99f2-4b2e-886d-78e53701d59c None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:28.922708 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c65b9-99f2-4b2e-886d-78e53701d59c None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:28.922708 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c65b9-99f2-4b2e-886d-78e53701d59c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:28.946179 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87276624-76e6-4cee-87f8-ff2ccba17cef None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:28.990847 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e19c5fc-1eb8-4557-b7de-89945594f643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:28.991588 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e19c5fc-1eb8-4557-b7de-89945594f643 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:28.991794 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e19c5fc-1eb8-4557-b7de-89945594f643 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:28.992117 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e19c5fc-1eb8-4557-b7de-89945594f643 None admin] PATH_INFO: `/v3/groups/cbf562a50e194986adfef41d4a7805d7` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:28.993201 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e19c5fc-1eb8-4557-b7de-89945594f643 None admin] RBAC: Authorizing `identity:get_group(group_id=cbf562a50e194986adfef41d4a7805d7)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:28.994879 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e19c5fc-1eb8-4557-b7de-89945594f643 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:28.996882 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 187/369] 10.222.0.16 () {56 vars in 1180 bytes} [Sun Sep 11 05:16:28 2022] GET /identity/v3/groups/cbf562a50e194986adfef41d4a7805d7 => generated 226 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:28.997822 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e19c5fc-1eb8-4557-b7de-89945594f643 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:29.010305 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216c65b9-99f2-4b2e-886d-78e53701d59c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:29.013046 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216c65b9-99f2-4b2e-886d-78e53701d59c None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:29.138081 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e19c5fc-1eb8-4557-b7de-89945594f643 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:29.144088 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 183/370] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 05:16:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 05:16:29.150426 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216c65b9-99f2-4b2e-886d-78e53701d59c None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:29.154596 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:29.170974 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:29.187770 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafcb12d-12b7-4515-b83f-27f823bc088d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:29.189094 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafcb12d-12b7-4515-b83f-27f823bc088d None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:29.189525 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafcb12d-12b7-4515-b83f-27f823bc088d None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:29.190203 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafcb12d-12b7-4515-b83f-27f823bc088d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:29.204067 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafcb12d-12b7-4515-b83f-27f823bc088d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:16:29.211605 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-eafcb12d-12b7-4515-b83f-27f823bc088d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 05:16:29.211605 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:16:29.211605 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:16:29.211605 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:16:29.211605 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:16:29.211605 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:16:29.211605 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:16:29.211605 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:16:29.211605 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:16:29.211605 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:16:29.211605 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:16:29.211605 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:16:29.211605 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:16:29.211605 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:16:29.211605 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:16:29.211605 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:16:29.212710 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:16:29.212710 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:16:29.212710 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:16:29.212710 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:16:29.212710 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:16:29.212710 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:16:29.212710 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:16:29.212710 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:16:29.212710 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:16:29.212710 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:16:29.212710 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:16:29.212710 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:16:29.212710 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:16:29.212710 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:16:29.212710 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:16:29.212710 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:16:29.213734 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:16:29.213734 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:16:29.213734 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:16:29.213734 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:16:29.213734 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:16:29.213734 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:16:29.213734 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:16:29.213734 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:16:29.213734 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:16:29.213734 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:16:29.213734 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 05:16:29.213734 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:16:29.215838 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 188/371] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 05:16:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:16:29.216789 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafcb12d-12b7-4515-b83f-27f823bc088d None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:29.272013 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216c65b9-99f2-4b2e-886d-78e53701d59c None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:29.311171 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7319632f-4231-48e8-b688-3b33c4e28787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:29.311930 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7319632f-4231-48e8-b688-3b33c4e28787 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:29.312278 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7319632f-4231-48e8-b688-3b33c4e28787 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:29.312623 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7319632f-4231-48e8-b688-3b33c4e28787 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:29.313458 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7319632f-4231-48e8-b688-3b33c4e28787 None admin] RBAC: Adding query filter params (group.id=cbf562a50e194986adfef41d4a7805d7, role.id=aa7ff8e0ec1e48e5811335b9eb38b448, scope.project.id=ca0a33c848834728909bb4815ac1e8bc) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:29.313834 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7319632f-4231-48e8-b688-3b33c4e28787 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:29.315366 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7319632f-4231-48e8-b688-3b33c4e28787 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:29.323338 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 184/372] 10.222.0.16 () {56 vars in 1376 bytes} [Sun Sep 11 05:16:29 2022] GET /identity/v3/role_assignments?group.id=cbf562a50e194986adfef41d4a7805d7&scope.project.id=ca0a33c848834728909bb4815ac1e8bc&role.id=aa7ff8e0ec1e48e5811335b9eb38b448 => generated 260 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:29.324354 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7319632f-4231-48e8-b688-3b33c4e28787 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:29.346633 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafcb12d-12b7-4515-b83f-27f823bc088d None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:29.395481 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fd4304-7993-4fe1-9a85-18cdcab0b8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:29.396369 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fd4304-7993-4fe1-9a85-18cdcab0b8d0 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:29.396754 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fd4304-7993-4fe1-9a85-18cdcab0b8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:29.397324 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fd4304-7993-4fe1-9a85-18cdcab0b8d0 None admin] PATH_INFO: `/v3/projects/ca0a33c848834728909bb4815ac1e8bc` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:29.398828 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fd4304-7993-4fe1-9a85-18cdcab0b8d0 None admin] RBAC: Authorizing `identity:get_project(project_id=ca0a33c848834728909bb4815ac1e8bc)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:29.400775 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fd4304-7993-4fe1-9a85-18cdcab0b8d0 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:29.403126 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 189/373] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 05:16:29 2022] GET /identity/v3/projects/ca0a33c848834728909bb4815ac1e8bc => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:29.408924 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fd4304-7993-4fe1-9a85-18cdcab0b8d0 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:29.438784 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:29.469261 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:29.498248 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7319632f-4231-48e8-b688-3b33c4e28787 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:29.554439 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fd4304-7993-4fe1-9a85-18cdcab0b8d0 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:29.589466 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9406bc89-1114-4b97-a73e-58137346ed88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:29.590034 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9406bc89-1114-4b97-a73e-58137346ed88 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:29.590315 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9406bc89-1114-4b97-a73e-58137346ed88 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:29.590587 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9406bc89-1114-4b97-a73e-58137346ed88 None admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:29.591252 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9406bc89-1114-4b97-a73e-58137346ed88 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:29.591559 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9406bc89-1114-4b97-a73e-58137346ed88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:29.592950 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9406bc89-1114-4b97-a73e-58137346ed88 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:29.598963 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6897b9-0e29-40b3-8bff-d573d0bea173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:29.600402 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6897b9-0e29-40b3-8bff-d573d0bea173 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:29.600889 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6897b9-0e29-40b3-8bff-d573d0bea173 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:29.601377 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6897b9-0e29-40b3-8bff-d573d0bea173 None admin] PATH_INFO: `/v3/groups/cbf562a50e194986adfef41d4a7805d7` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:29.602730 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6897b9-0e29-40b3-8bff-d573d0bea173 None admin] RBAC: Authorizing `identity:get_group(group_id=cbf562a50e194986adfef41d4a7805d7)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:29.604926 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6897b9-0e29-40b3-8bff-d573d0bea173 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:29.607086 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 190/374] 10.222.0.16 () {56 vars in 1180 bytes} [Sun Sep 11 05:16:29 2022] GET /identity/v3/groups/cbf562a50e194986adfef41d4a7805d7 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:29.613137 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6897b9-0e29-40b3-8bff-d573d0bea173 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:29.614331 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 185/375] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 05:16:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:29.620694 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9406bc89-1114-4b97-a73e-58137346ed88 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:29.749976 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6897b9-0e29-40b3-8bff-d573d0bea173 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:29.751034 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9406bc89-1114-4b97-a73e-58137346ed88 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:29.773267 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:29.794095 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9843c9-4fe3-44df-bbd6-25f999fe5930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:29.794721 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9843c9-4fe3-44df-bbd6-25f999fe5930 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:29.795007 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9843c9-4fe3-44df-bbd6-25f999fe5930 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:29.795384 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9843c9-4fe3-44df-bbd6-25f999fe5930 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:29.807452 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:29.843610 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da108ee2-fec4-4659-b68c-96a78a5efcf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:29.844315 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da108ee2-fec4-4659-b68c-96a78a5efcf4 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:29.844596 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da108ee2-fec4-4659-b68c-96a78a5efcf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:29.844869 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da108ee2-fec4-4659-b68c-96a78a5efcf4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:29.845604 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da108ee2-fec4-4659-b68c-96a78a5efcf4 None admin] RBAC: Adding query filter params (group.id=cbf562a50e194986adfef41d4a7805d7, role.id=ada04449ee1f42599a060f4795ec1a74, scope.project.id=ca0a33c848834728909bb4815ac1e8bc) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:29.845911 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da108ee2-fec4-4659-b68c-96a78a5efcf4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:29.847429 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da108ee2-fec4-4659-b68c-96a78a5efcf4 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:29.863416 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 191/376] 10.222.0.16 () {56 vars in 1376 bytes} [Sun Sep 11 05:16:29 2022] GET /identity/v3/role_assignments?group.id=cbf562a50e194986adfef41d4a7805d7&scope.project.id=ca0a33c848834728909bb4815ac1e8bc&role.id=ada04449ee1f42599a060f4795ec1a74 => generated 260 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:16:29.875869 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9843c9-4fe3-44df-bbd6-25f999fe5930 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:29.877367 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9843c9-4fe3-44df-bbd6-25f999fe5930 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:30.006301 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 186/377] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 05:16:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 11 05:16:30.011709 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da108ee2-fec4-4659-b68c-96a78a5efcf4 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:30.163321 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da108ee2-fec4-4659-b68c-96a78a5efcf4 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:30.205104 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d217f5d-42e8-479e-ba08-e488a4994f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:30.205744 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d217f5d-42e8-479e-ba08-e488a4994f36 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:30.206023 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d217f5d-42e8-479e-ba08-e488a4994f36 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:30.206293 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d217f5d-42e8-479e-ba08-e488a4994f36 None admin] PATH_INFO: `/v3/projects/6b45298f54324df991aa8efd3235c168` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:30.207438 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d217f5d-42e8-479e-ba08-e488a4994f36 None admin] RBAC: Authorizing `identity:get_project(project_id=6b45298f54324df991aa8efd3235c168)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:30.209446 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d217f5d-42e8-479e-ba08-e488a4994f36 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:30.212374 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 192/378] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 05:16:30 2022] GET /identity/v3/projects/6b45298f54324df991aa8efd3235c168 => generated 344 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:30.217393 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9843c9-4fe3-44df-bbd6-25f999fe5930 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:30.280122 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:30.352762 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9843c9-4fe3-44df-bbd6-25f999fe5930 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:30.390535 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18added3-b8a2-45ad-a7ec-b51ac73c80e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:30.391178 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18added3-b8a2-45ad-a7ec-b51ac73c80e5 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:30.391453 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18added3-b8a2-45ad-a7ec-b51ac73c80e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:30.391748 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18added3-b8a2-45ad-a7ec-b51ac73c80e5 None admin] PATH_INFO: `/v3/groups/3e591f1865e3459ba556544f72621dac` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:30.397494 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18added3-b8a2-45ad-a7ec-b51ac73c80e5 None admin] RBAC: Authorizing `identity:get_group(group_id=3e591f1865e3459ba556544f72621dac)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:30.398966 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18added3-b8a2-45ad-a7ec-b51ac73c80e5 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:30.400882 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 187/379] 10.222.0.16 () {56 vars in 1180 bytes} [Sun Sep 11 05:16:30 2022] GET /identity/v3/groups/3e591f1865e3459ba556544f72621dac => generated 229 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:30.406621 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d217f5d-42e8-479e-ba08-e488a4994f36 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:30.441441 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94bea7b-d95f-4443-aa5b-3db5e360c7e7 None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:30.441755 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94bea7b-d95f-4443-aa5b-3db5e360c7e7 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:30.441988 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94bea7b-d95f-4443-aa5b-3db5e360c7e7 None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:30.443407 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 188/380] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:16:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 05:16:30.448803 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9326333-a2a1-459a-a636-55c205ec0156 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:30.449089 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9326333-a2a1-459a-a636-55c205ec0156 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:30.449359 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9326333-a2a1-459a-a636-55c205ec0156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:30.460000 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:30.473956 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-d9326333-a2a1-459a-a636-55c205ec0156 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:16:30.475407 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-d9326333-a2a1-459a-a636-55c205ec0156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:16:30.551482 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d217f5d-42e8-479e-ba08-e488a4994f36 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:30.570698 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 189/381] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:16:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 05:16:30.602422 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e908d62e-f692-4e24-8e0d-affb2909ef92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:30.603435 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e908d62e-f692-4e24-8e0d-affb2909ef92 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:30.603933 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e908d62e-f692-4e24-8e0d-affb2909ef92 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:30.604398 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e908d62e-f692-4e24-8e0d-affb2909ef92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:30.605328 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e908d62e-f692-4e24-8e0d-affb2909ef92 None admin] RBAC: Adding query filter params (group.id=3e591f1865e3459ba556544f72621dac, role.id=5b702713e40145b49e0b42abd0a5fba9, scope.project.id=6b45298f54324df991aa8efd3235c168) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:30.605873 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e908d62e-f692-4e24-8e0d-affb2909ef92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:30.607510 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e908d62e-f692-4e24-8e0d-affb2909ef92 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:30.614319 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 193/382] 10.222.0.16 () {56 vars in 1376 bytes} [Sun Sep 11 05:16:30 2022] GET /identity/v3/role_assignments?group.id=3e591f1865e3459ba556544f72621dac&scope.project.id=6b45298f54324df991aa8efd3235c168&role.id=5b702713e40145b49e0b42abd0a5fba9 => generated 260 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:30.897423 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9326333-a2a1-459a-a636-55c205ec0156 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:30.944161 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:31.035014 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9326333-a2a1-459a-a636-55c205ec0156 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:31.061643 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed77c32-2c36-4b4d-b4ab-08952a144a5d None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:31.062143 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed77c32-2c36-4b4d-b4ab-08952a144a5d None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:31.062217 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed77c32-2c36-4b4d-b4ab-08952a144a5d None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:31.063948 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 194/383] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:16:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:16:31.069742 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b0dd3-d555-4879-afa6-3905705c452f None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:31.070026 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b0dd3-d555-4879-afa6-3905705c452f None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:31.070296 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b0dd3-d555-4879-afa6-3905705c452f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:31.090697 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9b5f91-4b7a-4fed-917c-38830f5b8c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:31.091400 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-380b0dd3-d555-4879-afa6-3905705c452f None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:16:31.091999 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b5f91-4b7a-4fed-917c-38830f5b8c6a None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:31.092487 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b5f91-4b7a-4fed-917c-38830f5b8c6a None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:31.092656 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-380b0dd3-d555-4879-afa6-3905705c452f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:16:31.093127 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b5f91-4b7a-4fed-917c-38830f5b8c6a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:31.106269 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9b5f91-4b7a-4fed-917c-38830f5b8c6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:16:31.112101 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-cf9b5f91-4b7a-4fed-917c-38830f5b8c6a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 05:16:31.112101 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:16:31.112101 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:16:31.112101 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:16:31.112101 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:16:31.112101 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:16:31.112101 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:16:31.112101 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:16:31.112101 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:16:31.112101 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:16:31.112101 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:16:31.112101 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:16:31.112101 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:16:31.112101 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:16:31.112101 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:16:31.112101 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:16:31.112978 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:16:31.112978 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:16:31.112978 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:16:31.112978 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:16:31.112978 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:16:31.112978 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:16:31.112978 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:16:31.112978 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:16:31.112978 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:16:31.112978 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:16:31.112978 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:16:31.112978 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:16:31.112978 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:16:31.112978 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:16:31.112978 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:16:31.112978 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:16:31.113761 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:16:31.113761 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:16:31.113761 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:16:31.113761 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:16:31.113761 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:16:31.113761 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:16:31.113761 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:16:31.113761 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:16:31.113761 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:16:31.113761 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:16:31.113761 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 05:16:31.113761 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:16:31.117493 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 190/384] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 05:16:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:16:31.123937 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9b5f91-4b7a-4fed-917c-38830f5b8c6a None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:31.207102 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 195/385] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:16:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 05:16:31.251950 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:31.261324 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9b5f91-4b7a-4fed-917c-38830f5b8c6a None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:31.297685 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187daddf-0964-4bc4-a6eb-fa7103b8de69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:31.298738 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187daddf-0964-4bc4-a6eb-fa7103b8de69 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:31.299220 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187daddf-0964-4bc4-a6eb-fa7103b8de69 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:31.299726 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187daddf-0964-4bc4-a6eb-fa7103b8de69 None admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:31.300578 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187daddf-0964-4bc4-a6eb-fa7103b8de69 None admin] RBAC: Adding query filter params (name=member) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:31.301073 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187daddf-0964-4bc4-a6eb-fa7103b8de69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:31.302675 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187daddf-0964-4bc4-a6eb-fa7103b8de69 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:31.311552 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 191/386] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 11 05:16:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:31.317684 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b0dd3-d555-4879-afa6-3905705c452f None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:31.369672 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:31.448437 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b0dd3-d555-4879-afa6-3905705c452f None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:31.492731 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c7ff33-0a7e-4115-8793-874aedeb2d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:31.493290 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c7ff33-0a7e-4115-8793-874aedeb2d80 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:31.493565 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c7ff33-0a7e-4115-8793-874aedeb2d80 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:31.493836 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c7ff33-0a7e-4115-8793-874aedeb2d80 None admin] PATH_INFO: `/v3/groups/cbf562a50e194986adfef41d4a7805d7` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:31.494965 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c7ff33-0a7e-4115-8793-874aedeb2d80 None admin] RBAC: Authorizing `identity:get_group(group_id=cbf562a50e194986adfef41d4a7805d7)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:31.496446 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c7ff33-0a7e-4115-8793-874aedeb2d80 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:31.498177 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 196/387] 10.222.0.16 () {56 vars in 1180 bytes} [Sun Sep 11 05:16:31 2022] GET /identity/v3/groups/cbf562a50e194986adfef41d4a7805d7 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:31.503891 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187daddf-0964-4bc4-a6eb-fa7103b8de69 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:31.632339 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c7ff33-0a7e-4115-8793-874aedeb2d80 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:31.647894 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187daddf-0964-4bc4-a6eb-fa7103b8de69 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:31.692428 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cba0a0-6539-4284-b032-891c3aaefe80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:31.693211 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cba0a0-6539-4284-b032-891c3aaefe80 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:31.693731 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cba0a0-6539-4284-b032-891c3aaefe80 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:31.694011 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cba0a0-6539-4284-b032-891c3aaefe80 None admin] PATH_INFO: `/v3/projects/199292d828144a70992f2344ae63f351` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:31.699577 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cba0a0-6539-4284-b032-891c3aaefe80 None admin] RBAC: Authorizing `identity:get_project(project_id=199292d828144a70992f2344ae63f351)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:31.701056 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cba0a0-6539-4284-b032-891c3aaefe80 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:31.704682 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 192/388] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 05:16:31 2022] GET /identity/v3/projects/199292d828144a70992f2344ae63f351 => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:31.709903 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cba0a0-6539-4284-b032-891c3aaefe80 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:31.755321 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:31.828716 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c7ff33-0a7e-4115-8793-874aedeb2d80 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:31.835576 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:31.884669 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f166b839-19e6-4843-99cb-135ffec58bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:31.885331 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f166b839-19e6-4843-99cb-135ffec58bd1 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:31.885842 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f166b839-19e6-4843-99cb-135ffec58bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:31.886122 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f166b839-19e6-4843-99cb-135ffec58bd1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:31.899410 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cba0a0-6539-4284-b032-891c3aaefe80 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:31.900933 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f166b839-19e6-4843-99cb-135ffec58bd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:16:31.906678 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-f166b839-19e6-4843-99cb-135ffec58bd1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 05:16:31.906678 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:16:31.906678 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:16:31.906678 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:16:31.906678 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:16:31.906678 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:16:31.906678 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:16:31.906678 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:16:31.906678 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:16:31.906678 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:16:31.906678 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:16:31.906678 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:16:31.906678 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:16:31.906678 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:16:31.906678 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:16:31.906678 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:16:31.907560 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:16:31.907560 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:16:31.907560 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:16:31.907560 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:16:31.907560 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:16:31.907560 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:16:31.907560 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:16:31.907560 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:16:31.907560 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:16:31.907560 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:16:31.907560 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:16:31.907560 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:16:31.907560 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:16:31.907560 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:16:31.907560 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:16:31.907560 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:16:31.908409 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:16:31.908409 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:16:31.908409 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:16:31.908409 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:16:31.908409 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:16:31.908409 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:16:31.908409 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:16:31.908409 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:16:31.908409 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:16:31.908409 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:16:31.908409 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 05:16:31.908409 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:16:31.909036 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 197/389] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 11 05:16:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:16:31.916243 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f166b839-19e6-4843-99cb-135ffec58bd1 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:31.964156 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd1896-5c6b-4d6d-901b-d9232139be6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:31.965253 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd1896-5c6b-4d6d-901b-d9232139be6c None admin] REQUEST_METHOD: `PUT` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:31.966477 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd1896-5c6b-4d6d-901b-d9232139be6c None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:31.967524 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd1896-5c6b-4d6d-901b-d9232139be6c None admin] PATH_INFO: `/v3/projects/199292d828144a70992f2344ae63f351/groups/cbf562a50e194986adfef41d4a7805d7/roles/aa7ff8e0ec1e48e5811335b9eb38b448` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:31.972065 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fd1896-5c6b-4d6d-901b-d9232139be6c None admin] RBAC: Authorizing `identity:create_grant(project_id=199292d828144a70992f2344ae63f351, group_id=cbf562a50e194986adfef41d4a7805d7, role_id=aa7ff8e0ec1e48e5811335b9eb38b448)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:31.974809 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fd1896-5c6b-4d6d-901b-d9232139be6c None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:32.000116 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 193/390] 10.222.0.16 () {58 vars in 1442 bytes} [Sun Sep 11 05:16:31 2022] PUT /identity/v3/projects/199292d828144a70992f2344ae63f351/groups/cbf562a50e194986adfef41d4a7805d7/roles/aa7ff8e0ec1e48e5811335b9eb38b448 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 05:16:32.077773 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f166b839-19e6-4843-99cb-135ffec58bd1 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:32.126966 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece9a5b3-5f07-4b97-8227-fc257fd4311b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:32.127868 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece9a5b3-5f07-4b97-8227-fc257fd4311b None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:32.128306 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece9a5b3-5f07-4b97-8227-fc257fd4311b None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:32.128729 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece9a5b3-5f07-4b97-8227-fc257fd4311b None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:32.129555 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece9a5b3-5f07-4b97-8227-fc257fd4311b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:32.130008 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece9a5b3-5f07-4b97-8227-fc257fd4311b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:32.132100 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece9a5b3-5f07-4b97-8227-fc257fd4311b None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:32.147732 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 198/391] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 05:16:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:16:32.153932 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd1896-5c6b-4d6d-901b-d9232139be6c None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:32.264078 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:32.285103 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd1896-5c6b-4d6d-901b-d9232139be6c None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:32.326937 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcc3f89-0eaf-426e-88f8-a9286e4f7d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:32.327919 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc3f89-0eaf-426e-88f8-a9286e4f7d1a None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:32.328358 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc3f89-0eaf-426e-88f8-a9286e4f7d1a None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:32.328785 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc3f89-0eaf-426e-88f8-a9286e4f7d1a None admin] PATH_INFO: `/v3/groups/cbf562a50e194986adfef41d4a7805d7` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:32.330051 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcc3f89-0eaf-426e-88f8-a9286e4f7d1a None admin] RBAC: Authorizing `identity:get_group(group_id=cbf562a50e194986adfef41d4a7805d7)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:32.331635 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcc3f89-0eaf-426e-88f8-a9286e4f7d1a None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:32.333391 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 194/392] 10.222.0.16 () {56 vars in 1180 bytes} [Sun Sep 11 05:16:32 2022] GET /identity/v3/groups/cbf562a50e194986adfef41d4a7805d7 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:32.339137 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece9a5b3-5f07-4b97-8227-fc257fd4311b None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:32.359868 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1eea16-bc85-4da4-a682-701c78513dce None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:32.360146 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1eea16-bc85-4da4-a682-701c78513dce None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:32.360420 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1eea16-bc85-4da4-a682-701c78513dce None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:32.362182 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 195/393] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:16:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 05:16:32.368929 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c255aac-ba67-4ed0-9dbd-b79782500157 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:32.369213 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c255aac-ba67-4ed0-9dbd-b79782500157 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:32.369486 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c255aac-ba67-4ed0-9dbd-b79782500157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:32.375004 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:32.397298 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-4c255aac-ba67-4ed0-9dbd-b79782500157 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:16:32.398601 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-4c255aac-ba67-4ed0-9dbd-b79782500157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:16:32.502070 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 196/394] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:16:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 05:16:32.502476 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece9a5b3-5f07-4b97-8227-fc257fd4311b None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:32.558225 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0d7c8a-2a6e-45d3-8b1c-08cf622a1c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:32.558871 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d7c8a-2a6e-45d3-8b1c-08cf622a1c00 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:32.559147 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d7c8a-2a6e-45d3-8b1c-08cf622a1c00 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:32.559417 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d7c8a-2a6e-45d3-8b1c-08cf622a1c00 None admin] PATH_INFO: `/v3/projects/199292d828144a70992f2344ae63f351` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:32.560642 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0d7c8a-2a6e-45d3-8b1c-08cf622a1c00 None admin] RBAC: Authorizing `identity:get_project(project_id=199292d828144a70992f2344ae63f351)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:32.562092 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0d7c8a-2a6e-45d3-8b1c-08cf622a1c00 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:32.564023 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 199/395] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 05:16:32 2022] GET /identity/v3/projects/199292d828144a70992f2344ae63f351 => generated 298 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:32.570323 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c255aac-ba67-4ed0-9dbd-b79782500157 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:32.668010 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:32.691941 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c255aac-ba67-4ed0-9dbd-b79782500157 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:32.736318 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b03115-3dbd-4dd6-95ee-18e8c295bee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:32.736991 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b03115-3dbd-4dd6-95ee-18e8c295bee3 None admin] REQUEST_METHOD: `PUT` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:32.737272 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b03115-3dbd-4dd6-95ee-18e8c295bee3 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:32.737546 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b03115-3dbd-4dd6-95ee-18e8c295bee3 None admin] PATH_INFO: `/v3/projects/199292d828144a70992f2344ae63f351/groups/cbf562a50e194986adfef41d4a7805d7/roles/ada04449ee1f42599a060f4795ec1a74` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:32.739670 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b03115-3dbd-4dd6-95ee-18e8c295bee3 None admin] RBAC: Authorizing `identity:create_grant(project_id=199292d828144a70992f2344ae63f351, group_id=cbf562a50e194986adfef41d4a7805d7, role_id=ada04449ee1f42599a060f4795ec1a74)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:32.741959 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b03115-3dbd-4dd6-95ee-18e8c295bee3 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:32.766039 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 197/396] 10.222.0.16 () {58 vars in 1442 bytes} [Sun Sep 11 05:16:32 2022] PUT /identity/v3/projects/199292d828144a70992f2344ae63f351/groups/cbf562a50e194986adfef41d4a7805d7/roles/ada04449ee1f42599a060f4795ec1a74 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:16:32.925928 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0d7c8a-2a6e-45d3-8b1c-08cf622a1c00 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:33.010726 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc17980-4019-49d8-8d3a-409750944d29 None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:33.011355 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc17980-4019-49d8-8d3a-409750944d29 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:33.011918 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc17980-4019-49d8-8d3a-409750944d29 None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:33.013468 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 198/397] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:16:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 05:16:33.019771 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da3cd82-17dc-447c-884f-059dce24b7d3 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:33.020056 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da3cd82-17dc-447c-884f-059dce24b7d3 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:33.020328 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da3cd82-17dc-447c-884f-059dce24b7d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:33.046668 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-9da3cd82-17dc-447c-884f-059dce24b7d3 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:16:33.048271 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-9da3cd82-17dc-447c-884f-059dce24b7d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:16:33.054859 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:33.064062 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0d7c8a-2a6e-45d3-8b1c-08cf622a1c00 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:33.104431 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9d61fa-5c8a-4284-abaf-7a23176d0c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:33.105046 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d61fa-5c8a-4284-abaf-7a23176d0c10 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:33.105330 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d61fa-5c8a-4284-abaf-7a23176d0c10 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:33.105602 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d61fa-5c8a-4284-abaf-7a23176d0c10 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:33.124478 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9d61fa-5c8a-4284-abaf-7a23176d0c10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:16:33.130060 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-cf9d61fa-5c8a-4284-abaf-7a23176d0c10 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 05:16:33.130060 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:16:33.130060 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:16:33.130060 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:16:33.130060 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:16:33.130060 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:16:33.130060 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:16:33.130060 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:16:33.130060 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:16:33.130060 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:16:33.130060 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:16:33.130060 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:16:33.130060 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:16:33.130060 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:16:33.130060 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:16:33.130060 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:16:33.131489 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:16:33.131489 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:16:33.131489 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:16:33.131489 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:16:33.131489 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:16:33.131489 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:16:33.131489 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:16:33.131489 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:16:33.131489 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:16:33.131489 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:16:33.131489 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:16:33.131489 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:16:33.131489 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:16:33.131489 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:16:33.131489 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:16:33.131489 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:16:33.132321 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:16:33.132321 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:16:33.132321 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:16:33.132321 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:16:33.132321 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:16:33.132321 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:16:33.132321 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:16:33.132321 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:16:33.132321 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:16:33.132321 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:16:33.132321 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 05:16:33.132321 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:16:33.132321 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 200/398] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 05:16:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:16:33.137474 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9d61fa-5c8a-4284-abaf-7a23176d0c10 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:33.141086 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 199/399] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:16:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 05:16:33.246594 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9d61fa-5c8a-4284-abaf-7a23176d0c10 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:33.283477 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40855fbc-7c1e-4701-9c38-e77feeef088f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:33.284448 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40855fbc-7c1e-4701-9c38-e77feeef088f None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:33.284911 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40855fbc-7c1e-4701-9c38-e77feeef088f None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:33.285378 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40855fbc-7c1e-4701-9c38-e77feeef088f None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:33.286228 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40855fbc-7c1e-4701-9c38-e77feeef088f None admin] RBAC: Adding query filter params (name=member) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:33.286699 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40855fbc-7c1e-4701-9c38-e77feeef088f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:33.288349 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40855fbc-7c1e-4701-9c38-e77feeef088f None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:33.297355 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 201/400] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 11 05:16:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:16:33.303762 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da3cd82-17dc-447c-884f-059dce24b7d3 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:33.408936 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:33.455566 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da3cd82-17dc-447c-884f-059dce24b7d3 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:33.518458 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948769c6-dbc6-4a0e-a1a7-b7fcd1e8febe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:33.519040 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948769c6-dbc6-4a0e-a1a7-b7fcd1e8febe None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:33.519315 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948769c6-dbc6-4a0e-a1a7-b7fcd1e8febe None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:33.519586 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948769c6-dbc6-4a0e-a1a7-b7fcd1e8febe None admin] PATH_INFO: `/v3/groups/cbf562a50e194986adfef41d4a7805d7` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:33.524529 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948769c6-dbc6-4a0e-a1a7-b7fcd1e8febe None admin] RBAC: Authorizing `identity:get_group(group_id=cbf562a50e194986adfef41d4a7805d7)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:33.526022 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948769c6-dbc6-4a0e-a1a7-b7fcd1e8febe None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:33.528306 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 200/401] 10.222.0.16 () {56 vars in 1180 bytes} [Sun Sep 11 05:16:33 2022] GET /identity/v3/groups/cbf562a50e194986adfef41d4a7805d7 => generated 226 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:33.533924 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40855fbc-7c1e-4701-9c38-e77feeef088f None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:33.567312 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:33.579772 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948769c6-dbc6-4a0e-a1a7-b7fcd1e8febe None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:33.688833 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40855fbc-7c1e-4701-9c38-e77feeef088f None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:33.699544 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948769c6-dbc6-4a0e-a1a7-b7fcd1e8febe None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:33.729733 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6348f330-7b94-48ca-b0c2-d20babb3aece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:33.730835 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6348f330-7b94-48ca-b0c2-d20babb3aece None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:33.731356 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6348f330-7b94-48ca-b0c2-d20babb3aece None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:33.731901 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6348f330-7b94-48ca-b0c2-d20babb3aece None admin] PATH_INFO: `/v3/projects/ca0a33c848834728909bb4815ac1e8bc` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:33.734145 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6348f330-7b94-48ca-b0c2-d20babb3aece None admin] RBAC: Authorizing `identity:get_project(project_id=ca0a33c848834728909bb4815ac1e8bc)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:33.734795 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6348f330-7b94-48ca-b0c2-d20babb3aece None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:33.741588 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 202/402] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 05:16:33 2022] GET /identity/v3/projects/ca0a33c848834728909bb4815ac1e8bc => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:33.741588 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a28e071-91a1-46df-8062-ab96049f7fc1 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:33.741588 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a28e071-91a1-46df-8062-ab96049f7fc1 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:33.741588 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a28e071-91a1-46df-8062-ab96049f7fc1 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:33.741588 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 203/403] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:16:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:16:33.742480 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a28e071-91a1-46df-8062-ab96049f7fc1 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:33.744120 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e57288-1d54-4963-b78d-46e6d7be426e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:33.745013 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e57288-1d54-4963-b78d-46e6d7be426e None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:33.745818 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e57288-1d54-4963-b78d-46e6d7be426e None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:33.747275 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e57288-1d54-4963-b78d-46e6d7be426e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:33.759115 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:33.772130 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e57288-1d54-4963-b78d-46e6d7be426e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:16:33.780054 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-68e57288-1d54-4963-b78d-46e6d7be426e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 05:16:33.780054 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:16:33.780054 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:16:33.780054 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:16:33.780054 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:16:33.780054 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:16:33.780054 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:16:33.780054 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:16:33.780054 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:16:33.780054 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:16:33.780054 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:16:33.780054 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:16:33.780054 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:16:33.780054 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:16:33.780054 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:16:33.780054 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:16:33.780977 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:16:33.780977 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:16:33.780977 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:16:33.780977 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:16:33.780977 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:16:33.780977 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:16:33.780977 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:16:33.780977 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:16:33.780977 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:16:33.780977 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:16:33.780977 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:16:33.780977 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:16:33.780977 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:16:33.780977 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:16:33.780977 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:16:33.780977 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:16:33.781801 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:16:33.781801 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:16:33.781801 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:16:33.781801 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:16:33.781801 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:16:33.781801 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:16:33.781801 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:16:33.781801 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:16:33.781801 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:16:33.781801 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:16:33.781801 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 05:16:33.781801 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:16:33.784420 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 201/404] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 11 05:16:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:16:33.785805 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae1674-9c96-474f-9861-b7b473577240 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:33.786089 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae1674-9c96-474f-9861-b7b473577240 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:33.786360 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae1674-9c96-474f-9861-b7b473577240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:33.812080 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-e8ae1674-9c96-474f-9861-b7b473577240 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:16:33.813789 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-e8ae1674-9c96-474f-9861-b7b473577240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:16:33.853169 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:33.873177 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a28e071-91a1-46df-8062-ab96049f7fc1 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:33.903188 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 202/405] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:16:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 05:16:33.904361 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ae1674-9c96-474f-9861-b7b473577240 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:33.920377 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d8c505-e7bf-4b2e-a512-e12b70e7fd41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:33.921614 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d8c505-e7bf-4b2e-a512-e12b70e7fd41 None admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:33.922651 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d8c505-e7bf-4b2e-a512-e12b70e7fd41 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:33.923455 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d8c505-e7bf-4b2e-a512-e12b70e7fd41 None admin] PATH_INFO: `/v3/projects/ca0a33c848834728909bb4815ac1e8bc/groups/cbf562a50e194986adfef41d4a7805d7/roles/aa7ff8e0ec1e48e5811335b9eb38b448` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:33.926320 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d8c505-e7bf-4b2e-a512-e12b70e7fd41 None admin] RBAC: Authorizing `identity:create_grant(project_id=ca0a33c848834728909bb4815ac1e8bc, group_id=cbf562a50e194986adfef41d4a7805d7, role_id=aa7ff8e0ec1e48e5811335b9eb38b448)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:33.928234 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d8c505-e7bf-4b2e-a512-e12b70e7fd41 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:33.947651 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 204/406] 10.222.0.16 () {58 vars in 1442 bytes} [Sun Sep 11 05:16:33 2022] PUT /identity/v3/projects/ca0a33c848834728909bb4815ac1e8bc/groups/cbf562a50e194986adfef41d4a7805d7/roles/aa7ff8e0ec1e48e5811335b9eb38b448 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:16:34.026331 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ae1674-9c96-474f-9861-b7b473577240 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:34.058431 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:34.065425 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f5f7fe-d254-4137-a5e6-f505e53e2eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:34.066067 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f5f7fe-d254-4137-a5e6-f505e53e2eec None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:34.066346 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f5f7fe-d254-4137-a5e6-f505e53e2eec None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:34.066623 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f5f7fe-d254-4137-a5e6-f505e53e2eec None admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:34.067310 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f5f7fe-d254-4137-a5e6-f505e53e2eec None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:34.067621 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f5f7fe-d254-4137-a5e6-f505e53e2eec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:34.069140 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f5f7fe-d254-4137-a5e6-f505e53e2eec None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:34.079145 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 203/407] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 05:16:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:34.085307 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d8c505-e7bf-4b2e-a512-e12b70e7fd41 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:34.219707 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f5f7fe-d254-4137-a5e6-f505e53e2eec None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:34.233571 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d8c505-e7bf-4b2e-a512-e12b70e7fd41 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:34.272380 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511d0164-d373-4a25-acc2-e3e801927992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:34.273026 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511d0164-d373-4a25-acc2-e3e801927992 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:34.273307 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511d0164-d373-4a25-acc2-e3e801927992 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:34.273583 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511d0164-d373-4a25-acc2-e3e801927992 None admin] PATH_INFO: `/v3/groups/cbf562a50e194986adfef41d4a7805d7` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:34.274816 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511d0164-d373-4a25-acc2-e3e801927992 None admin] RBAC: Authorizing `identity:get_group(group_id=cbf562a50e194986adfef41d4a7805d7)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:34.276329 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511d0164-d373-4a25-acc2-e3e801927992 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:34.278305 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 205/408] 10.222.0.16 () {56 vars in 1180 bytes} [Sun Sep 11 05:16:34 2022] GET /identity/v3/groups/cbf562a50e194986adfef41d4a7805d7 => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:34.283519 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511d0164-d373-4a25-acc2-e3e801927992 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:34.305281 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:34.399846 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f5f7fe-d254-4137-a5e6-f505e53e2eec None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:34.464640 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511d0164-d373-4a25-acc2-e3e801927992 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:34.476442 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932343de-2f44-47fd-9689-ba79562f7445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:34.477105 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932343de-2f44-47fd-9689-ba79562f7445 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:34.477386 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932343de-2f44-47fd-9689-ba79562f7445 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:34.477644 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932343de-2f44-47fd-9689-ba79562f7445 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:34.493033 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932343de-2f44-47fd-9689-ba79562f7445 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:16:34.497899 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-932343de-2f44-47fd-9689-ba79562f7445 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 05:16:34.497899 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:16:34.497899 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:16:34.497899 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:16:34.497899 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:16:34.497899 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:16:34.497899 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:16:34.497899 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:16:34.497899 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:16:34.497899 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:16:34.497899 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:16:34.497899 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:16:34.497899 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:16:34.497899 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:16:34.497899 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:16:34.497899 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:16:34.498762 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:16:34.498762 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:16:34.498762 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:16:34.498762 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:16:34.498762 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:16:34.498762 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:16:34.498762 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:16:34.498762 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:16:34.498762 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:16:34.498762 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:16:34.498762 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:16:34.498762 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:16:34.498762 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:16:34.498762 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:16:34.498762 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:16:34.498762 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:16:34.499532 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:16:34.499532 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:16:34.499532 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:16:34.499532 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:16:34.499532 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:16:34.499532 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:16:34.499532 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:16:34.499532 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:16:34.499532 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:16:34.499532 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:16:34.499532 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 05:16:34.499532 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:16:34.501537 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e766af8c-a635-459b-aa76-046be0c95a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:34.502169 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e766af8c-a635-459b-aa76-046be0c95a7f None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:34.502452 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e766af8c-a635-459b-aa76-046be0c95a7f None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:34.502727 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e766af8c-a635-459b-aa76-046be0c95a7f None admin] PATH_INFO: `/v3/projects/ca0a33c848834728909bb4815ac1e8bc` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:34.503893 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e766af8c-a635-459b-aa76-046be0c95a7f None admin] RBAC: Authorizing `identity:get_project(project_id=ca0a33c848834728909bb4815ac1e8bc)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:34.505362 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e766af8c-a635-459b-aa76-046be0c95a7f None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:34.507846 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 206/409] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 05:16:34 2022] GET /identity/v3/projects/ca0a33c848834728909bb4815ac1e8bc => generated 302 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:16:34.508025 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 204/410] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 05:16:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 05:16:34.516608 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e766af8c-a635-459b-aa76-046be0c95a7f None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:34.516740 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932343de-2f44-47fd-9689-ba79562f7445 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:34.607890 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:34.666652 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:34.677918 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932343de-2f44-47fd-9689-ba79562f7445 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:34.701799 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e766af8c-a635-459b-aa76-046be0c95a7f None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:34.719221 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c4df2d-6dd6-46a8-895c-0582f9eac561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:34.719221 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c4df2d-6dd6-46a8-895c-0582f9eac561 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:34.719221 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c4df2d-6dd6-46a8-895c-0582f9eac561 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:34.719221 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c4df2d-6dd6-46a8-895c-0582f9eac561 None admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:34.719716 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c4df2d-6dd6-46a8-895c-0582f9eac561 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:34.719716 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c4df2d-6dd6-46a8-895c-0582f9eac561 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:34.719716 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c4df2d-6dd6-46a8-895c-0582f9eac561 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:34.729317 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 205/411] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 05:16:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:34.737313 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c4df2d-6dd6-46a8-895c-0582f9eac561 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:34.774266 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f774f46-4cc3-47a9-87ae-eb6adf74f902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:34.775485 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f774f46-4cc3-47a9-87ae-eb6adf74f902 None admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:34.776243 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f774f46-4cc3-47a9-87ae-eb6adf74f902 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:34.776670 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f774f46-4cc3-47a9-87ae-eb6adf74f902 None admin] PATH_INFO: `/v3/projects/ca0a33c848834728909bb4815ac1e8bc/groups/cbf562a50e194986adfef41d4a7805d7/roles/ada04449ee1f42599a060f4795ec1a74` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:34.789090 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f774f46-4cc3-47a9-87ae-eb6adf74f902 None admin] RBAC: Authorizing `identity:create_grant(project_id=ca0a33c848834728909bb4815ac1e8bc, group_id=cbf562a50e194986adfef41d4a7805d7, role_id=ada04449ee1f42599a060f4795ec1a74)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:34.790752 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f774f46-4cc3-47a9-87ae-eb6adf74f902 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:34.819936 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 207/412] 10.222.0.16 () {58 vars in 1442 bytes} [Sun Sep 11 05:16:34 2022] PUT /identity/v3/projects/ca0a33c848834728909bb4815ac1e8bc/groups/cbf562a50e194986adfef41d4a7805d7/roles/ada04449ee1f42599a060f4795ec1a74 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:16:34.880143 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c4df2d-6dd6-46a8-895c-0582f9eac561 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:34.895852 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:34.929001 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ee51cb-09bf-40d8-b39e-cea4245915b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:34.929981 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee51cb-09bf-40d8-b39e-cea4245915b1 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:34.930436 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee51cb-09bf-40d8-b39e-cea4245915b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:34.930914 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee51cb-09bf-40d8-b39e-cea4245915b1 None admin] PATH_INFO: `/v3/groups/3e591f1865e3459ba556544f72621dac` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:34.936663 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ee51cb-09bf-40d8-b39e-cea4245915b1 None admin] RBAC: Authorizing `identity:get_group(group_id=3e591f1865e3459ba556544f72621dac)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:34.938495 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ee51cb-09bf-40d8-b39e-cea4245915b1 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:34.940854 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 206/413] 10.222.0.16 () {56 vars in 1180 bytes} [Sun Sep 11 05:16:34 2022] GET /identity/v3/groups/3e591f1865e3459ba556544f72621dac => generated 229 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:16:34.946820 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f774f46-4cc3-47a9-87ae-eb6adf74f902 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:35.089980 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e07baf-0035-451a-bfad-c4dfcb736ba2 None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:35.090323 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e07baf-0035-451a-bfad-c4dfcb736ba2 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:35.090521 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e07baf-0035-451a-bfad-c4dfcb736ba2 None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:35.092139 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 207/414] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:16:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 05:16:35.094379 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f774f46-4cc3-47a9-87ae-eb6adf74f902 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:35.101611 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a920d890-e1a0-4173-9aac-8ffbcaff52c2 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:35.102196 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a920d890-e1a0-4173-9aac-8ffbcaff52c2 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:35.102647 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a920d890-e1a0-4173-9aac-8ffbcaff52c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:35.124369 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-a920d890-e1a0-4173-9aac-8ffbcaff52c2 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:16:35.125877 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-a920d890-e1a0-4173-9aac-8ffbcaff52c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:16:35.138234 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88ea2d2-da19-450f-8657-0273b874383b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:35.138586 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ea2d2-da19-450f-8657-0273b874383b None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:35.138871 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ea2d2-da19-450f-8657-0273b874383b None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:35.139143 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ea2d2-da19-450f-8657-0273b874383b None admin] PATH_INFO: `/v3/projects/6b45298f54324df991aa8efd3235c168` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:35.140385 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88ea2d2-da19-450f-8657-0273b874383b None admin] RBAC: Authorizing `identity:get_project(project_id=6b45298f54324df991aa8efd3235c168)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:35.142002 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88ea2d2-da19-450f-8657-0273b874383b None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:35.144357 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 208/415] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 05:16:34 2022] GET /identity/v3/projects/6b45298f54324df991aa8efd3235c168 => generated 344 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:35.153239 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88ea2d2-da19-450f-8657-0273b874383b None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:35.165909 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:35.249478 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 208/416] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:16:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 05:16:35.292918 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88ea2d2-da19-450f-8657-0273b874383b None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:35.331440 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b91e990-cb01-48bd-9138-f9f6cf21af00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:35.332357 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b91e990-cb01-48bd-9138-f9f6cf21af00 None admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:35.332784 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b91e990-cb01-48bd-9138-f9f6cf21af00 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:35.333200 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b91e990-cb01-48bd-9138-f9f6cf21af00 None admin] PATH_INFO: `/v3/projects/6b45298f54324df991aa8efd3235c168/groups/3e591f1865e3459ba556544f72621dac/roles/5b702713e40145b49e0b42abd0a5fba9` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:35.335333 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b91e990-cb01-48bd-9138-f9f6cf21af00 None admin] RBAC: Authorizing `identity:create_grant(project_id=6b45298f54324df991aa8efd3235c168, group_id=3e591f1865e3459ba556544f72621dac, role_id=5b702713e40145b49e0b42abd0a5fba9)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:35.336974 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b91e990-cb01-48bd-9138-f9f6cf21af00 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:35.359455 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 209/417] 10.222.0.16 () {58 vars in 1442 bytes} [Sun Sep 11 05:16:35 2022] PUT /identity/v3/projects/6b45298f54324df991aa8efd3235c168/groups/3e591f1865e3459ba556544f72621dac/roles/5b702713e40145b49e0b42abd0a5fba9 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:16:35.534617 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a920d890-e1a0-4173-9aac-8ffbcaff52c2 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:35.641996 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c416d1-9e25-448a-94c3-2bda19319f10 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:35.642716 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c416d1-9e25-448a-94c3-2bda19319f10 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:35.643220 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c416d1-9e25-448a-94c3-2bda19319f10 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:35.650371 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 210/418] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:16:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:16:35.652613 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac159b-1b49-484b-b7c6-6c03e754774c None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:35.653498 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac159b-1b49-484b-b7c6-6c03e754774c None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:35.654248 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac159b-1b49-484b-b7c6-6c03e754774c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:35.665839 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a920d890-e1a0-4173-9aac-8ffbcaff52c2 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:35.676741 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-33ac159b-1b49-484b-b7c6-6c03e754774c None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:16:35.679413 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-33ac159b-1b49-484b-b7c6-6c03e754774c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:16:35.694726 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:35.742277 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf7e771-1ebc-4069-9c13-788ebe16492d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:35.743194 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7e771-1ebc-4069-9c13-788ebe16492d None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:35.743624 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7e771-1ebc-4069-9c13-788ebe16492d None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:35.744065 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7e771-1ebc-4069-9c13-788ebe16492d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:35.763046 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:35.764026 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf7e771-1ebc-4069-9c13-788ebe16492d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:16:35.769820 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 211/419] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:16:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 05:16:35.771881 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-daf7e771-1ebc-4069-9c13-788ebe16492d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 05:16:35.771881 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:16:35.771881 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:16:35.771881 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:16:35.771881 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:16:35.771881 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:16:35.771881 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:16:35.771881 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:16:35.771881 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:16:35.771881 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:16:35.771881 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:16:35.771881 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:16:35.771881 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:16:35.771881 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:16:35.771881 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:16:35.771881 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:16:35.772761 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:16:35.772761 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:16:35.772761 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:16:35.772761 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:16:35.772761 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:16:35.772761 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:16:35.772761 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:16:35.772761 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:16:35.772761 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:16:35.772761 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:16:35.772761 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:16:35.772761 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:16:35.772761 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:16:35.772761 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:16:35.772761 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:16:35.772761 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:16:35.773637 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:16:35.773637 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:16:35.773637 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:16:35.773637 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:16:35.773637 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:16:35.773637 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:16:35.773637 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:16:35.773637 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:16:35.773637 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:16:35.773637 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:16:35.773637 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 05:16:35.773637 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:16:35.775762 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 209/420] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 05:16:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:16:35.784820 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ac159b-1b49-484b-b7c6-6c03e754774c None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:35.928620 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ac159b-1b49-484b-b7c6-6c03e754774c None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:35.981321 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412c3d15-9e79-453a-8937-993283382745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:35.981957 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412c3d15-9e79-453a-8937-993283382745 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:35.982234 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412c3d15-9e79-453a-8937-993283382745 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:35.982502 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412c3d15-9e79-453a-8937-993283382745 None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:35.983173 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412c3d15-9e79-453a-8937-993283382745 None admin] RBAC: Adding query filter params (name=member) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:35.983480 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412c3d15-9e79-453a-8937-993283382745 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:35.984897 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412c3d15-9e79-453a-8937-993283382745 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:35.993785 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 212/421] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 11 05:16:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:35.999530 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf7e771-1ebc-4069-9c13-788ebe16492d None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:36.103834 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412c3d15-9e79-453a-8937-993283382745 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:36.145697 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf7e771-1ebc-4069-9c13-788ebe16492d None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:36.202190 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f56a64c-b607-41f6-bfd0-3b484cad1ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:36.202811 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56a64c-b607-41f6-bfd0-3b484cad1ad0 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:36.203091 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56a64c-b607-41f6-bfd0-3b484cad1ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:36.203363 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56a64c-b607-41f6-bfd0-3b484cad1ad0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:36.225633 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:36.269720 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:36.297981 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412c3d15-9e79-453a-8937-993283382745 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:36.325644 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f56a64c-b607-41f6-bfd0-3b484cad1ad0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:36.327101 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f56a64c-b607-41f6-bfd0-3b484cad1ad0 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:36.366551 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688f4aef-872f-47e1-a3d6-beffebbf2fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:36.367109 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f4aef-872f-47e1-a3d6-beffebbf2fdc None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:36.370423 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f4aef-872f-47e1-a3d6-beffebbf2fdc None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:36.370761 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f4aef-872f-47e1-a3d6-beffebbf2fdc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:36.391285 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688f4aef-872f-47e1-a3d6-beffebbf2fdc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:16:36.397176 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-688f4aef-872f-47e1-a3d6-beffebbf2fdc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 05:16:36.397176 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:16:36.397176 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:16:36.397176 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:16:36.397176 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:16:36.397176 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:16:36.397176 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:16:36.397176 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:16:36.397176 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:16:36.397176 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:16:36.397176 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:16:36.397176 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:16:36.397176 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:16:36.397176 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:16:36.397176 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:16:36.397176 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:16:36.398054 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:16:36.398054 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:16:36.398054 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:16:36.398054 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:16:36.398054 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:16:36.398054 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:16:36.398054 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:16:36.398054 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:16:36.398054 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:16:36.398054 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:16:36.398054 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:16:36.398054 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:16:36.398054 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:16:36.398054 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:16:36.398054 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:16:36.398054 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:16:36.398865 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:16:36.398865 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:16:36.398865 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:16:36.398865 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:16:36.398865 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:16:36.398865 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:16:36.398865 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:16:36.398865 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:16:36.398865 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:16:36.398865 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:16:36.398865 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 05:16:36.398865 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:16:36.406855 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 213/422] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 11 05:16:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 05:16:36.412732 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688f4aef-872f-47e1-a3d6-beffebbf2fdc None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:36.551644 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 210/423] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 05:16:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 05:16:36.554667 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688f4aef-872f-47e1-a3d6-beffebbf2fdc None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:36.558455 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f56a64c-b607-41f6-bfd0-3b484cad1ad0 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:36.587221 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:36.609108 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7c226d-5756-4141-a618-0b1dc7d93a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:36.609720 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7c226d-5756-4141-a618-0b1dc7d93a17 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:36.609998 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7c226d-5756-4141-a618-0b1dc7d93a17 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:36.611438 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7c226d-5756-4141-a618-0b1dc7d93a17 None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:36.612142 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7c226d-5756-4141-a618-0b1dc7d93a17 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:36.612450 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7c226d-5756-4141-a618-0b1dc7d93a17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:36.614804 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7c226d-5756-4141-a618-0b1dc7d93a17 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:36.629157 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 214/424] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 05:16:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:36.634500 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7c226d-5756-4141-a618-0b1dc7d93a17 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:36.685863 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:36.723304 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f56a64c-b607-41f6-bfd0-3b484cad1ad0 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:36.766627 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7c226d-5756-4141-a618-0b1dc7d93a17 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:36.774681 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a73e655-8af9-4282-8ae8-ff522c82cb62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:36.775638 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a73e655-8af9-4282-8ae8-ff522c82cb62 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:36.776152 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a73e655-8af9-4282-8ae8-ff522c82cb62 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:36.776610 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a73e655-8af9-4282-8ae8-ff522c82cb62 None admin] PATH_INFO: `/v3/projects/199292d828144a70992f2344ae63f351` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:36.777934 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a73e655-8af9-4282-8ae8-ff522c82cb62 None admin] RBAC: Authorizing `identity:get_project(project_id=199292d828144a70992f2344ae63f351)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:36.779512 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a73e655-8af9-4282-8ae8-ff522c82cb62 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:36.782454 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 211/425] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 05:16:36 2022] GET /identity/v3/projects/199292d828144a70992f2344ae63f351 => generated 298 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:36.783911 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d509b51-3e1c-4f90-a6e0-d7731aca5f6b None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:36.784354 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d509b51-3e1c-4f90-a6e0-d7731aca5f6b None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:36.784786 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d509b51-3e1c-4f90-a6e0-d7731aca5f6b None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:36.791835 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 212/426] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:16:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:16:36.794517 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d509b51-3e1c-4f90-a6e0-d7731aca5f6b None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:36.821756 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2399fb61-33f0-4b25-bd67-0699770004fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:36.822504 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2399fb61-33f0-4b25-bd67-0699770004fd None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:36.823008 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2399fb61-33f0-4b25-bd67-0699770004fd None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:36.823515 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2399fb61-33f0-4b25-bd67-0699770004fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:36.890096 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:36.915018 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2399fb61-33f0-4b25-bd67-0699770004fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:36.917443 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2399fb61-33f0-4b25-bd67-0699770004fd None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:36.920624 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d509b51-3e1c-4f90-a6e0-d7731aca5f6b None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:36.971669 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900bda97-bbd6-4461-8eae-e2af872ae9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:36.972324 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900bda97-bbd6-4461-8eae-e2af872ae9af None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:36.972596 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900bda97-bbd6-4461-8eae-e2af872ae9af None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:36.972863 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900bda97-bbd6-4461-8eae-e2af872ae9af None admin] PATH_INFO: `/v3/groups/cbf562a50e194986adfef41d4a7805d7` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:36.974826 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900bda97-bbd6-4461-8eae-e2af872ae9af None admin] RBAC: Authorizing `identity:get_group(group_id=cbf562a50e194986adfef41d4a7805d7)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:36.976326 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900bda97-bbd6-4461-8eae-e2af872ae9af None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:36.983619 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 213/427] 10.222.0.16 () {56 vars in 1180 bytes} [Sun Sep 11 05:16:36 2022] GET /identity/v3/groups/cbf562a50e194986adfef41d4a7805d7 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:36.984740 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d42462d-e845-483f-9d8c-5e5b96fffdbf None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:36.985039 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d42462d-e845-483f-9d8c-5e5b96fffdbf None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:36.985335 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d42462d-e845-483f-9d8c-5e5b96fffdbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:37.004641 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-6d42462d-e845-483f-9d8c-5e5b96fffdbf None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:16:37.005968 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-6d42462d-e845-483f-9d8c-5e5b96fffdbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:16:37.008207 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:37.048233 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 215/428] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 05:16:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 11 05:16:37.049122 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2399fb61-33f0-4b25-bd67-0699770004fd None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:37.087706 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 214/429] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:16:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 05:16:37.087706 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d42462d-e845-483f-9d8c-5e5b96fffdbf None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:37.196760 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d42462d-e845-483f-9d8c-5e5b96fffdbf None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:37.205946 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:37.236397 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505c9df7-d680-4277-a615-4a6cd1bb324b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:37.237757 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505c9df7-d680-4277-a615-4a6cd1bb324b None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:37.238034 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505c9df7-d680-4277-a615-4a6cd1bb324b None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:37.238303 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505c9df7-d680-4277-a615-4a6cd1bb324b None admin] PATH_INFO: `/v3/projects/199292d828144a70992f2344ae63f351` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:37.240836 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505c9df7-d680-4277-a615-4a6cd1bb324b None admin] RBAC: Authorizing `identity:get_project(project_id=199292d828144a70992f2344ae63f351)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:37.242485 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505c9df7-d680-4277-a615-4a6cd1bb324b None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:37.246333 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 215/430] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 05:16:37 2022] GET /identity/v3/projects/199292d828144a70992f2344ae63f351 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:37.248808 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2399fb61-33f0-4b25-bd67-0699770004fd None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:37.251987 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505c9df7-d680-4277-a615-4a6cd1bb324b None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:37.268616 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:37.289019 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861ac037-9c40-4dc2-a772-79b1ddd09506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:37.289627 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861ac037-9c40-4dc2-a772-79b1ddd09506 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:37.289902 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861ac037-9c40-4dc2-a772-79b1ddd09506 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:37.290418 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861ac037-9c40-4dc2-a772-79b1ddd09506 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:37.291150 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861ac037-9c40-4dc2-a772-79b1ddd09506 None admin] RBAC: Adding query filter params (group.id=cbf562a50e194986adfef41d4a7805d7, role.id=aa7ff8e0ec1e48e5811335b9eb38b448, scope.project.id=199292d828144a70992f2344ae63f351) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:37.291454 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861ac037-9c40-4dc2-a772-79b1ddd09506 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:37.292980 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861ac037-9c40-4dc2-a772-79b1ddd09506 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:37.312281 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 216/431] 10.222.0.16 () {56 vars in 1376 bytes} [Sun Sep 11 05:16:37 2022] GET /identity/v3/role_assignments?group.id=cbf562a50e194986adfef41d4a7805d7&scope.project.id=199292d828144a70992f2344ae63f351&role.id=aa7ff8e0ec1e48e5811335b9eb38b448 => generated 611 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:37.419028 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505c9df7-d680-4277-a615-4a6cd1bb324b None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:37.445000 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861ac037-9c40-4dc2-a772-79b1ddd09506 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:37.465925 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796ef3e3-dd03-4c3b-b981-e609b6e44593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:37.466555 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ef3e3-dd03-4c3b-b981-e609b6e44593 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:37.466831 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ef3e3-dd03-4c3b-b981-e609b6e44593 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:37.467108 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ef3e3-dd03-4c3b-b981-e609b6e44593 None admin] PATH_INFO: `/v3/groups/cbf562a50e194986adfef41d4a7805d7` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:37.468303 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796ef3e3-dd03-4c3b-b981-e609b6e44593 None admin] RBAC: Authorizing `identity:get_group(group_id=cbf562a50e194986adfef41d4a7805d7)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:37.469760 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796ef3e3-dd03-4c3b-b981-e609b6e44593 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:37.471710 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 216/432] 10.222.0.16 () {56 vars in 1180 bytes} [Sun Sep 11 05:16:37 2022] GET /identity/v3/groups/cbf562a50e194986adfef41d4a7805d7 => generated 226 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:37.472917 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dcfd4a-3c50-45a9-bac4-95e6d6b5b669 None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:37.473200 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dcfd4a-3c50-45a9-bac4-95e6d6b5b669 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:37.473477 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dcfd4a-3c50-45a9-bac4-95e6d6b5b669 None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:37.474964 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 217/433] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:16:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:16:37.481021 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb419d-0acc-4d02-8093-44a1ac2720db None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:37.481301 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb419d-0acc-4d02-8093-44a1ac2720db None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:37.481582 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb419d-0acc-4d02-8093-44a1ac2720db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:37.501403 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-81cb419d-0acc-4d02-8093-44a1ac2720db None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:16:37.502836 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-81cb419d-0acc-4d02-8093-44a1ac2720db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:16:37.584528 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 218/434] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:16:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 05:16:37.585407 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cb419d-0acc-4d02-8093-44a1ac2720db None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:37.586528 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861ac037-9c40-4dc2-a772-79b1ddd09506 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:37.589335 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:37.634849 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad7be35-4bc8-4f37-816a-7017843f5c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:37.635880 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad7be35-4bc8-4f37-816a-7017843f5c0d None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:37.636211 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad7be35-4bc8-4f37-816a-7017843f5c0d None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:37.636758 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad7be35-4bc8-4f37-816a-7017843f5c0d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:37.650346 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad7be35-4bc8-4f37-816a-7017843f5c0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:16:37.657722 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-7ad7be35-4bc8-4f37-816a-7017843f5c0d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 05:16:37.657722 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:16:37.657722 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:16:37.657722 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:16:37.657722 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:16:37.657722 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:16:37.657722 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:16:37.657722 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:16:37.657722 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:16:37.657722 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:16:37.657722 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:16:37.657722 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:16:37.657722 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:16:37.657722 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:16:37.657722 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:16:37.657722 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:16:37.658631 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:16:37.658631 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:16:37.658631 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:16:37.658631 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:16:37.658631 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:16:37.658631 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:16:37.658631 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:16:37.658631 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:16:37.658631 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:16:37.658631 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:16:37.658631 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:16:37.658631 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:16:37.658631 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:16:37.658631 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:16:37.658631 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:16:37.658631 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:16:37.659589 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:16:37.659589 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:16:37.659589 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:16:37.659589 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:16:37.659589 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:16:37.659589 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:16:37.659589 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:16:37.659589 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:16:37.659589 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:16:37.659589 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:16:37.659589 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 05:16:37.659589 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:16:37.659589 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 217/435] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 05:16:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 05:16:37.665765 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad7be35-4bc8-4f37-816a-7017843f5c0d None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:37.677115 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:37.715372 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cb419d-0acc-4d02-8093-44a1ac2720db None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:37.764399 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8cfea7-ec7f-4c15-8b4e-0c084e099ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:37.765344 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8cfea7-ec7f-4c15-8b4e-0c084e099ba2 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:37.765702 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8cfea7-ec7f-4c15-8b4e-0c084e099ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:37.766088 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8cfea7-ec7f-4c15-8b4e-0c084e099ba2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:37.767451 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8cfea7-ec7f-4c15-8b4e-0c084e099ba2 None admin] RBAC: Adding query filter params (group.id=cbf562a50e194986adfef41d4a7805d7, role.id=ada04449ee1f42599a060f4795ec1a74, scope.project.id=199292d828144a70992f2344ae63f351) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:37.768173 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8cfea7-ec7f-4c15-8b4e-0c084e099ba2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:37.769826 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8cfea7-ec7f-4c15-8b4e-0c084e099ba2 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:37.777977 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 219/436] 10.222.0.16 () {56 vars in 1376 bytes} [Sun Sep 11 05:16:37 2022] GET /identity/v3/role_assignments?group.id=cbf562a50e194986adfef41d4a7805d7&scope.project.id=199292d828144a70992f2344ae63f351&role.id=ada04449ee1f42599a060f4795ec1a74 => generated 611 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:37.801445 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad7be35-4bc8-4f37-816a-7017843f5c0d None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:37.841064 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8925b5eb-833f-4893-9bf7-d23bb14f4685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:37.841708 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8925b5eb-833f-4893-9bf7-d23bb14f4685 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:37.841989 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8925b5eb-833f-4893-9bf7-d23bb14f4685 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:37.842260 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8925b5eb-833f-4893-9bf7-d23bb14f4685 None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:37.842941 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8925b5eb-833f-4893-9bf7-d23bb14f4685 None admin] RBAC: Adding query filter params (name=member) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:37.843243 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8925b5eb-833f-4893-9bf7-d23bb14f4685 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:37.844984 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8925b5eb-833f-4893-9bf7-d23bb14f4685 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:37.855672 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 218/437] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 11 05:16:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:37.861851 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8cfea7-ec7f-4c15-8b4e-0c084e099ba2 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:37.907428 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8925b5eb-833f-4893-9bf7-d23bb14f4685 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:37.969055 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:38.002979 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:38.054221 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8cfea7-ec7f-4c15-8b4e-0c084e099ba2 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:38.067871 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8925b5eb-833f-4893-9bf7-d23bb14f4685 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:38.102350 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee8cb95-f35a-4995-838b-5669690f78ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:38.102963 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8cb95-f35a-4995-838b-5669690f78ff None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:38.103398 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8cb95-f35a-4995-838b-5669690f78ff None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:38.103672 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8cb95-f35a-4995-838b-5669690f78ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:38.120377 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a152f8-04d4-4275-b076-9cc52af20eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:38.121153 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a152f8-04d4-4275-b076-9cc52af20eba None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:38.121436 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a152f8-04d4-4275-b076-9cc52af20eba None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:38.121712 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a152f8-04d4-4275-b076-9cc52af20eba None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:38.139308 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a152f8-04d4-4275-b076-9cc52af20eba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:16:38.144775 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-b6a152f8-04d4-4275-b076-9cc52af20eba None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 05:16:38.144775 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:16:38.144775 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:16:38.144775 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:16:38.144775 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:16:38.144775 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:16:38.144775 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:16:38.144775 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:16:38.144775 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:16:38.144775 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:16:38.144775 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:16:38.144775 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:16:38.144775 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:16:38.144775 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:16:38.144775 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:16:38.144775 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:16:38.145683 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:16:38.145683 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:16:38.145683 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:16:38.145683 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:16:38.145683 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:16:38.145683 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:16:38.145683 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:16:38.145683 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:16:38.145683 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:16:38.145683 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:16:38.145683 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:16:38.145683 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:16:38.145683 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:16:38.145683 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:16:38.145683 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:16:38.145683 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:16:38.147152 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:16:38.147152 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:16:38.147152 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:16:38.147152 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:16:38.147152 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:16:38.147152 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:16:38.147152 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:16:38.147152 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:16:38.147152 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:16:38.147152 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:16:38.147152 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 05:16:38.147152 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:16:38.147152 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 219/438] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 11 05:16:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:16:38.154176 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a152f8-04d4-4275-b076-9cc52af20eba None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:38.198439 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee8cb95-f35a-4995-838b-5669690f78ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:38.199916 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee8cb95-f35a-4995-838b-5669690f78ff None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:38.277899 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a152f8-04d4-4275-b076-9cc52af20eba None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:38.282848 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:38.310015 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:38.324212 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 220/439] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 05:16:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 11 05:16:38.325794 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527fe3a8-d7c6-4b99-81f2-4ab62e856885 None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:38.325945 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33031038-93c7-4c5f-8a82-799d62eb1e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:38.326358 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527fe3a8-d7c6-4b99-81f2-4ab62e856885 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:38.326358 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527fe3a8-d7c6-4b99-81f2-4ab62e856885 None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:38.326606 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33031038-93c7-4c5f-8a82-799d62eb1e03 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:38.326817 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33031038-93c7-4c5f-8a82-799d62eb1e03 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:38.327093 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33031038-93c7-4c5f-8a82-799d62eb1e03 None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:38.327729 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 221/440] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:16:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:16:38.327842 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33031038-93c7-4c5f-8a82-799d62eb1e03 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:38.328151 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33031038-93c7-4c5f-8a82-799d62eb1e03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:38.329719 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33031038-93c7-4c5f-8a82-799d62eb1e03 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:38.332385 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527fe3a8-d7c6-4b99-81f2-4ab62e856885 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:38.341142 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 220/441] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 05:16:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:16:38.342336 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bfc0c0-4957-488c-9228-fb5b17548a94 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:38.342628 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bfc0c0-4957-488c-9228-fb5b17548a94 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:38.343792 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bfc0c0-4957-488c-9228-fb5b17548a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:38.363881 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-f4bfc0c0-4957-488c-9228-fb5b17548a94 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:16:38.365130 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-f4bfc0c0-4957-488c-9228-fb5b17548a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:16:38.435956 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 221/442] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:16:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 05:16:38.440646 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bfc0c0-4957-488c-9228-fb5b17548a94 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:38.454600 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527fe3a8-d7c6-4b99-81f2-4ab62e856885 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:38.489350 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72856196-85fe-457b-a2b6-d914f2858ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:38.490775 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72856196-85fe-457b-a2b6-d914f2858ca3 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:38.491060 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72856196-85fe-457b-a2b6-d914f2858ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:38.491333 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72856196-85fe-457b-a2b6-d914f2858ca3 None admin] PATH_INFO: `/v3/projects/ca0a33c848834728909bb4815ac1e8bc` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:38.492486 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72856196-85fe-457b-a2b6-d914f2858ca3 None admin] RBAC: Authorizing `identity:get_project(project_id=ca0a33c848834728909bb4815ac1e8bc)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:38.493926 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72856196-85fe-457b-a2b6-d914f2858ca3 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:38.495556 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 222/443] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 05:16:38 2022] GET /identity/v3/projects/ca0a33c848834728909bb4815ac1e8bc => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:38.500843 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72856196-85fe-457b-a2b6-d914f2858ca3 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:38.536445 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:38.553306 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bfc0c0-4957-488c-9228-fb5b17548a94 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:38.576067 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:38.591747 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d9b5e0-abe5-4090-9f4a-3b11c2a47f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:38.592709 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d9b5e0-abe5-4090-9f4a-3b11c2a47f4f None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:38.593042 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d9b5e0-abe5-4090-9f4a-3b11c2a47f4f None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:38.593316 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d9b5e0-abe5-4090-9f4a-3b11c2a47f4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:38.604569 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72856196-85fe-457b-a2b6-d914f2858ca3 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:38.643496 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d86853f-7362-4da2-aa93-9b40d31496a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:38.644552 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d86853f-7362-4da2-aa93-9b40d31496a1 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:38.644830 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d86853f-7362-4da2-aa93-9b40d31496a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:38.645252 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d86853f-7362-4da2-aa93-9b40d31496a1 None admin] PATH_INFO: `/v3/groups/cbf562a50e194986adfef41d4a7805d7` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:38.646433 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d86853f-7362-4da2-aa93-9b40d31496a1 None admin] RBAC: Authorizing `identity:get_group(group_id=cbf562a50e194986adfef41d4a7805d7)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:38.647935 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d86853f-7362-4da2-aa93-9b40d31496a1 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:38.649512 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 223/444] 10.222.0.16 () {56 vars in 1180 bytes} [Sun Sep 11 05:16:38 2022] GET /identity/v3/groups/cbf562a50e194986adfef41d4a7805d7 => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:38.655098 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d86853f-7362-4da2-aa93-9b40d31496a1 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:38.670822 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d9b5e0-abe5-4090-9f4a-3b11c2a47f4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:38.672343 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d9b5e0-abe5-4090-9f4a-3b11c2a47f4f None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:38.769841 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d86853f-7362-4da2-aa93-9b40d31496a1 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:38.773235 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:38.780481 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 222/445] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 05:16:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 05:16:38.781383 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d9b5e0-abe5-4090-9f4a-3b11c2a47f4f None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:38.802518 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:38.814601 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d97cb8c-b8c6-4a41-aa10-dd5db92179ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:38.815215 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d97cb8c-b8c6-4a41-aa10-dd5db92179ed None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:38.815490 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d97cb8c-b8c6-4a41-aa10-dd5db92179ed None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:38.815795 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d97cb8c-b8c6-4a41-aa10-dd5db92179ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:38.816511 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d97cb8c-b8c6-4a41-aa10-dd5db92179ed None admin] RBAC: Adding query filter params (group.id=cbf562a50e194986adfef41d4a7805d7, role.id=aa7ff8e0ec1e48e5811335b9eb38b448, scope.project.id=ca0a33c848834728909bb4815ac1e8bc) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:38.816814 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d97cb8c-b8c6-4a41-aa10-dd5db92179ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:38.818759 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d97cb8c-b8c6-4a41-aa10-dd5db92179ed None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:38.824945 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 224/446] 10.222.0.16 () {56 vars in 1376 bytes} [Sun Sep 11 05:16:38 2022] GET /identity/v3/role_assignments?group.id=cbf562a50e194986adfef41d4a7805d7&scope.project.id=ca0a33c848834728909bb4815ac1e8bc&role.id=aa7ff8e0ec1e48e5811335b9eb38b448 => generated 611 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:16:38.824945 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d97cb8c-b8c6-4a41-aa10-dd5db92179ed None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:38.901639 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d9b5e0-abe5-4090-9f4a-3b11c2a47f4f None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:38.938186 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d97cb8c-b8c6-4a41-aa10-dd5db92179ed None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:38.938664 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7c43cc-7834-40fd-aa21-48e7530693f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:38.939301 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7c43cc-7834-40fd-aa21-48e7530693f2 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:38.939570 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7c43cc-7834-40fd-aa21-48e7530693f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:38.940010 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7c43cc-7834-40fd-aa21-48e7530693f2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:38.954321 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7c43cc-7834-40fd-aa21-48e7530693f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:16:38.959237 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-6c7c43cc-7834-40fd-aa21-48e7530693f2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 05:16:38.959237 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:16:38.959237 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:16:38.959237 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:16:38.959237 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:16:38.959237 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:16:38.959237 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:16:38.959237 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:16:38.959237 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:16:38.959237 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:16:38.959237 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:16:38.959237 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:16:38.959237 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:16:38.959237 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:16:38.959237 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:16:38.959237 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:16:38.960176 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:16:38.960176 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:16:38.960176 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:16:38.960176 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:16:38.960176 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:16:38.960176 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:16:38.960176 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:16:38.960176 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:16:38.960176 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:16:38.960176 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:16:38.960176 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:16:38.960176 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:16:38.960176 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:16:38.960176 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:16:38.960176 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:16:38.960176 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:16:38.960986 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:16:38.960986 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:16:38.960986 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:16:38.960986 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:16:38.960986 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:16:38.960986 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:16:38.960986 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:16:38.960986 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:16:38.960986 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:16:38.960986 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:16:38.960986 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 05:16:38.960986 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:16:38.960986 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 223/447] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 05:16:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:16:38.966571 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7c43cc-7834-40fd-aa21-48e7530693f2 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:38.979826 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d84000c-a00b-448d-86fd-aa1ccbfa5dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:38.980663 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d84000c-a00b-448d-86fd-aa1ccbfa5dd0 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:38.980773 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d84000c-a00b-448d-86fd-aa1ccbfa5dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:38.981004 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d84000c-a00b-448d-86fd-aa1ccbfa5dd0 None admin] PATH_INFO: `/v3/projects/ca0a33c848834728909bb4815ac1e8bc` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:38.982200 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d84000c-a00b-448d-86fd-aa1ccbfa5dd0 None admin] RBAC: Authorizing `identity:get_project(project_id=ca0a33c848834728909bb4815ac1e8bc)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:38.983862 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d84000c-a00b-448d-86fd-aa1ccbfa5dd0 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:38.986251 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 225/448] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 05:16:38 2022] GET /identity/v3/projects/ca0a33c848834728909bb4815ac1e8bc => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:38.992350 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d84000c-a00b-448d-86fd-aa1ccbfa5dd0 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:39.039490 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:39.063865 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:39.087990 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7c43cc-7834-40fd-aa21-48e7530693f2 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:39.118915 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d84000c-a00b-448d-86fd-aa1ccbfa5dd0 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:39.133903 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210d4d0e-7355-4864-bab0-92bcd2cb09a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:39.134573 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d4d0e-7355-4864-bab0-92bcd2cb09a7 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:39.134852 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d4d0e-7355-4864-bab0-92bcd2cb09a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:39.135144 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d4d0e-7355-4864-bab0-92bcd2cb09a7 None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:39.135854 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210d4d0e-7355-4864-bab0-92bcd2cb09a7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:39.136162 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210d4d0e-7355-4864-bab0-92bcd2cb09a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:39.137535 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210d4d0e-7355-4864-bab0-92bcd2cb09a7 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:39.148657 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 224/449] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 05:16:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:39.154660 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210d4d0e-7355-4864-bab0-92bcd2cb09a7 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:39.165869 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7ba7b8-d602-4746-84c6-f2fd92d08d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:39.166109 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ba7b8-d602-4746-84c6-f2fd92d08d49 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:39.168976 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ba7b8-d602-4746-84c6-f2fd92d08d49 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:39.168976 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ba7b8-d602-4746-84c6-f2fd92d08d49 None admin] PATH_INFO: `/v3/groups/cbf562a50e194986adfef41d4a7805d7` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:39.168976 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7ba7b8-d602-4746-84c6-f2fd92d08d49 None admin] RBAC: Authorizing `identity:get_group(group_id=cbf562a50e194986adfef41d4a7805d7)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:39.169807 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7ba7b8-d602-4746-84c6-f2fd92d08d49 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:39.171721 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 226/450] 10.222.0.16 () {56 vars in 1180 bytes} [Sun Sep 11 05:16:38 2022] GET /identity/v3/groups/cbf562a50e194986adfef41d4a7805d7 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:16:39.177106 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7ba7b8-d602-4746-84c6-f2fd92d08d49 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:39.264552 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210d4d0e-7355-4864-bab0-92bcd2cb09a7 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:39.279827 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7ba7b8-d602-4746-84c6-f2fd92d08d49 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:39.282051 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:39.296909 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146c0523-5590-4b30-9d38-144fd7fb0b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:39.297510 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c0523-5590-4b30-9d38-144fd7fb0b36 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:39.297785 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c0523-5590-4b30-9d38-144fd7fb0b36 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:39.298065 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c0523-5590-4b30-9d38-144fd7fb0b36 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:39.309934 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:39.314871 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a15509-4af7-43c7-bb0f-fe31d751ba66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:39.315476 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a15509-4af7-43c7-bb0f-fe31d751ba66 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:39.315793 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a15509-4af7-43c7-bb0f-fe31d751ba66 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:39.316070 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a15509-4af7-43c7-bb0f-fe31d751ba66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:39.316789 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a15509-4af7-43c7-bb0f-fe31d751ba66 None admin] RBAC: Adding query filter params (group.id=cbf562a50e194986adfef41d4a7805d7, role.id=ada04449ee1f42599a060f4795ec1a74, scope.project.id=ca0a33c848834728909bb4815ac1e8bc) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:39.317102 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a15509-4af7-43c7-bb0f-fe31d751ba66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:39.318630 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a15509-4af7-43c7-bb0f-fe31d751ba66 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:39.324971 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 227/451] 10.222.0.16 () {56 vars in 1376 bytes} [Sun Sep 11 05:16:39 2022] GET /identity/v3/role_assignments?group.id=cbf562a50e194986adfef41d4a7805d7&scope.project.id=ca0a33c848834728909bb4815ac1e8bc&role.id=ada04449ee1f42599a060f4795ec1a74 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:16:39.370450 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146c0523-5590-4b30-9d38-144fd7fb0b36 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:39.371973 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146c0523-5590-4b30-9d38-144fd7fb0b36 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:39.474580 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 225/452] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 05:16:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 11 05:16:39.480236 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a15509-4af7-43c7-bb0f-fe31d751ba66 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:39.584363 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a15509-4af7-43c7-bb0f-fe31d751ba66 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:39.617483 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c7c769-00c7-46a7-a06a-6c1380bdba75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:39.618110 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7c769-00c7-46a7-a06a-6c1380bdba75 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:39.618381 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7c769-00c7-46a7-a06a-6c1380bdba75 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:39.618653 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7c769-00c7-46a7-a06a-6c1380bdba75 None admin] PATH_INFO: `/v3/projects/6b45298f54324df991aa8efd3235c168` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:39.619811 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c7c769-00c7-46a7-a06a-6c1380bdba75 None admin] RBAC: Authorizing `identity:get_project(project_id=6b45298f54324df991aa8efd3235c168)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:39.621253 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c7c769-00c7-46a7-a06a-6c1380bdba75 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:39.622874 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 228/453] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 05:16:39 2022] GET /identity/v3/projects/6b45298f54324df991aa8efd3235c168 => generated 344 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:39.628416 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146c0523-5590-4b30-9d38-144fd7fb0b36 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:39.672769 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:39.729031 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146c0523-5590-4b30-9d38-144fd7fb0b36 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:39.761431 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8012a4d-2fd9-42d2-a788-1490ee8851fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:39.762048 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8012a4d-2fd9-42d2-a788-1490ee8851fb None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:39.762324 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8012a4d-2fd9-42d2-a788-1490ee8851fb None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:39.762590 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8012a4d-2fd9-42d2-a788-1490ee8851fb None admin] PATH_INFO: `/v3/groups/3e591f1865e3459ba556544f72621dac` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:39.763668 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8012a4d-2fd9-42d2-a788-1490ee8851fb None admin] RBAC: Authorizing `identity:get_group(group_id=3e591f1865e3459ba556544f72621dac)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:39.765135 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8012a4d-2fd9-42d2-a788-1490ee8851fb None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:39.766679 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 226/454] 10.222.0.16 () {56 vars in 1180 bytes} [Sun Sep 11 05:16:39 2022] GET /identity/v3/groups/3e591f1865e3459ba556544f72621dac => generated 229 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:39.772439 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c7c769-00c7-46a7-a06a-6c1380bdba75 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:39.807151 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:39.869764 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c7c769-00c7-46a7-a06a-6c1380bdba75 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:39.901336 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1636061-150b-4176-84c3-f915c7465184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:39.901931 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1636061-150b-4176-84c3-f915c7465184 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:39.902210 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1636061-150b-4176-84c3-f915c7465184 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:39.902484 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1636061-150b-4176-84c3-f915c7465184 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:39.903215 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1636061-150b-4176-84c3-f915c7465184 None admin] RBAC: Adding query filter params (group.id=3e591f1865e3459ba556544f72621dac, role.id=5b702713e40145b49e0b42abd0a5fba9, scope.project.id=6b45298f54324df991aa8efd3235c168) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:39.903508 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1636061-150b-4176-84c3-f915c7465184 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:39.904968 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1636061-150b-4176-84c3-f915c7465184 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:39.910499 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 229/455] 10.222.0.16 () {56 vars in 1376 bytes} [Sun Sep 11 05:16:39 2022] GET /identity/v3/role_assignments?group.id=3e591f1865e3459ba556544f72621dac&scope.project.id=6b45298f54324df991aa8efd3235c168&role.id=5b702713e40145b49e0b42abd0a5fba9 => generated 611 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:42.505668 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce210a-fb80-4012-8008-d78f862c19cd None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:42.506718 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce210a-fb80-4012-8008-d78f862c19cd None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:42.507210 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce210a-fb80-4012-8008-d78f862c19cd None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:42.509228 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 227/456] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:16:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:16:42.515475 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b501f2-28fc-4952-96e1-ab36f379279c None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:42.516462 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b501f2-28fc-4952-96e1-ab36f379279c None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:42.516938 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b501f2-28fc-4952-96e1-ab36f379279c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:42.536624 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-74b501f2-28fc-4952-96e1-ab36f379279c None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:16:42.538817 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-74b501f2-28fc-4952-96e1-ab36f379279c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:16:42.621982 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 230/457] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:16:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 05:16:42.653381 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29be36cf-8299-4504-8c54-26faabc08884 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:42.653754 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29be36cf-8299-4504-8c54-26faabc08884 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:42.654106 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29be36cf-8299-4504-8c54-26faabc08884 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:42.655799 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 228/458] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:16:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:16:42.661016 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe55ab6-0711-4d22-8819-ef811418a820 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:42.661484 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe55ab6-0711-4d22-8819-ef811418a820 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:42.662024 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe55ab6-0711-4d22-8819-ef811418a820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:42.687560 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-7fe55ab6-0711-4d22-8819-ef811418a820 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:16:42.689040 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-7fe55ab6-0711-4d22-8819-ef811418a820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:16:42.725019 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:42.791778 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 231/459] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:16:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 05:16:42.943911 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c9159-1633-4033-9f9c-dde0dc6bb72d None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:42.944280 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c9159-1633-4033-9f9c-dde0dc6bb72d None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:42.944457 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c9159-1633-4033-9f9c-dde0dc6bb72d None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:42.946173 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 229/460] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:16:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:16:42.950989 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d40a08-3032-4c80-b275-cf847203fef7 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:42.951275 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d40a08-3032-4c80-b275-cf847203fef7 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:42.951547 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d40a08-3032-4c80-b275-cf847203fef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:42.976690 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-d8d40a08-3032-4c80-b275-cf847203fef7 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:16:42.977879 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-d8d40a08-3032-4c80-b275-cf847203fef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:16:43.066199 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 232/461] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:16:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 05:16:43.142218 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38c9159-1633-4033-9f9c-dde0dc6bb72d None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:43.257400 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d40a08-3032-4c80-b275-cf847203fef7 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:43.316840 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38c9159-1633-4033-9f9c-dde0dc6bb72d None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:43.340767 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:43.370438 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66c5c8d-7b31-4b4d-a0eb-af84756da8a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:43.371387 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c5c8d-7b31-4b4d-a0eb-af84756da8a7 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:43.372246 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c5c8d-7b31-4b4d-a0eb-af84756da8a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:43.372879 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c5c8d-7b31-4b4d-a0eb-af84756da8a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:43.384904 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66c5c8d-7b31-4b4d-a0eb-af84756da8a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:43.386644 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66c5c8d-7b31-4b4d-a0eb-af84756da8a7 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:43.404346 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-d66c5c8d-7b31-4b4d-a0eb-af84756da8a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:16:43.404346 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:16:43.404346 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:16:43.404346 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:16:43.404346 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:16:43.404346 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:16:43.404346 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:16:43.404346 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:16:43.404346 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:16:43.404346 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:16:43.404346 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:16:43.404346 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:16:43.404346 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 05:16:43.404346 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 05:16:43.404346 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 05:16:43.404346 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 05:16:43.405303 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:16:43.405303 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:16:43.405303 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:16:43.405303 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:16:43.405303 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:16:43.405303 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:16:43.405303 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:16:43.405303 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:16:43.405303 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:16:43.405303 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:16:43.405303 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:16:43.405303 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:16:43.405303 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:16:43.405303 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:16:43.405303 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:16:43.405303 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:16:43.405303 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 05:16:43.406172 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 05:16:43.406172 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:16:43.406172 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:16:43.408286 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 230/462] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:16:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:16:43.413670 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66c5c8d-7b31-4b4d-a0eb-af84756da8a7 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:43.440114 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:43.454656 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d40a08-3032-4c80-b275-cf847203fef7 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:43.500815 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12aa4e0-a408-4577-ab0c-3e2bd05bea2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:43.501999 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12aa4e0-a408-4577-ab0c-3e2bd05bea2c None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:43.501999 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12aa4e0-a408-4577-ab0c-3e2bd05bea2c None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:43.501999 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12aa4e0-a408-4577-ab0c-3e2bd05bea2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:43.512453 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12aa4e0-a408-4577-ab0c-3e2bd05bea2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:43.513909 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12aa4e0-a408-4577-ab0c-3e2bd05bea2c None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:43.529305 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-a12aa4e0-a408-4577-ab0c-3e2bd05bea2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:16:43.529305 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:16:43.529305 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:16:43.529305 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:16:43.529305 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:16:43.529305 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:16:43.529305 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:16:43.529305 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:16:43.529305 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:16:43.529305 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:16:43.529305 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:16:43.529305 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:16:43.529305 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 05:16:43.529305 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 05:16:43.529305 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 05:16:43.529305 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 05:16:43.530637 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:16:43.530637 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:16:43.530637 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:16:43.530637 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:16:43.530637 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:16:43.530637 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:16:43.530637 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:16:43.530637 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:16:43.530637 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:16:43.530637 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:16:43.530637 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:16:43.530637 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:16:43.530637 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:16:43.530637 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:16:43.530637 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:16:43.530637 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:16:43.530637 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 05:16:43.531483 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 05:16:43.531483 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:16:43.531483 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:16:43.531483 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 233/463] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:16:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 05:16:43.532522 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12aa4e0-a408-4577-ab0c-3e2bd05bea2c None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:43.536716 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66c5c8d-7b31-4b4d-a0eb-af84756da8a7 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:43.573506 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165a4e96-9e50-45cc-b25b-6e2464ab76bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:43.574038 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165a4e96-9e50-45cc-b25b-6e2464ab76bc None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:43.574316 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165a4e96-9e50-45cc-b25b-6e2464ab76bc None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:43.574585 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165a4e96-9e50-45cc-b25b-6e2464ab76bc None admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:43.575382 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165a4e96-9e50-45cc-b25b-6e2464ab76bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:43.575876 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165a4e96-9e50-45cc-b25b-6e2464ab76bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:43.577425 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165a4e96-9e50-45cc-b25b-6e2464ab76bc None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:43.590280 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 231/464] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 05:16:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:16:43.591656 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d8ca1-244f-477d-9884-3b48db654317 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:43.591971 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d8ca1-244f-477d-9884-3b48db654317 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:43.592246 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d8ca1-244f-477d-9884-3b48db654317 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:43.593459 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 232/465] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:16:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:16:43.594280 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9d8ca1-244f-477d-9884-3b48db654317 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:43.620298 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:43.650146 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12aa4e0-a408-4577-ab0c-3e2bd05bea2c None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:43.686994 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f0eb77-0e09-4221-8307-f846a5385ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:43.687938 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f0eb77-0e09-4221-8307-f846a5385ce8 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:43.688219 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f0eb77-0e09-4221-8307-f846a5385ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:43.688489 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f0eb77-0e09-4221-8307-f846a5385ce8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:43.698973 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f0eb77-0e09-4221-8307-f846a5385ce8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:43.700456 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f0eb77-0e09-4221-8307-f846a5385ce8 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:43.702403 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:43.705850 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9d8ca1-244f-477d-9884-3b48db654317 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:43.717502 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-36f0eb77-0e09-4221-8307-f846a5385ce8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:16:43.717502 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:16:43.717502 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:16:43.717502 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:16:43.717502 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:16:43.717502 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:16:43.717502 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:16:43.717502 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:16:43.717502 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:16:43.717502 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:16:43.717502 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:16:43.717502 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:16:43.717502 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 05:16:43.717502 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 05:16:43.717502 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 05:16:43.717502 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 05:16:43.718425 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:16:43.718425 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:16:43.718425 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:16:43.718425 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:16:43.718425 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:16:43.718425 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:16:43.718425 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:16:43.718425 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:16:43.718425 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:16:43.718425 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:16:43.718425 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:16:43.718425 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:16:43.718425 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:16:43.718425 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:16:43.718425 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:16:43.718425 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:16:43.718425 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 05:16:43.719295 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 05:16:43.719295 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:16:43.719295 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:16:43.719295 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 234/466] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:16:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:16:43.725010 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f0eb77-0e09-4221-8307-f846a5385ce8 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:43.742338 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a80d5-3b1b-46ea-9b05-bd8cf0cf98fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:43.742949 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a80d5-3b1b-46ea-9b05-bd8cf0cf98fc None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:43.743226 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a80d5-3b1b-46ea-9b05-bd8cf0cf98fc None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:43.743495 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a80d5-3b1b-46ea-9b05-bd8cf0cf98fc None admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:43.744303 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6a80d5-3b1b-46ea-9b05-bd8cf0cf98fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:43.744609 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6a80d5-3b1b-46ea-9b05-bd8cf0cf98fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:43.745999 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6a80d5-3b1b-46ea-9b05-bd8cf0cf98fc None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:43.758145 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 233/467] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 05:16:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:43.763769 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba5bea9-f356-4ca8-8677-a42e0e70bf31 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:43.764062 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba5bea9-f356-4ca8-8677-a42e0e70bf31 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:43.765061 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba5bea9-f356-4ca8-8677-a42e0e70bf31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:43.782034 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-2ba5bea9-f356-4ca8-8677-a42e0e70bf31 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:16:43.783233 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-2ba5bea9-f356-4ca8-8677-a42e0e70bf31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:16:43.836904 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f0eb77-0e09-4221-8307-f846a5385ce8 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:43.854567 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 234/468] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:16:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 05:16:43.855488 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba5bea9-f356-4ca8-8677-a42e0e70bf31 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:43.869656 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:43.888354 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f65412-2e96-4646-a34c-35e94c5f94cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:43.889318 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f65412-2e96-4646-a34c-35e94c5f94cf None admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:43.889772 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f65412-2e96-4646-a34c-35e94c5f94cf None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:43.890219 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f65412-2e96-4646-a34c-35e94c5f94cf None admin] PATH_INFO: `/v3/users` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:43.892031 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f65412-2e96-4646-a34c-35e94c5f94cf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:43.893327 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f65412-2e96-4646-a34c-35e94c5f94cf None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:43.922482 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 235/469] 10.222.0.16 () {60 vars in 1132 bytes} [Sun Sep 11 05:16:43 2022] POST /identity/v3/users => generated 246 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:16:43.923749 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f65412-2e96-4646-a34c-35e94c5f94cf None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:43.996494 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:44.023906 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba5bea9-f356-4ca8-8677-a42e0e70bf31 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:44.060197 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f65412-2e96-4646-a34c-35e94c5f94cf None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:44.092576 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb976d6-f78d-4766-895c-9cd7acc4aca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:44.093112 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb976d6-f78d-4766-895c-9cd7acc4aca6 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:44.093388 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb976d6-f78d-4766-895c-9cd7acc4aca6 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:44.093655 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb976d6-f78d-4766-895c-9cd7acc4aca6 None admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:44.094306 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb976d6-f78d-4766-895c-9cd7acc4aca6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:44.094608 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb976d6-f78d-4766-895c-9cd7acc4aca6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:44.096058 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb976d6-f78d-4766-895c-9cd7acc4aca6 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:44.109582 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6a75d4-dd37-4985-b8a1-92c14e053647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:44.110575 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a75d4-dd37-4985-b8a1-92c14e053647 None admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:44.111055 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a75d4-dd37-4985-b8a1-92c14e053647 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:44.111553 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a75d4-dd37-4985-b8a1-92c14e053647 None admin] PATH_INFO: `/v3/users` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:44.112453 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6a75d4-dd37-4985-b8a1-92c14e053647 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:44.112781 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 235/470] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 05:16:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:44.114200 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd314b-6e24-4bc9-a5ae-fd8520034db6 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:44.114528 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd314b-6e24-4bc9-a5ae-fd8520034db6 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:44.114800 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd314b-6e24-4bc9-a5ae-fd8520034db6 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:44.116009 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6a75d4-dd37-4985-b8a1-92c14e053647 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:44.119774 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 236/471] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:16:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:16:44.124683 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fd314b-6e24-4bc9-a5ae-fd8520034db6 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:44.146606 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 236/472] 10.222.0.16 () {60 vars in 1132 bytes} [Sun Sep 11 05:16:43 2022] POST /identity/v3/users => generated 248 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:16:44.148657 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd26dec-ba66-4d58-ab49-d182acf78533 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:44.149300 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd26dec-ba66-4d58-ab49-d182acf78533 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:44.150273 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd26dec-ba66-4d58-ab49-d182acf78533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:44.177152 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-5cd26dec-ba66-4d58-ab49-d182acf78533 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:16:44.179574 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-5cd26dec-ba66-4d58-ab49-d182acf78533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:16:44.218497 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:44.261999 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fd314b-6e24-4bc9-a5ae-fd8520034db6 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:44.287425 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 237/473] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:16:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 05:16:44.288470 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd26dec-ba66-4d58-ab49-d182acf78533 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:44.313414 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189b3624-c362-4307-9a09-ddbdac441308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:44.314055 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b3624-c362-4307-9a09-ddbdac441308 None admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:44.314556 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b3624-c362-4307-9a09-ddbdac441308 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:44.315033 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b3624-c362-4307-9a09-ddbdac441308 None admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:44.316806 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189b3624-c362-4307-9a09-ddbdac441308 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:44.319365 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189b3624-c362-4307-9a09-ddbdac441308 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:44.333889 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:44.355936 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 237/474] 10.222.0.16 () {60 vars in 1132 bytes} [Sun Sep 11 05:16:44 2022] POST /identity/v3/users => generated 248 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:16:44.428456 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd26dec-ba66-4d58-ab49-d182acf78533 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:44.472023 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bcae2b-856c-49b9-8310-6937f15e15ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:44.473025 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bcae2b-856c-49b9-8310-6937f15e15ca None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:44.473500 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bcae2b-856c-49b9-8310-6937f15e15ca None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:44.473993 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bcae2b-856c-49b9-8310-6937f15e15ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:44.486092 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bcae2b-856c-49b9-8310-6937f15e15ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:44.487939 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bcae2b-856c-49b9-8310-6937f15e15ca None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:44.505843 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-50bcae2b-856c-49b9-8310-6937f15e15ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:16:44.505843 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:16:44.505843 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:16:44.505843 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:16:44.505843 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:16:44.505843 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:16:44.505843 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:16:44.505843 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:16:44.505843 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:16:44.505843 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:16:44.505843 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:16:44.505843 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:16:44.505843 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 05:16:44.505843 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 05:16:44.505843 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 05:16:44.505843 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 05:16:44.506820 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:16:44.506820 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:16:44.506820 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:16:44.506820 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:16:44.506820 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:16:44.506820 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:16:44.506820 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:16:44.506820 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:16:44.506820 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:16:44.506820 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:16:44.506820 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:16:44.506820 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:16:44.506820 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:16:44.506820 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:16:44.506820 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:16:44.506820 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:16:44.506820 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 05:16:44.507699 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 05:16:44.507699 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:16:44.507699 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:16:44.509947 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 238/475] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:16:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:16:44.516631 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189b3624-c362-4307-9a09-ddbdac441308 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:44.582953 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bcae2b-856c-49b9-8310-6937f15e15ca None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:44.672466 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189b3624-c362-4307-9a09-ddbdac441308 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:44.705822 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:44.707128 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:44.716980 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bcae2b-856c-49b9-8310-6937f15e15ca None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:44.717802 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b59427-bcb0-4367-b624-b1b4b69c1c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:44.719306 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b59427-bcb0-4367-b624-b1b4b69c1c49 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:44.720169 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b59427-bcb0-4367-b624-b1b4b69c1c49 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:44.721479 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b59427-bcb0-4367-b624-b1b4b69c1c49 None admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:44.722326 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b59427-bcb0-4367-b624-b1b4b69c1c49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:44.722635 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b59427-bcb0-4367-b624-b1b4b69c1c49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:44.724069 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b59427-bcb0-4367-b624-b1b4b69c1c49 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:44.737881 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 238/476] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 05:16:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:44.744861 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b59427-bcb0-4367-b624-b1b4b69c1c49 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:44.765061 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a232b06-6bb7-414d-ad06-59aabd78bbd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:44.765673 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a232b06-6bb7-414d-ad06-59aabd78bbd9 None admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:44.765955 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a232b06-6bb7-414d-ad06-59aabd78bbd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:44.766226 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a232b06-6bb7-414d-ad06-59aabd78bbd9 None admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:44.766904 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a232b06-6bb7-414d-ad06-59aabd78bbd9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:44.768317 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a232b06-6bb7-414d-ad06-59aabd78bbd9 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:44.785428 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.sql.core [None req-8a232b06-6bb7-414d-ad06-59aabd78bbd9 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 11 05:16:44.785428 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 11 05:16:44.785428 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [parameters: {'id': 'c4107b12fea8440eab393f92ab5d4757', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 11 05:16:44.785428 dv-cinder-856921-1-smb devstack@keystone.service[81383]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81383) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 11 05:16:44.822440 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-8a232b06-6bb7-414d-ad06-59aabd78bbd9 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 11 05:16:44.822440 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:16:44.822440 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 11 05:16:44.822440 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 11 05:16:44.822440 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 11 05:16:44.822440 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 11 05:16:44.822440 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 11 05:16:44.822440 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application result = self._query(query) Sep 11 05:16:44.822440 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 11 05:16:44.822440 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application conn.query(q) Sep 11 05:16:44.822440 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 11 05:16:44.822440 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 11 05:16:44.822440 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 11 05:16:44.822440 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application result.read() Sep 11 05:16:44.822440 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 11 05:16:44.823377 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 11 05:16:44.823377 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 11 05:16:44.823377 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 11 05:16:44.823377 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 11 05:16:44.823377 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 11 05:16:44.823377 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 11 05:16:44.823377 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 11 05:16:44.823377 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 11 05:16:44.823377 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:16:44.823377 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 11 05:16:44.823377 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:16:44.823377 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:16:44.823377 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 11 05:16:44.823377 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 11 05:16:44.823377 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 11 05:16:44.823377 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return ref.to_dict() Sep 11 05:16:44.823377 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 11 05:16:44.823377 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application next(self.gen) Sep 11 05:16:44.824722 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 11 05:16:44.824722 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application yield resource Sep 11 05:16:44.824722 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 11 05:16:44.824722 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application next(self.gen) Sep 11 05:16:44.824722 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 11 05:16:44.824722 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application self.session.rollback() Sep 11 05:16:44.824722 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 11 05:16:44.824722 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application self.force_reraise() Sep 11 05:16:44.824722 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 11 05:16:44.824722 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise self.value Sep 11 05:16:44.824722 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 11 05:16:44.824722 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 11 05:16:44.824722 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 11 05:16:44.824722 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application session.commit() Sep 11 05:16:44.824722 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 11 05:16:44.824722 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 11 05:16:44.824722 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 11 05:16:44.825548 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application self._prepare_impl() Sep 11 05:16:44.825548 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 11 05:16:44.825548 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application self.session.flush() Sep 11 05:16:44.825548 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 11 05:16:44.825548 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application self._flush(objects) Sep 11 05:16:44.825548 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 11 05:16:44.825548 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 11 05:16:44.825548 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 11 05:16:44.825548 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application compat.raise_( Sep 11 05:16:44.825548 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 11 05:16:44.825548 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception Sep 11 05:16:44.825548 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 11 05:16:44.825548 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application flush_context.execute() Sep 11 05:16:44.825548 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 11 05:16:44.825548 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rec.execute(self) Sep 11 05:16:44.825548 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 11 05:16:44.825548 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 11 05:16:44.826415 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 11 05:16:44.826415 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 11 05:16:44.826415 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 11 05:16:44.826415 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 11 05:16:44.826415 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 11 05:16:44.826415 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 11 05:16:44.826415 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 11 05:16:44.826415 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 11 05:16:44.826415 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 11 05:16:44.826415 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 11 05:16:44.826415 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 11 05:16:44.826415 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 11 05:16:44.826415 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 11 05:16:44.826415 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 11 05:16:44.826415 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 11 05:16:44.826415 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception Sep 11 05:16:44.828084 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 11 05:16:44.828084 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 11 05:16:44.828084 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 11 05:16:44.828084 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 11 05:16:44.828084 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 11 05:16:44.828084 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application result = self._query(query) Sep 11 05:16:44.828084 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 11 05:16:44.828084 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application conn.query(q) Sep 11 05:16:44.828084 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 11 05:16:44.828084 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 11 05:16:44.828084 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 11 05:16:44.828084 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application result.read() Sep 11 05:16:44.828084 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 11 05:16:44.828084 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 11 05:16:44.828084 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 11 05:16:44.828084 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 11 05:16:44.829978 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 11 05:16:44.829978 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 11 05:16:44.829978 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 11 05:16:44.829978 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 11 05:16:44.829978 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 11 05:16:44.829978 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 11 05:16:44.829978 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [parameters: {'id': 'c4107b12fea8440eab393f92ab5d4757', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 11 05:16:44.829978 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 11 05:16:44.829978 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:16:44.829978 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 05:16:44.829978 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:16:44.829978 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:16:44.829978 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:16:44.829978 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:16:44.829978 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:16:44.829978 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:16:44.837310 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:16:44.837310 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:16:44.837310 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:16:44.837310 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:16:44.837310 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:16:44.837310 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:16:44.837310 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 11 05:16:44.837310 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 11 05:16:44.837310 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:16:44.837310 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:16:44.837310 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 11 05:16:44.837310 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 11 05:16:44.837310 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 11 05:16:44.837310 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 11 05:16:44.837310 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 11 05:16:44.837310 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:16:44.839263 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 239/477] 10.222.0.16 () {60 vars in 1131 bytes} [Sun Sep 11 05:16:44 2022] POST /identity/v3/roles => generated 144 bytes in 241 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:16:44.839263 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a232b06-6bb7-414d-ad06-59aabd78bbd9 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:44.872105 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b59427-bcb0-4367-b624-b1b4b69c1c49 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:44.932621 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd50fe2-8bd9-45f9-ac4b-6f1087bec3b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:44.933164 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd50fe2-8bd9-45f9-ac4b-6f1087bec3b7 None admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:44.933444 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd50fe2-8bd9-45f9-ac4b-6f1087bec3b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:44.933718 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd50fe2-8bd9-45f9-ac4b-6f1087bec3b7 None admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:44.934472 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd50fe2-8bd9-45f9-ac4b-6f1087bec3b7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:44.936120 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd50fe2-8bd9-45f9-ac4b-6f1087bec3b7 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:44.984480 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a232b06-6bb7-414d-ad06-59aabd78bbd9 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:44.986555 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 239/478] 10.222.0.16 () {60 vars in 1132 bytes} [Sun Sep 11 05:16:44 2022] POST /identity/v3/users => generated 249 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 05:16:45.022770 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f156e117-de83-4e03-b2fa-a2751fac49ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:45.023504 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f156e117-de83-4e03-b2fa-a2751fac49ca None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:45.023820 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f156e117-de83-4e03-b2fa-a2751fac49ca None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:45.024102 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f156e117-de83-4e03-b2fa-a2751fac49ca None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:45.037805 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f156e117-de83-4e03-b2fa-a2751fac49ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:16:45.043308 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-f156e117-de83-4e03-b2fa-a2751fac49ca None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 05:16:45.043308 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:16:45.043308 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:16:45.043308 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:16:45.043308 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:16:45.043308 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:16:45.043308 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:16:45.043308 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:16:45.043308 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:16:45.043308 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:16:45.043308 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:16:45.043308 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:16:45.043308 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:16:45.043308 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:16:45.043308 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:16:45.043308 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:16:45.045561 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:16:45.045561 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:16:45.045561 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:16:45.045561 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:16:45.045561 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:16:45.045561 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:16:45.045561 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:16:45.045561 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:16:45.045561 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:16:45.045561 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:16:45.045561 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:16:45.045561 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:16:45.045561 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:16:45.045561 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:16:45.045561 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:16:45.045561 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:16:45.047521 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:16:45.047521 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:16:45.047521 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:16:45.047521 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:16:45.047521 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:16:45.047521 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:16:45.047521 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:16:45.047521 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:16:45.047521 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:16:45.047521 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:16:45.047521 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 05:16:45.047521 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:16:45.047521 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 240/479] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 11 05:16:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:16:45.053256 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd50fe2-8bd9-45f9-ac4b-6f1087bec3b7 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:45.131139 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:45.201439 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd50fe2-8bd9-45f9-ac4b-6f1087bec3b7 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:45.249331 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aabb06-4380-4637-a7f1-1b4268179ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:45.250347 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aabb06-4380-4637-a7f1-1b4268179ad6 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:45.250821 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aabb06-4380-4637-a7f1-1b4268179ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:45.251287 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aabb06-4380-4637-a7f1-1b4268179ad6 None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:45.252202 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aabb06-4380-4637-a7f1-1b4268179ad6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:45.252726 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aabb06-4380-4637-a7f1-1b4268179ad6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:45.254322 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aabb06-4380-4637-a7f1-1b4268179ad6 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:45.263851 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 240/480] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 05:16:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:46.681832 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404eb953-899f-4d47-86b0-00f71c5edffa None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:46.682384 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404eb953-899f-4d47-86b0-00f71c5edffa None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:46.682384 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404eb953-899f-4d47-86b0-00f71c5edffa None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:46.684020 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 241/481] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:16:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:16:46.688907 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68097fcf-2ac5-4fee-837f-6fb577206c93 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:46.689305 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68097fcf-2ac5-4fee-837f-6fb577206c93 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:46.689490 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68097fcf-2ac5-4fee-837f-6fb577206c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:46.716947 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-68097fcf-2ac5-4fee-837f-6fb577206c93 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:16:46.718196 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-68097fcf-2ac5-4fee-837f-6fb577206c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:16:46.804995 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 241/482] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:16:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 05:16:46.971781 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1fae70-b6b3-4258-a062-3295d9e16222 None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:46.971964 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1fae70-b6b3-4258-a062-3295d9e16222 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:46.972239 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1fae70-b6b3-4258-a062-3295d9e16222 None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:46.973840 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 242/483] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:16:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:16:46.978868 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f9788e-16a9-4f8d-93f8-28f29e49afeb None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:46.979158 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f9788e-16a9-4f8d-93f8-28f29e49afeb None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:46.979436 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f9788e-16a9-4f8d-93f8-28f29e49afeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:47.001830 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-38f9788e-16a9-4f8d-93f8-28f29e49afeb None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:16:47.003011 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-38f9788e-16a9-4f8d-93f8-28f29e49afeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:16:47.042893 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:47.086679 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 242/484] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:16:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 05:16:47.173257 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1fae70-b6b3-4258-a062-3295d9e16222 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:47.188746 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:47.316476 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1fae70-b6b3-4258-a062-3295d9e16222 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:47.326305 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f162cd4-eb3a-4713-befb-75764270d64c None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:47.326599 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f162cd4-eb3a-4713-befb-75764270d64c None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:47.326874 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f162cd4-eb3a-4713-befb-75764270d64c None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:47.328737 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 243/485] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:16:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:16:47.335033 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6beedc-8221-4de4-b4e8-7901a462c43c None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:47.335311 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6beedc-8221-4de4-b4e8-7901a462c43c None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:47.335584 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6beedc-8221-4de4-b4e8-7901a462c43c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:47.357276 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc3676c-a260-4c67-a4df-a3083e9e49c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:47.358275 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc3676c-a260-4c67-a4df-a3083e9e49c7 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:47.359167 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc3676c-a260-4c67-a4df-a3083e9e49c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:47.359637 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc3676c-a260-4c67-a4df-a3083e9e49c7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:47.370747 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc3676c-a260-4c67-a4df-a3083e9e49c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:16:47.372648 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-5c6beedc-8221-4de4-b4e8-7901a462c43c None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:16:47.373832 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-5c6beedc-8221-4de4-b4e8-7901a462c43c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:16:47.378051 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-ebc3676c-a260-4c67-a4df-a3083e9e49c7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 05:16:47.378051 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:16:47.378051 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:16:47.378051 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:16:47.378051 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:16:47.378051 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:16:47.378051 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:16:47.378051 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:16:47.378051 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:16:47.378051 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:16:47.378051 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:16:47.378051 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:16:47.378051 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:16:47.378051 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:16:47.378051 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:16:47.378051 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:16:47.378975 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:16:47.378975 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:16:47.378975 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:16:47.378975 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:16:47.378975 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:16:47.378975 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:16:47.378975 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:16:47.378975 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:16:47.378975 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:16:47.378975 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:16:47.378975 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:16:47.378975 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:16:47.378975 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:16:47.378975 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:16:47.378975 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:16:47.378975 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:16:47.379825 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:16:47.379825 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:16:47.379825 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:16:47.379825 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:16:47.379825 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:16:47.379825 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:16:47.379825 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:16:47.379825 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:16:47.379825 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:16:47.379825 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:16:47.379825 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 05:16:47.379825 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:16:47.383331 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 243/486] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 11 05:16:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:16:47.388955 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc3676c-a260-4c67-a4df-a3083e9e49c7 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:47.478170 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 244/487] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:16:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 05:16:47.483846 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6beedc-8221-4de4-b4e8-7901a462c43c None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:47.492660 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:47.546443 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc3676c-a260-4c67-a4df-a3083e9e49c7 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:47.609339 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586a7890-36b7-4dc5-a7e8-defeac666df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:47.609920 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a7890-36b7-4dc5-a7e8-defeac666df2 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:47.610207 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a7890-36b7-4dc5-a7e8-defeac666df2 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:47.610478 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a7890-36b7-4dc5-a7e8-defeac666df2 None admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:47.611145 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586a7890-36b7-4dc5-a7e8-defeac666df2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:47.611449 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586a7890-36b7-4dc5-a7e8-defeac666df2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:47.612871 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586a7890-36b7-4dc5-a7e8-defeac666df2 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:47.629870 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 244/488] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 11 05:16:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:47.634449 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586a7890-36b7-4dc5-a7e8-defeac666df2 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:47.649356 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:47.660138 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6beedc-8221-4de4-b4e8-7901a462c43c None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:47.726078 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40467f72-be6d-43cc-b960-a5222d0058c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:47.726736 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40467f72-be6d-43cc-b960-a5222d0058c7 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:47.726985 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40467f72-be6d-43cc-b960-a5222d0058c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:47.727263 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40467f72-be6d-43cc-b960-a5222d0058c7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:47.748906 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40467f72-be6d-43cc-b960-a5222d0058c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:16:47.759714 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-40467f72-be6d-43cc-b960-a5222d0058c7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 05:16:47.759714 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:16:47.759714 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:16:47.759714 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:16:47.759714 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:16:47.759714 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:16:47.759714 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:16:47.759714 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:16:47.759714 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:16:47.759714 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:16:47.759714 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:16:47.759714 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:16:47.759714 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:16:47.759714 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:16:47.759714 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:16:47.759714 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:16:47.760646 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:16:47.760646 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:16:47.760646 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:16:47.760646 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:16:47.760646 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:16:47.760646 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:16:47.760646 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:16:47.760646 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:16:47.760646 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:16:47.760646 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:16:47.760646 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:16:47.760646 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:16:47.760646 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:16:47.760646 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:16:47.760646 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:16:47.760646 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:16:47.761453 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:16:47.761453 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:16:47.761453 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:16:47.761453 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:16:47.761453 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:16:47.761453 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:16:47.761453 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:16:47.761453 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:16:47.761453 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:16:47.761453 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:16:47.761453 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 05:16:47.761453 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:16:47.761453 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 245/489] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 11 05:16:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:16:47.765766 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40467f72-be6d-43cc-b960-a5222d0058c7 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:47.823155 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586a7890-36b7-4dc5-a7e8-defeac666df2 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:47.859077 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036a054b-d5c1-469b-83d6-41e028c00909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:47.859895 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a054b-d5c1-469b-83d6-41e028c00909 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:47.860112 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a054b-d5c1-469b-83d6-41e028c00909 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:47.860382 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a054b-d5c1-469b-83d6-41e028c00909 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:47.862358 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:47.872988 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036a054b-d5c1-469b-83d6-41e028c00909 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:47.874419 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036a054b-d5c1-469b-83d6-41e028c00909 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:47.878618 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40467f72-be6d-43cc-b960-a5222d0058c7 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:47.889961 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-036a054b-d5c1-469b-83d6-41e028c00909 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:16:47.889961 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:16:47.889961 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:16:47.889961 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:16:47.889961 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:16:47.889961 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:16:47.889961 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:16:47.889961 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:16:47.889961 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:16:47.889961 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:16:47.889961 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:16:47.889961 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:16:47.889961 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 05:16:47.889961 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 05:16:47.889961 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 05:16:47.889961 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 05:16:47.890869 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:16:47.890869 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:16:47.890869 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:16:47.890869 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:16:47.890869 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:16:47.890869 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:16:47.890869 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:16:47.890869 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:16:47.890869 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:16:47.890869 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:16:47.890869 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:16:47.890869 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:16:47.890869 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:16:47.890869 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:16:47.890869 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:16:47.890869 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:16:47.890869 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 05:16:47.891734 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 05:16:47.891734 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:16:47.891734 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:16:47.892520 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 245/490] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:16:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 05:16:47.894129 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc45309-b4f2-42af-930c-0ccc4491fbd8 None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:47.894760 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc45309-b4f2-42af-930c-0ccc4491fbd8 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:47.895141 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc45309-b4f2-42af-930c-0ccc4491fbd8 None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:47.896833 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 246/491] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:16:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:16:47.897634 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc45309-b4f2-42af-930c-0ccc4491fbd8 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:47.921523 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aa8c1b-78a1-459a-be19-e140f7e6d85e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:47.922280 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa8c1b-78a1-459a-be19-e140f7e6d85e None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:47.922559 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa8c1b-78a1-459a-be19-e140f7e6d85e None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:47.922831 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa8c1b-78a1-459a-be19-e140f7e6d85e None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:47.923491 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aa8c1b-78a1-459a-be19-e140f7e6d85e None admin] RBAC: Adding query filter params (name=service) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:47.923831 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aa8c1b-78a1-459a-be19-e140f7e6d85e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:47.925228 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aa8c1b-78a1-459a-be19-e140f7e6d85e None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:47.933275 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 246/492] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 11 05:16:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:47.934060 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aa8c1b-78a1-459a-be19-e140f7e6d85e None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:47.957586 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:48.009480 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc45309-b4f2-42af-930c-0ccc4491fbd8 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:48.042477 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aa8c1b-78a1-459a-be19-e140f7e6d85e None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:48.044347 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f124ac-bf3d-4517-911d-e45529994870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:48.044979 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f124ac-bf3d-4517-911d-e45529994870 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:48.045254 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f124ac-bf3d-4517-911d-e45529994870 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:48.045526 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f124ac-bf3d-4517-911d-e45529994870 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:48.056789 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f124ac-bf3d-4517-911d-e45529994870 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:16:48.062241 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-19f124ac-bf3d-4517-911d-e45529994870 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 05:16:48.062241 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:16:48.062241 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:16:48.062241 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:16:48.062241 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:16:48.062241 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:16:48.062241 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:16:48.062241 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:16:48.062241 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:16:48.062241 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:16:48.062241 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:16:48.062241 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:16:48.062241 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:16:48.062241 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:16:48.062241 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:16:48.062241 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:16:48.063225 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:16:48.063225 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:16:48.063225 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:16:48.063225 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:16:48.063225 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:16:48.063225 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:16:48.063225 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:16:48.063225 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:16:48.063225 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:16:48.063225 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:16:48.063225 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:16:48.063225 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:16:48.063225 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:16:48.063225 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:16:48.063225 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:16:48.063225 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:16:48.064080 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:16:48.064080 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:16:48.064080 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:16:48.064080 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:16:48.064080 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:16:48.064080 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:16:48.064080 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:16:48.064080 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:16:48.064080 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:16:48.064080 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:16:48.064080 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 05:16:48.064080 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:16:48.064080 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 247/493] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 11 05:16:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:16:48.070230 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b845f-146d-4338-88ef-926bc594dcd4 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:48.070514 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b845f-146d-4338-88ef-926bc594dcd4 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:48.070790 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b845f-146d-4338-88ef-926bc594dcd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:48.081964 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db1673a-b73b-4557-8bb9-0bf4aee5970b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:48.082602 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db1673a-b73b-4557-8bb9-0bf4aee5970b None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:48.082908 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db1673a-b73b-4557-8bb9-0bf4aee5970b None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:48.083157 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db1673a-b73b-4557-8bb9-0bf4aee5970b None admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:48.083918 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db1673a-b73b-4557-8bb9-0bf4aee5970b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:48.084234 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db1673a-b73b-4557-8bb9-0bf4aee5970b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:48.085672 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db1673a-b73b-4557-8bb9-0bf4aee5970b None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:48.090511 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-2a7b845f-146d-4338-88ef-926bc594dcd4 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:16:48.091752 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-2a7b845f-146d-4338-88ef-926bc594dcd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:16:48.099050 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 247/494] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 05:16:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:48.100279 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db1673a-b73b-4557-8bb9-0bf4aee5970b None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:48.143279 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:48.171812 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 248/495] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:16:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 05:16:48.172673 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7b845f-146d-4338-88ef-926bc594dcd4 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:48.191383 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:48.214169 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db1673a-b73b-4557-8bb9-0bf4aee5970b None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:48.248071 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533c6435-b0c7-4135-8662-4d027aa008fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:48.248704 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c6435-b0c7-4135-8662-4d027aa008fc None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:48.248985 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c6435-b0c7-4135-8662-4d027aa008fc None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:48.249263 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c6435-b0c7-4135-8662-4d027aa008fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:48.259500 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533c6435-b0c7-4135-8662-4d027aa008fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:48.260989 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533c6435-b0c7-4135-8662-4d027aa008fc None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:48.275886 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-533c6435-b0c7-4135-8662-4d027aa008fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:16:48.275886 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:16:48.275886 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:16:48.275886 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:16:48.275886 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:16:48.275886 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:16:48.275886 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:16:48.275886 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:16:48.275886 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:16:48.275886 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:16:48.275886 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:16:48.275886 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:16:48.275886 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 05:16:48.275886 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 05:16:48.275886 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 05:16:48.275886 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 05:16:48.276794 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:16:48.276794 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:16:48.276794 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:16:48.276794 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:16:48.276794 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:16:48.276794 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:16:48.276794 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:16:48.276794 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:16:48.276794 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:16:48.276794 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:16:48.276794 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:16:48.276794 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:16:48.276794 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:16:48.276794 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:16:48.276794 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:16:48.276794 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:16:48.276794 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 05:16:48.277671 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 05:16:48.277671 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:16:48.277671 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:16:48.277671 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 248/496] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:16:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:16:48.277897 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533c6435-b0c7-4135-8662-4d027aa008fc None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:48.286667 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7b845f-146d-4338-88ef-926bc594dcd4 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:48.323224 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbec863-1faa-4320-b838-856126b36240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:48.323866 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbec863-1faa-4320-b838-856126b36240 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:48.324148 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbec863-1faa-4320-b838-856126b36240 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:48.324420 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbec863-1faa-4320-b838-856126b36240 None admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:48.325080 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbec863-1faa-4320-b838-856126b36240 None admin] RBAC: Adding query filter params (name=service) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:48.325382 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbec863-1faa-4320-b838-856126b36240 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:48.326756 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbec863-1faa-4320-b838-856126b36240 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:48.339938 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 249/497] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 11 05:16:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:48.339938 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a805cfcc-a425-48bc-9625-372c316223c4 None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:48.339938 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a805cfcc-a425-48bc-9625-372c316223c4 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:48.339938 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a805cfcc-a425-48bc-9625-372c316223c4 None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:48.343197 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 250/498] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:16:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:16:48.344020 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a805cfcc-a425-48bc-9625-372c316223c4 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:48.386876 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:48.387642 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533c6435-b0c7-4135-8662-4d027aa008fc None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:48.417995 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:48.425081 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346dc037-c861-4c3d-964e-197bb2708d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:48.426117 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346dc037-c861-4c3d-964e-197bb2708d4b None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:48.426407 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346dc037-c861-4c3d-964e-197bb2708d4b None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:48.426685 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346dc037-c861-4c3d-964e-197bb2708d4b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:48.434882 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346dc037-c861-4c3d-964e-197bb2708d4b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:48.436722 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346dc037-c861-4c3d-964e-197bb2708d4b None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:48.449473 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-346dc037-c861-4c3d-964e-197bb2708d4b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 11 05:16:48.449473 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:16:48.449473 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:16:48.449473 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:16:48.449473 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:16:48.449473 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:16:48.449473 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:16:48.449473 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:16:48.449473 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:16:48.449473 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:16:48.449473 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:16:48.449473 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:16:48.449473 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 05:16:48.449473 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 05:16:48.449473 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 05:16:48.449473 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 05:16:48.450485 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:16:48.450485 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:16:48.450485 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 05:16:48.450485 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 05:16:48.450485 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 05:16:48.450485 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 05:16:48.450485 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:16:48.450485 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:16:48.450485 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:16:48.450485 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:16:48.450485 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:16:48.450485 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:16:48.450485 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:16:48.450485 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:16:48.450485 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:16:48.450485 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:16:48.450485 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:16:48.450485 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:16:48.451413 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:16:48.451413 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:16:48.451413 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 05:16:48.451413 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 05:16:48.451413 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 05:16:48.451413 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 05:16:48.451413 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 05:16:48.451413 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 05:16:48.451413 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 11 05:16:48.451413 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:16:48.451413 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 249/499] 10.222.0.16 () {56 vars in 1093 bytes} [Sun Sep 11 05:16:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:16:48.452028 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a805cfcc-a425-48bc-9625-372c316223c4 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:48.452105 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7ac40-62da-4e9a-aa0c-3597ad6f9759 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:48.452105 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7ac40-62da-4e9a-aa0c-3597ad6f9759 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:48.452524 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7ac40-62da-4e9a-aa0c-3597ad6f9759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:48.470195 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-30b7ac40-62da-4e9a-aa0c-3597ad6f9759 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:16:48.471361 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-30b7ac40-62da-4e9a-aa0c-3597ad6f9759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:16:48.487517 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3d92cb-51e2-414d-bfd3-c523456fbdb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:48.488162 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d92cb-51e2-414d-bfd3-c523456fbdb5 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:48.488471 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d92cb-51e2-414d-bfd3-c523456fbdb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:48.488747 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d92cb-51e2-414d-bfd3-c523456fbdb5 None admin] PATH_INFO: `/v3/domains` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:48.489396 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3d92cb-51e2-414d-bfd3-c523456fbdb5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:48.489701 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3d92cb-51e2-414d-bfd3-c523456fbdb5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:48.491385 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3d92cb-51e2-414d-bfd3-c523456fbdb5 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:48.508723 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 251/500] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 05:16:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:48.509523 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3d92cb-51e2-414d-bfd3-c523456fbdb5 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:48.540291 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 250/501] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:16:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 05:16:48.554615 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b7ac40-62da-4e9a-aa0c-3597ad6f9759 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:48.613156 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:48.617356 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3d92cb-51e2-414d-bfd3-c523456fbdb5 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:48.642258 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b7ac40-62da-4e9a-aa0c-3597ad6f9759 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:48.654571 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b4a621-7c18-4572-b3f7-d199b386fcb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:48.655244 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b4a621-7c18-4572-b3f7-d199b386fcb8 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:48.655524 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b4a621-7c18-4572-b3f7-d199b386fcb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:48.655968 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b4a621-7c18-4572-b3f7-d199b386fcb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:48.664022 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:48.668398 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b4a621-7c18-4572-b3f7-d199b386fcb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:48.669981 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b4a621-7c18-4572-b3f7-d199b386fcb8 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:48.678738 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33110d4a-b4ba-49f1-9ca4-e8dbca2a7791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:48.679361 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33110d4a-b4ba-49f1-9ca4-e8dbca2a7791 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:48.679634 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33110d4a-b4ba-49f1-9ca4-e8dbca2a7791 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:48.679945 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33110d4a-b4ba-49f1-9ca4-e8dbca2a7791 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:48.685361 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-04b4a621-7c18-4572-b3f7-d199b386fcb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:16:48.685361 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:16:48.685361 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:16:48.685361 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:16:48.685361 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:16:48.685361 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:16:48.685361 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:16:48.685361 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:16:48.685361 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:16:48.685361 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:16:48.685361 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:16:48.685361 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:16:48.685361 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 05:16:48.685361 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 05:16:48.685361 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 05:16:48.685361 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 05:16:48.686247 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:16:48.686247 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:16:48.686247 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:16:48.686247 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:16:48.686247 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:16:48.686247 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:16:48.686247 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:16:48.686247 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:16:48.686247 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:16:48.686247 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:16:48.686247 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:16:48.686247 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:16:48.686247 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:16:48.686247 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:16:48.686247 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:16:48.686247 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:16:48.686247 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 05:16:48.687112 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 05:16:48.687112 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:16:48.687112 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:16:48.687112 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 252/502] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:16:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:16:48.687328 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b4a621-7c18-4572-b3f7-d199b386fcb8 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:48.698173 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33110d4a-b4ba-49f1-9ca4-e8dbca2a7791 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:16:48.703785 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-33110d4a-b4ba-49f1-9ca4-e8dbca2a7791 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 05:16:48.703785 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:16:48.703785 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:16:48.703785 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:16:48.703785 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:16:48.703785 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:16:48.703785 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:16:48.703785 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:16:48.703785 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:16:48.703785 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:16:48.703785 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:16:48.703785 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:16:48.703785 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:16:48.703785 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:16:48.703785 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:16:48.703785 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:16:48.704829 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:16:48.704829 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:16:48.704829 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:16:48.704829 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:16:48.704829 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:16:48.704829 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:16:48.704829 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:16:48.704829 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:16:48.704829 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:16:48.704829 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:16:48.704829 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:16:48.704829 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:16:48.704829 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:16:48.704829 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:16:48.704829 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:16:48.704829 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:16:48.705675 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:16:48.705675 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:16:48.705675 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:16:48.705675 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:16:48.705675 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:16:48.705675 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:16:48.705675 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:16:48.705675 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:16:48.705675 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:16:48.705675 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:16:48.705675 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 05:16:48.705675 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:16:48.705675 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 251/503] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 11 05:16:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:16:48.705675 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33110d4a-b4ba-49f1-9ca4-e8dbca2a7791 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:48.810843 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b4a621-7c18-4572-b3f7-d199b386fcb8 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:48.818516 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33110d4a-b4ba-49f1-9ca4-e8dbca2a7791 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:48.844724 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f46073-d9e0-47e8-b11e-6a6bba3c8535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:48.845320 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f46073-d9e0-47e8-b11e-6a6bba3c8535 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:48.845595 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f46073-d9e0-47e8-b11e-6a6bba3c8535 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:48.845862 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f46073-d9e0-47e8-b11e-6a6bba3c8535 None admin] PATH_INFO: `/v3/users` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:48.846579 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f46073-d9e0-47e8-b11e-6a6bba3c8535 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:48.846880 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f46073-d9e0-47e8-b11e-6a6bba3c8535 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:48.848343 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f46073-d9e0-47e8-b11e-6a6bba3c8535 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:48.852192 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6579d051-3c81-4d7a-8b2c-9fb54f87f6be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:48.852810 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579d051-3c81-4d7a-8b2c-9fb54f87f6be None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:48.853088 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579d051-3c81-4d7a-8b2c-9fb54f87f6be None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:48.853357 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579d051-3c81-4d7a-8b2c-9fb54f87f6be None admin] PATH_INFO: `/v3/users/glance` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:48.860196 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6579d051-3c81-4d7a-8b2c-9fb54f87f6be None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:48.861639 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6579d051-3c81-4d7a-8b2c-9fb54f87f6be None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:48.873183 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-6579d051-3c81-4d7a-8b2c-9fb54f87f6be None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 11 05:16:48.873183 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:16:48.873183 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:16:48.873183 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:16:48.873183 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:16:48.873183 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:16:48.873183 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:16:48.873183 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:16:48.873183 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:16:48.873183 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:16:48.873183 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:16:48.873183 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:16:48.873183 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 05:16:48.873183 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 05:16:48.873183 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 05:16:48.873183 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 05:16:48.874083 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:16:48.874083 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:16:48.874083 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 05:16:48.874083 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 05:16:48.874083 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 05:16:48.874083 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 05:16:48.874083 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:16:48.874083 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:16:48.874083 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:16:48.874083 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:16:48.874083 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:16:48.874083 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:16:48.874083 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:16:48.874083 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:16:48.874083 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:16:48.874083 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:16:48.874083 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:16:48.874083 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:16:48.875104 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:16:48.875104 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:16:48.875104 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 05:16:48.875104 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 05:16:48.875104 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 05:16:48.875104 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 05:16:48.875104 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 05:16:48.875104 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 05:16:48.875104 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 11 05:16:48.875104 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:16:48.875104 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 252/504] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 05:16:48 2022] GET /identity/v3/users/glance => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:16:48.875104 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6579d051-3c81-4d7a-8b2c-9fb54f87f6be None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:48.888805 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 253/505] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Sep 11 05:16:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:48.888805 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f46073-d9e0-47e8-b11e-6a6bba3c8535 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:48.897928 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:48.920186 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:48.980925 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6579d051-3c81-4d7a-8b2c-9fb54f87f6be None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:48.986140 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f46073-d9e0-47e8-b11e-6a6bba3c8535 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:49.013937 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce5249c-e3f4-4e42-8dcd-8afa0f42033f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:49.014532 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce5249c-e3f4-4e42-8dcd-8afa0f42033f None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:49.014807 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce5249c-e3f4-4e42-8dcd-8afa0f42033f None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:49.015075 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce5249c-e3f4-4e42-8dcd-8afa0f42033f None admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:49.015738 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce5249c-e3f4-4e42-8dcd-8afa0f42033f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:49.016042 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce5249c-e3f4-4e42-8dcd-8afa0f42033f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:49.017415 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce5249c-e3f4-4e42-8dcd-8afa0f42033f None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:49.020776 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b49adcb-e039-4934-8442-b4335faa2c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:49.021423 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b49adcb-e039-4934-8442-b4335faa2c37 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:49.021706 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b49adcb-e039-4934-8442-b4335faa2c37 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:49.021978 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b49adcb-e039-4934-8442-b4335faa2c37 None admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:49.022635 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b49adcb-e039-4934-8442-b4335faa2c37 None admin] RBAC: Adding query filter params (name=service) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:49.022939 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b49adcb-e039-4934-8442-b4335faa2c37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:49.024337 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b49adcb-e039-4934-8442-b4335faa2c37 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:49.028631 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 253/506] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 05:16:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:49.029407 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce5249c-e3f4-4e42-8dcd-8afa0f42033f None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:49.040824 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 254/507] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 11 05:16:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:49.040824 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b49adcb-e039-4934-8442-b4335faa2c37 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:49.108376 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:49.122524 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:49.125478 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce5249c-e3f4-4e42-8dcd-8afa0f42033f None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:49.140118 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b49adcb-e039-4934-8442-b4335faa2c37 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:49.159172 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc944c6c-5c05-4654-8b89-32a02569b227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:49.159832 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc944c6c-5c05-4654-8b89-32a02569b227 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:49.160110 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc944c6c-5c05-4654-8b89-32a02569b227 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:49.160387 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc944c6c-5c05-4654-8b89-32a02569b227 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:49.172629 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc944c6c-5c05-4654-8b89-32a02569b227 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:49.174021 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc944c6c-5c05-4654-8b89-32a02569b227 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:49.177554 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420118fc-4c1f-4028-8850-f4e2689c6b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:49.178165 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420118fc-4c1f-4028-8850-f4e2689c6b2e None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:49.178444 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420118fc-4c1f-4028-8850-f4e2689c6b2e None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:49.178717 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420118fc-4c1f-4028-8850-f4e2689c6b2e None admin] PATH_INFO: `/v3/users` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:49.179445 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420118fc-4c1f-4028-8850-f4e2689c6b2e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:49.179784 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420118fc-4c1f-4028-8850-f4e2689c6b2e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:49.181205 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420118fc-4c1f-4028-8850-f4e2689c6b2e None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:49.188564 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-cc944c6c-5c05-4654-8b89-32a02569b227 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:16:49.188564 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:16:49.188564 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:16:49.188564 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:16:49.188564 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:16:49.188564 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:16:49.188564 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:16:49.188564 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:16:49.188564 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:16:49.188564 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:16:49.188564 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:16:49.188564 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:16:49.188564 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 05:16:49.188564 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 05:16:49.188564 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 05:16:49.188564 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 05:16:49.189498 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:16:49.189498 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:16:49.189498 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:16:49.189498 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:16:49.189498 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:16:49.189498 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:16:49.189498 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:16:49.189498 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:16:49.189498 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:16:49.189498 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:16:49.189498 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:16:49.189498 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:16:49.189498 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:16:49.189498 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:16:49.189498 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:16:49.189498 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:16:49.189498 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 05:16:49.190342 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 05:16:49.190342 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:16:49.190342 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:16:49.190342 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 254/508] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:16:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:16:49.190564 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc944c6c-5c05-4654-8b89-32a02569b227 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:49.205939 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 255/509] 10.222.0.16 () {56 vars in 1137 bytes} [Sun Sep 11 05:16:49 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:49.205939 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420118fc-4c1f-4028-8850-f4e2689c6b2e None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:49.298899 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc944c6c-5c05-4654-8b89-32a02569b227 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:49.299799 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420118fc-4c1f-4028-8850-f4e2689c6b2e None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:49.326444 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:49.332970 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ef4ef3-b74a-4a02-ba40-3dcb9f7d4331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:49.333579 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef4ef3-b74a-4a02-ba40-3dcb9f7d4331 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:49.334475 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef4ef3-b74a-4a02-ba40-3dcb9f7d4331 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:49.334747 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef4ef3-b74a-4a02-ba40-3dcb9f7d4331 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:49.334941 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49eda8d-a888-4e46-bd96-c77155dfcd76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:49.335577 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49eda8d-a888-4e46-bd96-c77155dfcd76 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:49.335880 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49eda8d-a888-4e46-bd96-c77155dfcd76 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:49.336154 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49eda8d-a888-4e46-bd96-c77155dfcd76 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:49.343192 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49eda8d-a888-4e46-bd96-c77155dfcd76 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:49.344688 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49eda8d-a888-4e46-bd96-c77155dfcd76 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:49.355801 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:49.357449 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-a49eda8d-a888-4e46-bd96-c77155dfcd76 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 11 05:16:49.357449 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:16:49.357449 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:16:49.357449 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:16:49.357449 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:16:49.357449 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:16:49.357449 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:16:49.357449 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:16:49.357449 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:16:49.357449 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:16:49.357449 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:16:49.357449 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:16:49.357449 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 05:16:49.357449 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 05:16:49.357449 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 05:16:49.357449 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 05:16:49.358398 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:16:49.358398 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:16:49.358398 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 05:16:49.358398 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 05:16:49.358398 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 05:16:49.358398 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 05:16:49.358398 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:16:49.358398 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:16:49.358398 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:16:49.358398 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:16:49.358398 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:16:49.358398 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:16:49.358398 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:16:49.358398 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:16:49.358398 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:16:49.358398 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:16:49.358398 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:16:49.358398 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:16:49.359285 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:16:49.359285 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:16:49.359285 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 05:16:49.359285 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 05:16:49.359285 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 05:16:49.359285 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 05:16:49.359285 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 05:16:49.359285 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 05:16:49.359285 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 11 05:16:49.359285 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:16:49.359285 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 256/510] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 05:16:49 2022] GET /identity/v3/users/cinder => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:16:49.360317 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49eda8d-a888-4e46-bd96-c77155dfcd76 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:49.405300 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ef4ef3-b74a-4a02-ba40-3dcb9f7d4331 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:49.406767 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ef4ef3-b74a-4a02-ba40-3dcb9f7d4331 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:49.458161 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49eda8d-a888-4e46-bd96-c77155dfcd76 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:49.491240 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e098a3f7-a068-455f-9928-7782d3f48790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:49.491895 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e098a3f7-a068-455f-9928-7782d3f48790 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:49.492177 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e098a3f7-a068-455f-9928-7782d3f48790 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:49.492450 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e098a3f7-a068-455f-9928-7782d3f48790 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:49.503916 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e098a3f7-a068-455f-9928-7782d3f48790 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:49.505373 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e098a3f7-a068-455f-9928-7782d3f48790 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:49.512194 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 255/511] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 05:16:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 05:16:49.513051 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ef4ef3-b74a-4a02-ba40-3dcb9f7d4331 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:49.523241 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-e098a3f7-a068-455f-9928-7782d3f48790 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:16:49.523241 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:16:49.523241 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:16:49.523241 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:16:49.523241 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:16:49.523241 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:16:49.523241 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:16:49.523241 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:16:49.523241 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:16:49.523241 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:16:49.523241 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:16:49.523241 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:16:49.523241 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 05:16:49.523241 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 05:16:49.523241 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 05:16:49.523241 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 05:16:49.524360 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:16:49.524360 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:16:49.524360 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:16:49.524360 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:16:49.524360 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:16:49.524360 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:16:49.524360 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:16:49.524360 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:16:49.524360 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:16:49.524360 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:16:49.524360 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:16:49.524360 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:16:49.524360 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:16:49.524360 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:16:49.524360 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:16:49.524360 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:16:49.524360 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 05:16:49.525196 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 05:16:49.525196 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:16:49.525196 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:16:49.525196 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 257/512] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:16:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:16:49.525196 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e098a3f7-a068-455f-9928-7782d3f48790 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:49.564547 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:49.568705 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:49.613951 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ef4ef3-b74a-4a02-ba40-3dcb9f7d4331 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:49.627391 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e098a3f7-a068-455f-9928-7782d3f48790 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:49.647452 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445180ba-4249-420d-bedd-a516ef1d6e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:49.648095 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445180ba-4249-420d-bedd-a516ef1d6e03 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:49.648373 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445180ba-4249-420d-bedd-a516ef1d6e03 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:49.648644 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445180ba-4249-420d-bedd-a516ef1d6e03 None admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:49.649290 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445180ba-4249-420d-bedd-a516ef1d6e03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:49.649588 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445180ba-4249-420d-bedd-a516ef1d6e03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:49.650995 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445180ba-4249-420d-bedd-a516ef1d6e03 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:49.663005 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 256/513] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 05:16:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:49.663862 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445180ba-4249-420d-bedd-a516ef1d6e03 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:49.672595 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ac749c-14c9-4caf-a137-9af96feae7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:49.673205 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac749c-14c9-4caf-a137-9af96feae7c5 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:49.673477 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac749c-14c9-4caf-a137-9af96feae7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:49.673744 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac749c-14c9-4caf-a137-9af96feae7c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:49.741477 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ac749c-14c9-4caf-a137-9af96feae7c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:49.742902 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ac749c-14c9-4caf-a137-9af96feae7c5 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:49.765727 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445180ba-4249-420d-bedd-a516ef1d6e03 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:49.778516 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:49.782844 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:49.803749 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbf2196-9641-42cb-aafa-822709bb43d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:49.804357 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf2196-9641-42cb-aafa-822709bb43d6 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:49.804633 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf2196-9641-42cb-aafa-822709bb43d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:49.804902 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf2196-9641-42cb-aafa-822709bb43d6 None admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:49.805629 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbf2196-9641-42cb-aafa-822709bb43d6 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:49.805935 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbf2196-9641-42cb-aafa-822709bb43d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:49.807362 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbf2196-9641-42cb-aafa-822709bb43d6 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:49.840094 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 258/514] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 05:16:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 05:16:49.840939 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ac749c-14c9-4caf-a137-9af96feae7c5 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:49.843261 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 257/515] 10.222.0.16 () {56 vars in 1137 bytes} [Sun Sep 11 05:16:49 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:49.844175 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbf2196-9641-42cb-aafa-822709bb43d6 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:49.938069 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ac749c-14c9-4caf-a137-9af96feae7c5 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:49.942076 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbf2196-9641-42cb-aafa-822709bb43d6 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:49.972760 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5e166e-fb1e-401b-ba84-e1f2ce063a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:49.973379 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e166e-fb1e-401b-ba84-e1f2ce063a52 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:49.973654 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e166e-fb1e-401b-ba84-e1f2ce063a52 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:49.973928 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e166e-fb1e-401b-ba84-e1f2ce063a52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:49.981956 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619f5542-47d8-461f-b1ba-66da81b37e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:49.982562 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619f5542-47d8-461f-b1ba-66da81b37e24 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:49.982781 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:49.982872 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619f5542-47d8-461f-b1ba-66da81b37e24 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:49.983097 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619f5542-47d8-461f-b1ba-66da81b37e24 None admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:49.983769 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619f5542-47d8-461f-b1ba-66da81b37e24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:49.984406 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619f5542-47d8-461f-b1ba-66da81b37e24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:49.984763 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5e166e-fb1e-401b-ba84-e1f2ce063a52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:49.985472 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619f5542-47d8-461f-b1ba-66da81b37e24 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:49.986419 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5e166e-fb1e-401b-ba84-e1f2ce063a52 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:49.997341 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 258/516] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 05:16:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:49.998060 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619f5542-47d8-461f-b1ba-66da81b37e24 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:50.003886 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-2a5e166e-fb1e-401b-ba84-e1f2ce063a52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:16:50.003886 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:16:50.003886 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:16:50.003886 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:16:50.003886 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:16:50.003886 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:16:50.003886 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:16:50.003886 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:16:50.003886 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:16:50.003886 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:16:50.003886 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:16:50.003886 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:16:50.003886 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 05:16:50.003886 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 05:16:50.003886 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 05:16:50.003886 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 05:16:50.004814 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:16:50.004814 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:16:50.004814 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:16:50.004814 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:16:50.004814 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:16:50.004814 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:16:50.004814 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:16:50.004814 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:16:50.004814 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:16:50.004814 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:16:50.004814 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:16:50.004814 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:16:50.004814 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:16:50.004814 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:16:50.004814 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:16:50.004814 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:16:50.004814 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 05:16:50.005772 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 05:16:50.005772 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:16:50.005772 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:16:50.005772 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 259/517] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:16:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:16:50.006311 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5e166e-fb1e-401b-ba84-e1f2ce063a52 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:50.027529 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:50.095986 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619f5542-47d8-461f-b1ba-66da81b37e24 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:50.105023 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5e166e-fb1e-401b-ba84-e1f2ce063a52 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:50.129400 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d43aff-ad55-418e-a76d-106c61adf388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:50.129996 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d43aff-ad55-418e-a76d-106c61adf388 None admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:50.130270 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d43aff-ad55-418e-a76d-106c61adf388 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:50.131048 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d43aff-ad55-418e-a76d-106c61adf388 None admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:50.131701 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d43aff-ad55-418e-a76d-106c61adf388 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:50.133149 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d43aff-ad55-418e-a76d-106c61adf388 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:50.138693 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3618ae-b0fc-44a9-b782-eb555c36be4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:50.139286 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3618ae-b0fc-44a9-b782-eb555c36be4a None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:50.139563 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3618ae-b0fc-44a9-b782-eb555c36be4a None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:50.139868 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3618ae-b0fc-44a9-b782-eb555c36be4a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:50.154171 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 259/518] 10.222.0.16 () {60 vars in 1132 bytes} [Sun Sep 11 05:16:49 2022] POST /identity/v3/users => generated 247 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:16:50.155171 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d43aff-ad55-418e-a76d-106c61adf388 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:50.209903 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:50.222978 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3618ae-b0fc-44a9-b782-eb555c36be4a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:50.225094 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3618ae-b0fc-44a9-b782-eb555c36be4a None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:50.248740 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:50.266412 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d43aff-ad55-418e-a76d-106c61adf388 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:50.301706 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc1c3fa-d1ea-42aa-802f-d03db9b3c6ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:50.302357 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc1c3fa-d1ea-42aa-802f-d03db9b3c6ac None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:50.302677 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc1c3fa-d1ea-42aa-802f-d03db9b3c6ac None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:50.302949 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc1c3fa-d1ea-42aa-802f-d03db9b3c6ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:50.314593 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc1c3fa-d1ea-42aa-802f-d03db9b3c6ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:50.316129 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc1c3fa-d1ea-42aa-802f-d03db9b3c6ac None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:50.331595 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-8cc1c3fa-d1ea-42aa-802f-d03db9b3c6ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:16:50.331595 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:16:50.331595 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:16:50.331595 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:16:50.331595 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:16:50.331595 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:16:50.331595 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:16:50.331595 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:16:50.331595 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:16:50.331595 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:16:50.331595 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:16:50.331595 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:16:50.331595 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 05:16:50.331595 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 05:16:50.331595 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 05:16:50.331595 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 05:16:50.333822 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:16:50.333822 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:16:50.333822 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:16:50.333822 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:16:50.333822 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:16:50.333822 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:16:50.333822 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:16:50.333822 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:16:50.333822 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:16:50.333822 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:16:50.333822 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:16:50.333822 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:16:50.333822 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:16:50.333822 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:16:50.333822 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:16:50.333822 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:16:50.333822 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 05:16:50.334702 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 05:16:50.334702 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:16:50.334702 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:16:50.334702 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 260/519] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:16:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:16:50.334702 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc1c3fa-d1ea-42aa-802f-d03db9b3c6ac None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:50.346513 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 260/520] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 05:16:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 05:16:50.347361 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3618ae-b0fc-44a9-b782-eb555c36be4a None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:50.444854 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc1c3fa-d1ea-42aa-802f-d03db9b3c6ac None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:50.450750 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:50.462569 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3618ae-b0fc-44a9-b782-eb555c36be4a None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:50.479141 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e74d6b8-33f0-4d05-93da-ab4e9ee1aa89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:50.479803 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74d6b8-33f0-4d05-93da-ab4e9ee1aa89 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:50.480082 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74d6b8-33f0-4d05-93da-ab4e9ee1aa89 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:50.480351 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74d6b8-33f0-4d05-93da-ab4e9ee1aa89 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:50.487805 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e74d6b8-33f0-4d05-93da-ab4e9ee1aa89 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:50.489262 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e74d6b8-33f0-4d05-93da-ab4e9ee1aa89 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:50.491817 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:50.500573 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b930952b-eb2c-4a38-a963-00298c03331c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:50.501123 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930952b-eb2c-4a38-a963-00298c03331c None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:50.501405 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930952b-eb2c-4a38-a963-00298c03331c None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:50.501679 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930952b-eb2c-4a38-a963-00298c03331c None admin] PATH_INFO: `/v3/domains` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:50.502318 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b930952b-eb2c-4a38-a963-00298c03331c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:50.502622 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b930952b-eb2c-4a38-a963-00298c03331c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:50.502779 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-0e74d6b8-33f0-4d05-93da-ab4e9ee1aa89 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 11 05:16:50.502779 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:16:50.502779 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:16:50.502779 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:16:50.502779 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:16:50.502779 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:16:50.502779 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:16:50.502779 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:16:50.502779 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:16:50.502779 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:16:50.502779 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:16:50.502779 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:16:50.502779 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 05:16:50.502779 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 05:16:50.502779 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 05:16:50.502779 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 05:16:50.503647 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:16:50.503647 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:16:50.503647 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 05:16:50.503647 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 05:16:50.503647 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 05:16:50.503647 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 05:16:50.503647 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:16:50.503647 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:16:50.503647 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:16:50.503647 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:16:50.503647 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:16:50.503647 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:16:50.503647 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:16:50.503647 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:16:50.503647 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:16:50.503647 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:16:50.503647 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:16:50.503647 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:16:50.504561 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:16:50.504561 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:16:50.504561 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 05:16:50.504561 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 05:16:50.504561 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 05:16:50.504561 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 05:16:50.504561 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 05:16:50.504561 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 05:16:50.504561 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 11 05:16:50.504561 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:16:50.505069 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b930952b-eb2c-4a38-a963-00298c03331c None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:50.505136 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 261/521] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 11 05:16:50 2022] GET /identity/v3/users/neutron => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:16:50.505136 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e74d6b8-33f0-4d05-93da-ab4e9ee1aa89 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:50.519740 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 261/522] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 05:16:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:50.519740 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b930952b-eb2c-4a38-a963-00298c03331c None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:50.612411 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e74d6b8-33f0-4d05-93da-ab4e9ee1aa89 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:50.622736 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b930952b-eb2c-4a38-a963-00298c03331c None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:50.646997 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672cf574-6ec0-4d76-9103-70851a29515c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:50.647605 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672cf574-6ec0-4d76-9103-70851a29515c None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:50.647942 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672cf574-6ec0-4d76-9103-70851a29515c None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:50.648204 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672cf574-6ec0-4d76-9103-70851a29515c None admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:50.648843 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672cf574-6ec0-4d76-9103-70851a29515c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:50.649146 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672cf574-6ec0-4d76-9103-70851a29515c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:50.650521 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672cf574-6ec0-4d76-9103-70851a29515c None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:50.656993 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af921c68-f6eb-42eb-89fc-42005b31a7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:50.657668 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af921c68-f6eb-42eb-89fc-42005b31a7d4 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:50.657948 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af921c68-f6eb-42eb-89fc-42005b31a7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:50.658224 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af921c68-f6eb-42eb-89fc-42005b31a7d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:50.667439 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 262/523] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 05:16:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:50.667439 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672cf574-6ec0-4d76-9103-70851a29515c None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:50.672549 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af921c68-f6eb-42eb-89fc-42005b31a7d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:50.674061 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af921c68-f6eb-42eb-89fc-42005b31a7d4 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:50.690896 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-af921c68-f6eb-42eb-89fc-42005b31a7d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:16:50.690896 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:16:50.690896 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:16:50.690896 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:16:50.690896 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:16:50.690896 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:16:50.690896 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:16:50.690896 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:16:50.690896 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:16:50.690896 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:16:50.690896 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:16:50.690896 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:16:50.690896 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 05:16:50.690896 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 05:16:50.690896 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 05:16:50.690896 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 05:16:50.692179 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:16:50.692179 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:16:50.692179 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:16:50.692179 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:16:50.692179 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:16:50.692179 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:16:50.692179 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:16:50.692179 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:16:50.692179 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:16:50.692179 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:16:50.692179 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:16:50.692179 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:16:50.692179 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:16:50.692179 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:16:50.692179 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:16:50.692179 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:16:50.692179 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 05:16:50.693102 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 05:16:50.693102 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:16:50.693102 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:16:50.693102 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 262/524] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:16:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:16:50.693102 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af921c68-f6eb-42eb-89fc-42005b31a7d4 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:50.696795 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:50.732963 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:50.777196 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672cf574-6ec0-4d76-9103-70851a29515c None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:50.809169 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af921c68-f6eb-42eb-89fc-42005b31a7d4 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:50.815941 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d49c5c-b0f4-47de-8d5c-e5dd7114309f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:50.816552 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d49c5c-b0f4-47de-8d5c-e5dd7114309f None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:50.816828 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d49c5c-b0f4-47de-8d5c-e5dd7114309f None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:50.817106 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d49c5c-b0f4-47de-8d5c-e5dd7114309f None admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:50.817829 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d49c5c-b0f4-47de-8d5c-e5dd7114309f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:50.818659 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d49c5c-b0f4-47de-8d5c-e5dd7114309f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:50.820126 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d49c5c-b0f4-47de-8d5c-e5dd7114309f None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:50.838178 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 263/525] 10.222.0.16 () {56 vars in 1139 bytes} [Sun Sep 11 05:16:50 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:50.839041 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d49c5c-b0f4-47de-8d5c-e5dd7114309f None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:50.848897 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91173d96-0e89-48fd-86fd-8bba6e90bae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:50.850051 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91173d96-0e89-48fd-86fd-8bba6e90bae1 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:50.850329 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91173d96-0e89-48fd-86fd-8bba6e90bae1 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:50.850598 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91173d96-0e89-48fd-86fd-8bba6e90bae1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:50.857899 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91173d96-0e89-48fd-86fd-8bba6e90bae1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:50.859348 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91173d96-0e89-48fd-86fd-8bba6e90bae1 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:50.871643 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-91173d96-0e89-48fd-86fd-8bba6e90bae1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 05:16:50.871643 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:16:50.871643 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:16:50.871643 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:16:50.871643 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:16:50.871643 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:16:50.871643 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:16:50.871643 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:16:50.871643 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:16:50.871643 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:16:50.871643 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:16:50.871643 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:16:50.871643 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 05:16:50.871643 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 05:16:50.871643 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 05:16:50.872556 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 05:16:50.872556 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:16:50.872556 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:16:50.872556 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:16:50.872556 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:16:50.872556 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:16:50.872556 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:16:50.872556 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:16:50.872556 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:16:50.872556 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:16:50.872556 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:16:50.872556 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:16:50.872556 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:16:50.872556 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:16:50.872556 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:16:50.872556 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:16:50.872556 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:16:50.873417 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 05:16:50.873417 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 05:16:50.873417 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 05:16:50.873417 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 05:16:50.873417 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 05:16:50.873417 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 05:16:50.873417 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 05:16:50.873417 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:16:50.873417 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 263/526] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 05:16:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:16:50.873896 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91173d96-0e89-48fd-86fd-8bba6e90bae1 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:50.940567 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:50.952337 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d49c5c-b0f4-47de-8d5c-e5dd7114309f None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:50.972322 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:50.983232 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91173d96-0e89-48fd-86fd-8bba6e90bae1 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:50.990907 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204b1152-5f05-41e8-ace3-e8db752505de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:50.991827 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204b1152-5f05-41e8-ace3-e8db752505de None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:50.992160 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204b1152-5f05-41e8-ace3-e8db752505de None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:50.992437 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204b1152-5f05-41e8-ace3-e8db752505de None admin] PATH_INFO: `/v3/projects/service` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:50.999214 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204b1152-5f05-41e8-ace3-e8db752505de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:51.000732 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204b1152-5f05-41e8-ace3-e8db752505de None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:51.012918 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-204b1152-5f05-41e8-ace3-e8db752505de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 05:16:51.012918 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:16:51.012918 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:16:51.012918 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:16:51.012918 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:16:51.012918 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:16:51.012918 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:16:51.012918 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:16:51.012918 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:16:51.012918 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:16:51.012918 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:16:51.012918 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:16:51.012918 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 05:16:51.012918 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 05:16:51.012918 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 05:16:51.013762 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 05:16:51.013762 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:16:51.013762 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:16:51.013762 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:16:51.013762 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:16:51.013762 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:16:51.013762 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:16:51.013762 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:16:51.013762 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:16:51.013762 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:16:51.013762 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:16:51.013762 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:16:51.013762 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:16:51.013762 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:16:51.013762 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:16:51.013762 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:16:51.013762 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:16:51.014628 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 05:16:51.014628 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 05:16:51.014628 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 05:16:51.014628 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 05:16:51.014628 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 05:16:51.014628 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 05:16:51.014628 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 05:16:51.014628 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:16:51.014628 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 264/527] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 05:16:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:16:51.015700 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204b1152-5f05-41e8-ace3-e8db752505de None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:51.025495 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c1a341-e309-4dfb-be19-02a44ad069db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:51.026110 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c1a341-e309-4dfb-be19-02a44ad069db None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:51.026387 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c1a341-e309-4dfb-be19-02a44ad069db None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:51.026658 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c1a341-e309-4dfb-be19-02a44ad069db None admin] PATH_INFO: `/v3/domains` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:51.027749 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c1a341-e309-4dfb-be19-02a44ad069db None admin] RBAC: Adding query filter params (name=Default) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:51.028001 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c1a341-e309-4dfb-be19-02a44ad069db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:51.029694 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c1a341-e309-4dfb-be19-02a44ad069db None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:51.046444 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 264/528] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 05:16:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:51.046444 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c1a341-e309-4dfb-be19-02a44ad069db None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:51.128399 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204b1152-5f05-41e8-ace3-e8db752505de None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:51.147060 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c1a341-e309-4dfb-be19-02a44ad069db None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:51.164038 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d35bd02-9686-4bd3-9ce7-26fdd0b6992b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:51.164638 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d35bd02-9686-4bd3-9ce7-26fdd0b6992b None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:51.164921 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d35bd02-9686-4bd3-9ce7-26fdd0b6992b None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:51.165237 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d35bd02-9686-4bd3-9ce7-26fdd0b6992b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:51.173231 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:51.185609 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45489d17-8742-400b-a4b4-0448955d003f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:51.186432 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45489d17-8742-400b-a4b4-0448955d003f None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:51.186768 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45489d17-8742-400b-a4b4-0448955d003f None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:51.187368 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45489d17-8742-400b-a4b4-0448955d003f None admin] PATH_INFO: `/v3/projects` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:51.188150 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45489d17-8742-400b-a4b4-0448955d003f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:51.188525 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45489d17-8742-400b-a4b4-0448955d003f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:51.190433 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45489d17-8742-400b-a4b4-0448955d003f None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:51.215528 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 265/529] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 05:16:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:51.215528 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45489d17-8742-400b-a4b4-0448955d003f None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:51.219030 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:51.244818 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d35bd02-9686-4bd3-9ce7-26fdd0b6992b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:51.246370 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d35bd02-9686-4bd3-9ce7-26fdd0b6992b None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:51.323302 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45489d17-8742-400b-a4b4-0448955d003f None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:51.354674 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 265/530] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 05:16:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 05:16:51.355891 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d35bd02-9686-4bd3-9ce7-26fdd0b6992b None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:51.362264 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b58e371-b295-4f97-aca5-a2fa85dac8f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:51.363022 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58e371-b295-4f97-aca5-a2fa85dac8f4 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:51.363401 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58e371-b295-4f97-aca5-a2fa85dac8f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:51.363807 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58e371-b295-4f97-aca5-a2fa85dac8f4 None admin] PATH_INFO: `/v3/projects` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:51.364603 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b58e371-b295-4f97-aca5-a2fa85dac8f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:51.365077 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b58e371-b295-4f97-aca5-a2fa85dac8f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:51.366866 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b58e371-b295-4f97-aca5-a2fa85dac8f4 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:51.378945 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 266/531] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 05:16:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:51.379906 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b58e371-b295-4f97-aca5-a2fa85dac8f4 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:51.428200 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:51.441866 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:51.466882 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d35bd02-9686-4bd3-9ce7-26fdd0b6992b None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:51.488534 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b58e371-b295-4f97-aca5-a2fa85dac8f4 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:51.502607 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fea3c26-8502-4b40-a243-18c98a7c9646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:51.503343 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea3c26-8502-4b40-a243-18c98a7c9646 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:51.503717 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea3c26-8502-4b40-a243-18c98a7c9646 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:51.504077 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea3c26-8502-4b40-a243-18c98a7c9646 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:51.511022 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fea3c26-8502-4b40-a243-18c98a7c9646 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:51.512531 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fea3c26-8502-4b40-a243-18c98a7c9646 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:51.524328 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-4fea3c26-8502-4b40-a243-18c98a7c9646 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 05:16:51.524328 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:16:51.524328 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:16:51.524328 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:16:51.524328 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:16:51.524328 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:16:51.524328 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:16:51.524328 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:16:51.524328 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:16:51.524328 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:16:51.524328 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:16:51.524328 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:16:51.524328 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 05:16:51.524328 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 05:16:51.524328 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 05:16:51.525378 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 05:16:51.525378 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:16:51.525378 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:16:51.525378 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:16:51.525378 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:16:51.525378 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:16:51.525378 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:16:51.525378 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:16:51.525378 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:16:51.525378 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:16:51.525378 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:16:51.525378 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:16:51.525378 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:16:51.525378 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:16:51.525378 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:16:51.525378 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:16:51.525378 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:16:51.526256 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 05:16:51.526256 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 05:16:51.526256 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 05:16:51.526256 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 05:16:51.526256 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 05:16:51.526256 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 05:16:51.526256 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 05:16:51.526256 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:16:51.526256 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 266/532] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 05:16:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:16:51.526713 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fea3c26-8502-4b40-a243-18c98a7c9646 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:51.531747 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b141f5-46dd-4766-a0cf-f43d094c3e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:51.532564 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b141f5-46dd-4766-a0cf-f43d094c3e78 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:51.533017 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b141f5-46dd-4766-a0cf-f43d094c3e78 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:51.533433 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b141f5-46dd-4766-a0cf-f43d094c3e78 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:51.534325 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b141f5-46dd-4766-a0cf-f43d094c3e78 None admin] RBAC: Adding query filter params (role.id=82bd224e8afc480782a85b833a2aa03e, scope.project.id=61ffb079d9e1437084945554bcc0747b, user.id=6cd6136036bd467c946cae90d5c29263) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:51.534781 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b141f5-46dd-4766-a0cf-f43d094c3e78 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:51.537176 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b141f5-46dd-4766-a0cf-f43d094c3e78 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:51.547648 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 267/533] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 05:16:51 2022] GET /identity/v3/role_assignments?user.id=6cd6136036bd467c946cae90d5c29263&scope.project.id=61ffb079d9e1437084945554bcc0747b&role.id=82bd224e8afc480782a85b833a2aa03e => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:51.548704 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b141f5-46dd-4766-a0cf-f43d094c3e78 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:51.641062 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fea3c26-8502-4b40-a243-18c98a7c9646 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:51.677105 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b141f5-46dd-4766-a0cf-f43d094c3e78 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:51.686075 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b5596b-16fc-4455-ba62-41e3ba50b9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:51.687239 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b5596b-16fc-4455-ba62-41e3ba50b9a2 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:51.687526 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b5596b-16fc-4455-ba62-41e3ba50b9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:51.687885 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b5596b-16fc-4455-ba62-41e3ba50b9a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:51.689670 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:51.691323 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:51.702517 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b5596b-16fc-4455-ba62-41e3ba50b9a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:51.704092 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b5596b-16fc-4455-ba62-41e3ba50b9a2 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:51.723100 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff6bd97-e162-411a-92fb-5353aa83dcc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:51.723528 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-18b5596b-16fc-4455-ba62-41e3ba50b9a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:16:51.723528 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:16:51.723528 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:16:51.723528 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:16:51.723528 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:16:51.723528 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:16:51.723528 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:16:51.723528 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:16:51.723528 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:16:51.723528 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:16:51.723528 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:16:51.723528 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:16:51.723528 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 05:16:51.723528 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 05:16:51.723528 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 05:16:51.723528 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 05:16:51.725162 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:16:51.725162 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:16:51.725162 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:16:51.725162 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:16:51.725162 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:16:51.725162 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:16:51.725162 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:16:51.725162 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:16:51.725162 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:16:51.725162 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:16:51.725162 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:16:51.725162 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:16:51.725162 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:16:51.725162 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:16:51.725162 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:16:51.725162 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:16:51.725162 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 05:16:51.726110 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 05:16:51.726110 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:16:51.726110 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:16:51.726110 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 267/534] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:16:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:16:51.726335 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b5596b-16fc-4455-ba62-41e3ba50b9a2 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:51.727023 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6bd97-e162-411a-92fb-5353aa83dcc3 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:51.727446 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6bd97-e162-411a-92fb-5353aa83dcc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:51.727881 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6bd97-e162-411a-92fb-5353aa83dcc3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:51.728801 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff6bd97-e162-411a-92fb-5353aa83dcc3 None admin] RBAC: Adding query filter params (role.id=82bd224e8afc480782a85b833a2aa03e, scope.project.id=61ffb079d9e1437084945554bcc0747b, user.id=bdd09106382447e9bf8b3a6a9ada89b0) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:51.729279 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff6bd97-e162-411a-92fb-5353aa83dcc3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:51.730921 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff6bd97-e162-411a-92fb-5353aa83dcc3 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:51.738191 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 268/535] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 05:16:51 2022] GET /identity/v3/role_assignments?user.id=bdd09106382447e9bf8b3a6a9ada89b0&scope.project.id=61ffb079d9e1437084945554bcc0747b&role.id=82bd224e8afc480782a85b833a2aa03e => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:51.739290 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff6bd97-e162-411a-92fb-5353aa83dcc3 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:51.864365 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b5596b-16fc-4455-ba62-41e3ba50b9a2 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:51.869506 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff6bd97-e162-411a-92fb-5353aa83dcc3 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:51.903454 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0eb671-e83f-48b6-82d9-201e1cb5fdab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:51.904265 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0eb671-e83f-48b6-82d9-201e1cb5fdab None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:51.904744 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0eb671-e83f-48b6-82d9-201e1cb5fdab None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:51.905216 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0eb671-e83f-48b6-82d9-201e1cb5fdab None admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:51.906019 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0eb671-e83f-48b6-82d9-201e1cb5fdab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:51.906443 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0eb671-e83f-48b6-82d9-201e1cb5fdab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:51.906721 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32c38b1-0163-4b2a-82b7-3d54d5f5be16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:51.907489 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32c38b1-0163-4b2a-82b7-3d54d5f5be16 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:51.908029 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32c38b1-0163-4b2a-82b7-3d54d5f5be16 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:51.908328 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0eb671-e83f-48b6-82d9-201e1cb5fdab None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:51.908602 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32c38b1-0163-4b2a-82b7-3d54d5f5be16 None admin] PATH_INFO: `/v3/domains` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:51.909389 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32c38b1-0163-4b2a-82b7-3d54d5f5be16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:51.909838 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32c38b1-0163-4b2a-82b7-3d54d5f5be16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:51.911377 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32c38b1-0163-4b2a-82b7-3d54d5f5be16 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:51.925254 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 269/536] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 05:16:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:51.932783 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32c38b1-0163-4b2a-82b7-3d54d5f5be16 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:51.935722 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 268/537] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 05:16:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:51.936751 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0eb671-e83f-48b6-82d9-201e1cb5fdab None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:51.998410 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:52.009096 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:52.061995 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0eb671-e83f-48b6-82d9-201e1cb5fdab None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:52.100522 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d3dc16-ce9b-4f8b-af83-c22b48147a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:52.101256 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d3dc16-ce9b-4f8b-af83-c22b48147a60 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:52.101537 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d3dc16-ce9b-4f8b-af83-c22b48147a60 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:52.101809 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d3dc16-ce9b-4f8b-af83-c22b48147a60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:52.102540 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d3dc16-ce9b-4f8b-af83-c22b48147a60 None admin] RBAC: Adding query filter params (role.id=82bd224e8afc480782a85b833a2aa03e, scope.project.id=61ffb079d9e1437084945554bcc0747b, user.id=5a147e14b61d481db1cac02c58ac3500) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:52.102848 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d3dc16-ce9b-4f8b-af83-c22b48147a60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:52.104342 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d3dc16-ce9b-4f8b-af83-c22b48147a60 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:52.115781 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 269/538] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 05:16:51 2022] GET /identity/v3/role_assignments?user.id=5a147e14b61d481db1cac02c58ac3500&scope.project.id=61ffb079d9e1437084945554bcc0747b&role.id=82bd224e8afc480782a85b833a2aa03e => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:16:52.186804 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32c38b1-0163-4b2a-82b7-3d54d5f5be16 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:52.240966 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627de250-80f3-4c03-af24-0fa6987fb176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:52.241866 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627de250-80f3-4c03-af24-0fa6987fb176 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:52.242141 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627de250-80f3-4c03-af24-0fa6987fb176 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:52.242413 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627de250-80f3-4c03-af24-0fa6987fb176 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:52.250010 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627de250-80f3-4c03-af24-0fa6987fb176 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:52.251550 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627de250-80f3-4c03-af24-0fa6987fb176 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:52.265425 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-627de250-80f3-4c03-af24-0fa6987fb176 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 05:16:52.265425 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:16:52.265425 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:16:52.265425 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:16:52.265425 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:16:52.265425 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:16:52.265425 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:16:52.265425 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:16:52.265425 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:16:52.265425 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:16:52.265425 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:16:52.265425 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:16:52.265425 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 05:16:52.265425 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 05:16:52.265425 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 05:16:52.266346 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 05:16:52.266346 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:16:52.266346 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:16:52.266346 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:16:52.266346 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:16:52.266346 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:16:52.266346 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:16:52.266346 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:16:52.266346 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:16:52.266346 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:16:52.266346 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:16:52.266346 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:16:52.266346 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:16:52.266346 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:16:52.266346 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:16:52.266346 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:16:52.266346 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:16:52.267182 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 05:16:52.267182 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 05:16:52.267182 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 05:16:52.267182 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 05:16:52.267182 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 05:16:52.267182 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 05:16:52.267182 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 05:16:52.267182 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:16:52.267182 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 270/539] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 05:16:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:16:52.275701 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d3dc16-ce9b-4f8b-af83-c22b48147a60 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:52.398513 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca8a2d2-8f28-475e-9aa4-750f1760b293 None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:52.398851 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca8a2d2-8f28-475e-9aa4-750f1760b293 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:52.399050 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca8a2d2-8f28-475e-9aa4-750f1760b293 None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:52.400867 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 271/540] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:16:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 05:16:52.408214 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2958c02c-d114-410c-809f-6e483f5c7498 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:52.408491 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2958c02c-d114-410c-809f-6e483f5c7498 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:52.408759 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2958c02c-d114-410c-809f-6e483f5c7498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:52.418545 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d3dc16-ce9b-4f8b-af83-c22b48147a60 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:52.433122 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:52.434179 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-2958c02c-d114-410c-809f-6e483f5c7498 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:16:52.435372 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-2958c02c-d114-410c-809f-6e483f5c7498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:16:52.473074 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5b3731-ba00-48eb-965a-f4125511a592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:52.473676 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b3731-ba00-48eb-965a-f4125511a592 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:52.473955 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b3731-ba00-48eb-965a-f4125511a592 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:52.474225 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b3731-ba00-48eb-965a-f4125511a592 None admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:52.475483 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5b3731-ba00-48eb-965a-f4125511a592 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:52.475819 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5b3731-ba00-48eb-965a-f4125511a592 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:52.477302 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5b3731-ba00-48eb-965a-f4125511a592 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:52.500013 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 270/541] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 05:16:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:52.506402 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5b3731-ba00-48eb-965a-f4125511a592 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:52.514652 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 272/542] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:16:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 05:16:52.643043 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5b3731-ba00-48eb-965a-f4125511a592 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:52.677412 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9304b7c1-d934-4f6a-b4ee-04bd15f44b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:52.678089 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9304b7c1-d934-4f6a-b4ee-04bd15f44b98 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:52.678362 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9304b7c1-d934-4f6a-b4ee-04bd15f44b98 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:52.678630 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9304b7c1-d934-4f6a-b4ee-04bd15f44b98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:52.679351 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9304b7c1-d934-4f6a-b4ee-04bd15f44b98 None admin] RBAC: Adding query filter params (role.id=82bd224e8afc480782a85b833a2aa03e, scope.project.id=61ffb079d9e1437084945554bcc0747b, user.id=72086abb4e0547dc96d76a44886805ff) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:52.679655 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9304b7c1-d934-4f6a-b4ee-04bd15f44b98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:52.681152 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9304b7c1-d934-4f6a-b4ee-04bd15f44b98 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:52.686989 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 271/543] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 05:16:52 2022] GET /identity/v3/role_assignments?user.id=72086abb4e0547dc96d76a44886805ff&scope.project.id=61ffb079d9e1437084945554bcc0747b&role.id=82bd224e8afc480782a85b833a2aa03e => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:52.834251 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2958c02c-d114-410c-809f-6e483f5c7498 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:52.863490 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:52.962808 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2958c02c-d114-410c-809f-6e483f5c7498 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:53.006712 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8983fc-f59f-440c-83e4-a2930e5ad524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:53.007350 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8983fc-f59f-440c-83e4-a2930e5ad524 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:53.007626 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8983fc-f59f-440c-83e4-a2930e5ad524 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:53.007921 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8983fc-f59f-440c-83e4-a2930e5ad524 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:53.024239 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8983fc-f59f-440c-83e4-a2930e5ad524 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:16:53.029012 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-3f8983fc-f59f-440c-83e4-a2930e5ad524 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 05:16:53.029012 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:16:53.029012 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:16:53.029012 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:16:53.029012 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:16:53.029012 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:16:53.029012 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:16:53.029012 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:16:53.029012 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:16:53.029012 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:16:53.029012 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:16:53.029012 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:16:53.029012 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:16:53.029012 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:16:53.029012 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:16:53.029012 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:16:53.029892 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:16:53.029892 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:16:53.029892 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:16:53.029892 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:16:53.029892 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:16:53.029892 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:16:53.029892 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:16:53.029892 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:16:53.029892 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:16:53.029892 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:16:53.029892 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:16:53.029892 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:16:53.029892 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:16:53.029892 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:16:53.029892 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:16:53.029892 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:16:53.030681 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:16:53.030681 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:16:53.030681 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:16:53.030681 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:16:53.030681 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:16:53.030681 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:16:53.030681 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:16:53.030681 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:16:53.030681 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:16:53.030681 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:16:53.030681 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 05:16:53.030681 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:16:53.030681 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 273/544] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 11 05:16:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:16:53.038135 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9304b7c1-d934-4f6a-b4ee-04bd15f44b98 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:53.096618 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:53.181132 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9304b7c1-d934-4f6a-b4ee-04bd15f44b98 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:53.216293 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f642e14-9507-429c-9e36-c5b217b17eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:53.216907 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f642e14-9507-429c-9e36-c5b217b17eec None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:53.217183 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f642e14-9507-429c-9e36-c5b217b17eec None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:53.217452 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f642e14-9507-429c-9e36-c5b217b17eec None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:53.218115 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f642e14-9507-429c-9e36-c5b217b17eec None admin] RBAC: Adding query filter params (name=service) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:53.218414 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f642e14-9507-429c-9e36-c5b217b17eec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:53.219862 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f642e14-9507-429c-9e36-c5b217b17eec None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:53.229258 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 272/545] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 11 05:16:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:53.240828 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8983fc-f59f-440c-83e4-a2930e5ad524 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:53.370159 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:53.390146 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8983fc-f59f-440c-83e4-a2930e5ad524 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:53.437396 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d516bfff-9108-4067-98e2-15887168bce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:53.438026 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d516bfff-9108-4067-98e2-15887168bce7 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:53.438302 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d516bfff-9108-4067-98e2-15887168bce7 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:53.438573 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d516bfff-9108-4067-98e2-15887168bce7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:53.452365 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d516bfff-9108-4067-98e2-15887168bce7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:53.457218 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d516bfff-9108-4067-98e2-15887168bce7 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:53.485677 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-d516bfff-9108-4067-98e2-15887168bce7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:16:53.485677 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:16:53.485677 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:16:53.485677 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:16:53.485677 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:16:53.485677 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:16:53.485677 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:16:53.485677 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:16:53.485677 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:16:53.485677 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:16:53.485677 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:16:53.485677 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:16:53.485677 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 05:16:53.485677 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 05:16:53.485677 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 05:16:53.485677 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 05:16:53.487914 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:16:53.487914 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:16:53.487914 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:16:53.487914 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:16:53.487914 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:16:53.487914 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:16:53.487914 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:16:53.487914 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:16:53.487914 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:16:53.487914 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:16:53.487914 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:16:53.487914 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:16:53.487914 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:16:53.487914 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:16:53.487914 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:16:53.487914 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:16:53.487914 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 05:16:53.490023 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 05:16:53.490023 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:16:53.490023 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:16:53.490023 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 274/546] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:16:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:16:53.493499 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f642e14-9507-429c-9e36-c5b217b17eec None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:53.629459 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:53.634591 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f642e14-9507-429c-9e36-c5b217b17eec None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:53.691706 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f58ddb7-e5ed-4c29-9cd2-099ce2e48ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:53.692328 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58ddb7-e5ed-4c29-9cd2-099ce2e48ecc None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:53.692611 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58ddb7-e5ed-4c29-9cd2-099ce2e48ecc None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:53.692883 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58ddb7-e5ed-4c29-9cd2-099ce2e48ecc None admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:53.693596 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f58ddb7-e5ed-4c29-9cd2-099ce2e48ecc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:53.693956 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f58ddb7-e5ed-4c29-9cd2-099ce2e48ecc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:53.695397 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f58ddb7-e5ed-4c29-9cd2-099ce2e48ecc None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:53.711639 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 273/547] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 05:16:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:53.716842 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d516bfff-9108-4067-98e2-15887168bce7 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:53.897858 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d516bfff-9108-4067-98e2-15887168bce7 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:53.946608 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a962fd-b010-4fcf-9005-1f71c63555d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:53.947242 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a962fd-b010-4fcf-9005-1f71c63555d1 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:53.947521 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a962fd-b010-4fcf-9005-1f71c63555d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:53.947815 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a962fd-b010-4fcf-9005-1f71c63555d1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:53.949832 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:53.960771 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a962fd-b010-4fcf-9005-1f71c63555d1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:53.962242 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a962fd-b010-4fcf-9005-1f71c63555d1 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:53.977670 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-a9a962fd-b010-4fcf-9005-1f71c63555d1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 11 05:16:53.977670 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:16:53.977670 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:16:53.977670 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:16:53.977670 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:16:53.977670 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:16:53.977670 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:16:53.977670 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:16:53.977670 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:16:53.977670 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:16:53.977670 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:16:53.977670 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:16:53.977670 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 05:16:53.977670 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 05:16:53.977670 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 05:16:53.977670 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 05:16:53.979392 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:16:53.979392 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:16:53.979392 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 05:16:53.979392 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 05:16:53.979392 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 05:16:53.979392 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 05:16:53.979392 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:16:53.979392 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:16:53.979392 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:16:53.979392 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:16:53.979392 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:16:53.979392 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:16:53.979392 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:16:53.979392 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:16:53.979392 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:16:53.979392 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:16:53.979392 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:16:53.979392 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:16:53.982281 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:16:53.982281 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:16:53.982281 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 05:16:53.982281 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 05:16:53.982281 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 05:16:53.982281 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 05:16:53.982281 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 05:16:53.982281 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 05:16:53.982281 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 11 05:16:53.982281 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:16:53.982281 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 275/548] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 05:16:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:16:53.988244 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f58ddb7-e5ed-4c29-9cd2-099ce2e48ecc None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:54.140316 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f58ddb7-e5ed-4c29-9cd2-099ce2e48ecc None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:54.182463 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f60b8f-6922-4dfd-87ff-cb11cd42c339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:54.182990 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f60b8f-6922-4dfd-87ff-cb11cd42c339 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:54.183266 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f60b8f-6922-4dfd-87ff-cb11cd42c339 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:54.183535 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f60b8f-6922-4dfd-87ff-cb11cd42c339 None admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:54.184290 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f60b8f-6922-4dfd-87ff-cb11cd42c339 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:54.184590 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f60b8f-6922-4dfd-87ff-cb11cd42c339 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:54.186291 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f60b8f-6922-4dfd-87ff-cb11cd42c339 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:54.210440 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 274/549] 10.222.0.16 () {56 vars in 1135 bytes} [Sun Sep 11 05:16:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:54.216139 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a962fd-b010-4fcf-9005-1f71c63555d1 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:54.376250 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a962fd-b010-4fcf-9005-1f71c63555d1 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:54.421290 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e340f3-355e-4358-a751-61a0181a059b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:54.421903 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e340f3-355e-4358-a751-61a0181a059b None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:54.422185 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e340f3-355e-4358-a751-61a0181a059b None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:54.422465 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e340f3-355e-4358-a751-61a0181a059b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:54.477442 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e0d3d-46ff-46f0-8be7-f42c2dcde9a0 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:54.477633 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e0d3d-46ff-46f0-8be7-f42c2dcde9a0 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:54.477930 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e0d3d-46ff-46f0-8be7-f42c2dcde9a0 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:54.479594 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 275/550] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:16:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:16:54.486564 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e47089-14ac-485a-835a-2be5229aac72 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:54.486873 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e47089-14ac-485a-835a-2be5229aac72 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:54.487126 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e47089-14ac-485a-835a-2be5229aac72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:54.495132 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e340f3-355e-4358-a751-61a0181a059b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:54.496675 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e340f3-355e-4358-a751-61a0181a059b None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:54.514712 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:54.522069 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-c7e47089-14ac-485a-835a-2be5229aac72 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:16:54.523277 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-c7e47089-14ac-485a-835a-2be5229aac72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:16:54.550587 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:54.612181 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 276/551] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 05:16:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 05:16:54.614458 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e340f3-355e-4358-a751-61a0181a059b None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:54.682836 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 276/552] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:16:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 05:16:54.703356 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3b757-8bd8-4e62-ac1a-12db961da280 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:54.703627 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3b757-8bd8-4e62-ac1a-12db961da280 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:54.703970 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3b757-8bd8-4e62-ac1a-12db961da280 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:54.705275 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 277/553] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:16:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 05:16:54.712106 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277258d5-2e40-4082-a8f1-a6fd50e6bada None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:54.712384 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277258d5-2e40-4082-a8f1-a6fd50e6bada None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:54.712655 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277258d5-2e40-4082-a8f1-a6fd50e6bada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:54.720131 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:54.724540 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e340f3-355e-4358-a751-61a0181a059b None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:54.748370 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-277258d5-2e40-4082-a8f1-a6fd50e6bada None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:16:54.749482 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-277258d5-2e40-4082-a8f1-a6fd50e6bada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:16:54.763112 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8424004a-7ae5-4c04-9343-28239e9c0fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:54.763779 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8424004a-7ae5-4c04-9343-28239e9c0fb6 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:54.764063 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8424004a-7ae5-4c04-9343-28239e9c0fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:54.764338 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8424004a-7ae5-4c04-9343-28239e9c0fb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:54.775439 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8424004a-7ae5-4c04-9343-28239e9c0fb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:54.776935 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8424004a-7ae5-4c04-9343-28239e9c0fb6 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:54.792854 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-8424004a-7ae5-4c04-9343-28239e9c0fb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:16:54.792854 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:16:54.792854 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:16:54.792854 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:16:54.792854 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:16:54.792854 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:16:54.792854 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:16:54.792854 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:16:54.792854 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:16:54.792854 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:16:54.792854 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:16:54.792854 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:16:54.792854 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 05:16:54.792854 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 05:16:54.792854 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 05:16:54.792854 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 05:16:54.793774 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:16:54.793774 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:16:54.793774 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:16:54.793774 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:16:54.793774 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:16:54.793774 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:16:54.793774 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:16:54.793774 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:16:54.793774 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:16:54.793774 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:16:54.793774 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:16:54.793774 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:16:54.793774 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:16:54.793774 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:16:54.793774 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:16:54.793774 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:16:54.793774 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 05:16:54.794654 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 05:16:54.794654 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:16:54.794654 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:16:54.794654 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 277/554] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:16:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 05:16:54.800179 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8424004a-7ae5-4c04-9343-28239e9c0fb6 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:54.907361 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 278/555] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:16:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 05:16:54.919083 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8424004a-7ae5-4c04-9343-28239e9c0fb6 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:54.954839 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f978ee-c7e4-48d9-840c-452227bea7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:54.955452 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f978ee-c7e4-48d9-840c-452227bea7eb None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:54.955769 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f978ee-c7e4-48d9-840c-452227bea7eb None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:54.956048 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f978ee-c7e4-48d9-840c-452227bea7eb None admin] PATH_INFO: `/v3/domains` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:54.956698 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f978ee-c7e4-48d9-840c-452227bea7eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:54.957004 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f978ee-c7e4-48d9-840c-452227bea7eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:54.958391 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f978ee-c7e4-48d9-840c-452227bea7eb None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:54.971511 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 278/556] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 05:16:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:54.977470 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277258d5-2e40-4082-a8f1-a6fd50e6bada None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:55.088908 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:55.113320 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277258d5-2e40-4082-a8f1-a6fd50e6bada None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:55.132887 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f978ee-c7e4-48d9-840c-452227bea7eb None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:55.145388 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:55.157137 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded2536c-3ba6-4304-91f4-4e7523335692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:55.158507 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded2536c-3ba6-4304-91f4-4e7523335692 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:55.159091 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded2536c-3ba6-4304-91f4-4e7523335692 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:55.159557 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded2536c-3ba6-4304-91f4-4e7523335692 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:55.167705 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded2536c-3ba6-4304-91f4-4e7523335692 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:55.169713 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded2536c-3ba6-4304-91f4-4e7523335692 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:55.181555 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-ded2536c-3ba6-4304-91f4-4e7523335692 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 05:16:55.181555 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:16:55.181555 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:16:55.181555 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:16:55.181555 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:16:55.181555 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:16:55.181555 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:16:55.181555 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:16:55.181555 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:16:55.181555 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:16:55.181555 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:16:55.181555 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:16:55.181555 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 05:16:55.181555 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 05:16:55.181555 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 05:16:55.182419 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 05:16:55.182419 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:16:55.182419 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:16:55.182419 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:16:55.182419 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:16:55.182419 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:16:55.182419 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:16:55.182419 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:16:55.182419 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:16:55.182419 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:16:55.182419 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:16:55.182419 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:16:55.182419 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:16:55.182419 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:16:55.182419 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:16:55.182419 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:16:55.182419 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:16:55.183290 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 05:16:55.183290 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 05:16:55.183290 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 05:16:55.183290 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 05:16:55.183290 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 05:16:55.183290 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 05:16:55.183290 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 05:16:55.183290 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:16:55.185837 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 279/557] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 05:16:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:16:55.187155 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be181a3-1086-46f4-81f5-964e0424b2c3 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:55.187506 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be181a3-1086-46f4-81f5-964e0424b2c3 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:55.187871 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be181a3-1086-46f4-81f5-964e0424b2c3 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:55.189563 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 280/558] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:16:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:16:55.193935 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be181a3-1086-46f4-81f5-964e0424b2c3 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:55.254184 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f978ee-c7e4-48d9-840c-452227bea7eb None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:55.298831 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a50a65-4b02-4067-9e40-9574c875a77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:55.299861 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a50a65-4b02-4067-9e40-9574c875a77e None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:55.300500 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a50a65-4b02-4067-9e40-9574c875a77e None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:55.301015 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a50a65-4b02-4067-9e40-9574c875a77e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:55.316614 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a50a65-4b02-4067-9e40-9574c875a77e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:16:55.317647 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be181a3-1086-46f4-81f5-964e0424b2c3 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:55.325555 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-90a50a65-4b02-4067-9e40-9574c875a77e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 05:16:55.325555 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:16:55.325555 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:16:55.325555 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:16:55.325555 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:16:55.325555 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:16:55.325555 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:16:55.325555 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:16:55.325555 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:16:55.325555 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:16:55.325555 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:16:55.325555 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:16:55.325555 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:16:55.325555 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:16:55.325555 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:16:55.325555 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:16:55.327123 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:16:55.327123 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:16:55.327123 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:16:55.327123 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:16:55.327123 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:16:55.327123 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:16:55.327123 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:16:55.327123 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:16:55.327123 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:16:55.327123 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:16:55.327123 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:16:55.327123 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:16:55.327123 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:16:55.327123 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:16:55.327123 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:16:55.327123 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:16:55.328251 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:16:55.328251 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:16:55.328251 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:16:55.328251 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:16:55.328251 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:16:55.328251 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:16:55.328251 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:16:55.328251 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:16:55.328251 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:16:55.328251 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:16:55.328251 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 05:16:55.328251 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:16:55.331816 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 279/559] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 11 05:16:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:16:55.333255 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd7c8f6-0ddb-4288-a1d8-d1f3476c0586 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:55.333574 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd7c8f6-0ddb-4288-a1d8-d1f3476c0586 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:55.334429 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd7c8f6-0ddb-4288-a1d8-d1f3476c0586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:55.352089 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-acd7c8f6-0ddb-4288-a1d8-d1f3476c0586 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:16:55.353213 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-acd7c8f6-0ddb-4288-a1d8-d1f3476c0586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:16:55.358874 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4966f4a-9575-4cfc-9ed9-e414736398bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:55.359474 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4966f4a-9575-4cfc-9ed9-e414736398bd None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:55.359794 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4966f4a-9575-4cfc-9ed9-e414736398bd None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:55.360071 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4966f4a-9575-4cfc-9ed9-e414736398bd None admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:55.360758 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4966f4a-9575-4cfc-9ed9-e414736398bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:55.361062 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4966f4a-9575-4cfc-9ed9-e414736398bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:55.362496 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4966f4a-9575-4cfc-9ed9-e414736398bd None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:55.364949 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:55.375115 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 281/560] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 05:16:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:55.376316 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1239d09e-76d4-40b7-a6bc-84a3b6428916 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:55.376598 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1239d09e-76d4-40b7-a6bc-84a3b6428916 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:55.376872 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1239d09e-76d4-40b7-a6bc-84a3b6428916 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:55.378063 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 282/561] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:16:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:16:55.378814 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1239d09e-76d4-40b7-a6bc-84a3b6428916 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:55.418396 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:55.426401 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 280/562] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:16:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 05:16:55.427206 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd7c8f6-0ddb-4288-a1d8-d1f3476c0586 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:55.497596 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1239d09e-76d4-40b7-a6bc-84a3b6428916 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:55.530069 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd7c8f6-0ddb-4288-a1d8-d1f3476c0586 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:55.533090 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3292a22-48a1-49b2-be3a-ef0832f3b717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:55.533717 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3292a22-48a1-49b2-be3a-ef0832f3b717 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:55.533988 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3292a22-48a1-49b2-be3a-ef0832f3b717 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:55.534253 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3292a22-48a1-49b2-be3a-ef0832f3b717 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:55.546633 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3292a22-48a1-49b2-be3a-ef0832f3b717 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:16:55.551458 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-d3292a22-48a1-49b2-be3a-ef0832f3b717 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 05:16:55.551458 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:16:55.551458 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:16:55.551458 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:16:55.551458 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:16:55.551458 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:16:55.551458 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:16:55.551458 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:16:55.551458 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:16:55.551458 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:16:55.551458 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:16:55.551458 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:16:55.551458 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:16:55.551458 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:16:55.551458 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:16:55.551458 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:16:55.552671 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:16:55.552671 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:16:55.552671 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:16:55.552671 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:16:55.552671 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:16:55.552671 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:16:55.552671 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:16:55.552671 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:16:55.552671 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:16:55.552671 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:16:55.552671 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:16:55.552671 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:16:55.552671 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:16:55.552671 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:16:55.552671 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:16:55.552671 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:16:55.553539 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:16:55.553539 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:16:55.553539 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:16:55.553539 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:16:55.553539 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:16:55.553539 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:16:55.553539 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:16:55.553539 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:16:55.553539 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:16:55.553539 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:16:55.553539 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 05:16:55.553539 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:16:55.553539 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 283/563] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 11 05:16:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:16:55.553539 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3292a22-48a1-49b2-be3a-ef0832f3b717 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:55.569538 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1150d60-a06a-483b-86d2-236e6b6ec89b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:55.570401 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1150d60-a06a-483b-86d2-236e6b6ec89b None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:55.570904 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1150d60-a06a-483b-86d2-236e6b6ec89b None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:55.571374 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1150d60-a06a-483b-86d2-236e6b6ec89b None admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:55.572305 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1150d60-a06a-483b-86d2-236e6b6ec89b None admin] RBAC: Adding query filter params (name=service) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:55.572865 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1150d60-a06a-483b-86d2-236e6b6ec89b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:55.574524 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1150d60-a06a-483b-86d2-236e6b6ec89b None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:55.583083 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 281/564] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 11 05:16:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:55.585168 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ac4a0-1896-43a1-a1a2-7e06159358c6 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:55.585449 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ac4a0-1896-43a1-a1a2-7e06159358c6 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:55.585736 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ac4a0-1896-43a1-a1a2-7e06159358c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:55.604136 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-200ac4a0-1896-43a1-a1a2-7e06159358c6 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:16:55.605234 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-200ac4a0-1896-43a1-a1a2-7e06159358c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:16:55.616853 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:55.664448 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3292a22-48a1-49b2-be3a-ef0832f3b717 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:55.668010 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:55.682766 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 282/565] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:16:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 05:16:55.683592 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200ac4a0-1896-43a1-a1a2-7e06159358c6 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:55.713222 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98297fd3-0eac-4398-b1a7-a9821dfd5b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:55.713831 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98297fd3-0eac-4398-b1a7-a9821dfd5b69 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:55.714107 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98297fd3-0eac-4398-b1a7-a9821dfd5b69 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:55.714378 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98297fd3-0eac-4398-b1a7-a9821dfd5b69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:55.715109 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98297fd3-0eac-4398-b1a7-a9821dfd5b69 None admin] RBAC: Adding query filter params (role.id=82bd224e8afc480782a85b833a2aa03e, scope.project.id=61ffb079d9e1437084945554bcc0747b, user.id=2bbe4555380345e485572d2da8b78be1) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:55.715420 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98297fd3-0eac-4398-b1a7-a9821dfd5b69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:55.716920 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98297fd3-0eac-4398-b1a7-a9821dfd5b69 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:55.722329 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 284/566] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 05:16:55 2022] GET /identity/v3/role_assignments?user.id=2bbe4555380345e485572d2da8b78be1&scope.project.id=61ffb079d9e1437084945554bcc0747b&role.id=82bd224e8afc480782a85b833a2aa03e => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:55.723109 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98297fd3-0eac-4398-b1a7-a9821dfd5b69 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:55.805856 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200ac4a0-1896-43a1-a1a2-7e06159358c6 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:55.845516 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e7efb1-8363-463a-b429-57c4ebd5fa6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:55.846146 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e7efb1-8363-463a-b429-57c4ebd5fa6a None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:55.846424 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e7efb1-8363-463a-b429-57c4ebd5fa6a None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:55.846698 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e7efb1-8363-463a-b429-57c4ebd5fa6a None admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:55.847389 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e7efb1-8363-463a-b429-57c4ebd5fa6a None admin] RBAC: Adding query filter params (name=service) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:55.847706 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e7efb1-8363-463a-b429-57c4ebd5fa6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:55.849149 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e7efb1-8363-463a-b429-57c4ebd5fa6a None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:55.862307 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98297fd3-0eac-4398-b1a7-a9821dfd5b69 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:55.864142 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 283/567] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 11 05:16:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:55.865675 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e7efb1-8363-463a-b429-57c4ebd5fa6a None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:55.891345 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:55.913164 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9c7438-c375-495f-96d1-d0116ae17244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:55.914025 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c7438-c375-495f-96d1-d0116ae17244 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:55.914393 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c7438-c375-495f-96d1-d0116ae17244 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:55.914762 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c7438-c375-495f-96d1-d0116ae17244 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:55.925195 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:55.926760 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9c7438-c375-495f-96d1-d0116ae17244 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:55.928931 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9c7438-c375-495f-96d1-d0116ae17244 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:55.944746 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-2b9c7438-c375-495f-96d1-d0116ae17244 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:16:55.944746 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:16:55.944746 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:16:55.944746 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:16:55.944746 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:16:55.944746 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:16:55.944746 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:16:55.944746 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:16:55.944746 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:16:55.944746 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:16:55.944746 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:16:55.944746 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:16:55.944746 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 05:16:55.944746 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 05:16:55.944746 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 05:16:55.944746 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 05:16:55.945962 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:16:55.945962 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:16:55.945962 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:16:55.945962 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:16:55.945962 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:16:55.945962 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:16:55.945962 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:16:55.945962 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:16:55.945962 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:16:55.945962 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:16:55.945962 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:16:55.945962 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:16:55.945962 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:16:55.945962 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:16:55.945962 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:16:55.945962 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:16:55.945962 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 05:16:55.947074 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 05:16:55.947074 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:16:55.947074 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:16:55.948290 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 285/568] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:16:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:16:55.949503 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9c7438-c375-495f-96d1-d0116ae17244 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:55.995636 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e7efb1-8363-463a-b429-57c4ebd5fa6a None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:56.036317 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c399fc-04b1-4e86-845e-f3ef50fffb16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:56.037478 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c399fc-04b1-4e86-845e-f3ef50fffb16 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:56.037760 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c399fc-04b1-4e86-845e-f3ef50fffb16 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:56.038033 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c399fc-04b1-4e86-845e-f3ef50fffb16 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:56.049136 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c399fc-04b1-4e86-845e-f3ef50fffb16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:16:56.053774 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9c7438-c375-495f-96d1-d0116ae17244 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:56.055987 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-60c399fc-04b1-4e86-845e-f3ef50fffb16 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 05:16:56.055987 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:16:56.055987 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:16:56.055987 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:16:56.055987 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:16:56.055987 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:16:56.055987 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:16:56.055987 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:16:56.055987 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:16:56.055987 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:16:56.055987 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:16:56.055987 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:16:56.055987 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:16:56.055987 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:16:56.055987 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:16:56.055987 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:16:56.057071 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:16:56.057071 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:16:56.057071 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:16:56.057071 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:16:56.057071 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:16:56.057071 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:16:56.057071 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:16:56.057071 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:16:56.057071 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:16:56.057071 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:16:56.057071 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:16:56.057071 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:16:56.057071 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:16:56.057071 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:16:56.057071 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:16:56.057071 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:16:56.058011 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:16:56.058011 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:16:56.058011 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:16:56.058011 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:16:56.058011 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:16:56.058011 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:16:56.058011 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:16:56.058011 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:16:56.058011 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:16:56.058011 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:16:56.058011 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 05:16:56.058011 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:16:56.058011 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 284/569] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 11 05:16:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:16:56.062528 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c399fc-04b1-4e86-845e-f3ef50fffb16 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:56.091616 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d2ace-b2e1-4013-a99c-e8cbe82f3b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:56.092259 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d2ace-b2e1-4013-a99c-e8cbe82f3b38 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:56.092532 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d2ace-b2e1-4013-a99c-e8cbe82f3b38 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:56.092800 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d2ace-b2e1-4013-a99c-e8cbe82f3b38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:56.104514 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074d2ace-b2e1-4013-a99c-e8cbe82f3b38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:56.105975 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074d2ace-b2e1-4013-a99c-e8cbe82f3b38 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:56.122881 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-074d2ace-b2e1-4013-a99c-e8cbe82f3b38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:16:56.122881 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:16:56.122881 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:16:56.122881 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:16:56.122881 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:16:56.122881 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:16:56.122881 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:16:56.122881 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:16:56.122881 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:16:56.122881 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:16:56.122881 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:16:56.122881 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:16:56.122881 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 05:16:56.122881 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 05:16:56.122881 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 05:16:56.122881 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 05:16:56.124080 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:16:56.124080 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:16:56.124080 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:16:56.124080 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:16:56.124080 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:16:56.124080 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:16:56.124080 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:16:56.124080 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:16:56.124080 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:16:56.124080 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:16:56.124080 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:16:56.124080 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:16:56.124080 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:16:56.124080 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:16:56.124080 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:16:56.124080 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:16:56.124080 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 05:16:56.125211 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 05:16:56.125211 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:16:56.125211 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:16:56.130698 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 286/570] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:16:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:16:56.130698 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d2ace-b2e1-4013-a99c-e8cbe82f3b38 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:56.153000 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:56.178482 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c399fc-04b1-4e86-845e-f3ef50fffb16 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:56.189574 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:56.219731 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a3ffb4-74cc-4578-9703-78aa9e65f55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:56.220354 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3ffb4-74cc-4578-9703-78aa9e65f55f None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:56.220640 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3ffb4-74cc-4578-9703-78aa9e65f55f None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:56.220914 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3ffb4-74cc-4578-9703-78aa9e65f55f None admin] PATH_INFO: `/v3/domains` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:56.221562 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a3ffb4-74cc-4578-9703-78aa9e65f55f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:56.221876 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a3ffb4-74cc-4578-9703-78aa9e65f55f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:56.223250 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a3ffb4-74cc-4578-9703-78aa9e65f55f None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:56.232181 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d2ace-b2e1-4013-a99c-e8cbe82f3b38 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:56.236125 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 285/571] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 05:16:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:56.236740 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a3ffb4-74cc-4578-9703-78aa9e65f55f None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:56.271450 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5507c339-5f19-4e08-ba30-bdd9d8af37a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:56.272448 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5507c339-5f19-4e08-ba30-bdd9d8af37a4 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:56.272722 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5507c339-5f19-4e08-ba30-bdd9d8af37a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:56.272991 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5507c339-5f19-4e08-ba30-bdd9d8af37a4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:56.284279 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5507c339-5f19-4e08-ba30-bdd9d8af37a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:16:56.290140 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-5507c339-5f19-4e08-ba30-bdd9d8af37a4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 05:16:56.290140 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:16:56.290140 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:16:56.290140 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:16:56.290140 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:16:56.290140 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:16:56.290140 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:16:56.290140 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:16:56.290140 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:16:56.290140 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:16:56.290140 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:16:56.290140 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:16:56.290140 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:16:56.290140 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:16:56.290140 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:16:56.290140 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:16:56.291088 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:16:56.291088 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:16:56.291088 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:16:56.291088 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:16:56.291088 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:16:56.291088 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:16:56.291088 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:16:56.291088 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:16:56.291088 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:16:56.291088 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:16:56.291088 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:16:56.291088 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:16:56.291088 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:16:56.291088 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:16:56.291088 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:16:56.291088 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:16:56.292017 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:16:56.292017 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:16:56.292017 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:16:56.292017 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:16:56.292017 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:16:56.292017 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:16:56.292017 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:16:56.292017 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:16:56.292017 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:16:56.292017 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:16:56.292017 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 05:16:56.292017 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:16:56.292017 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 287/572] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 11 05:16:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:16:56.292017 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5507c339-5f19-4e08-ba30-bdd9d8af37a4 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:56.348912 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a3ffb4-74cc-4578-9703-78aa9e65f55f None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:56.383272 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:56.389010 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a8da9c-6375-4608-8447-00ac73713184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:56.389791 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a8da9c-6375-4608-8447-00ac73713184 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:56.390066 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a8da9c-6375-4608-8447-00ac73713184 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:56.390333 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a8da9c-6375-4608-8447-00ac73713184 None admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:56.391108 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a8da9c-6375-4608-8447-00ac73713184 None admin] RBAC: Adding query filter params (name=service) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:56.391708 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a8da9c-6375-4608-8447-00ac73713184 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:56.392906 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a8da9c-6375-4608-8447-00ac73713184 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:56.399905 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5507c339-5f19-4e08-ba30-bdd9d8af37a4 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:56.402250 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 286/573] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 11 05:16:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:56.403263 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a8da9c-6375-4608-8447-00ac73713184 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:56.436927 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:56.442858 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3db7c1d-3054-48e1-899c-84de5cb51c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:56.443522 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3db7c1d-3054-48e1-899c-84de5cb51c37 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:56.443866 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3db7c1d-3054-48e1-899c-84de5cb51c37 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:56.444129 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3db7c1d-3054-48e1-899c-84de5cb51c37 None admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:56.444779 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3db7c1d-3054-48e1-899c-84de5cb51c37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:56.445085 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3db7c1d-3054-48e1-899c-84de5cb51c37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:56.446912 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3db7c1d-3054-48e1-899c-84de5cb51c37 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:56.464547 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 288/574] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 05:16:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:56.464547 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3db7c1d-3054-48e1-899c-84de5cb51c37 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:56.516122 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a8da9c-6375-4608-8447-00ac73713184 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:56.551632 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a3c706-c812-443f-81d5-846c5ddb9838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:56.552291 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3c706-c812-443f-81d5-846c5ddb9838 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:56.553101 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3c706-c812-443f-81d5-846c5ddb9838 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:56.553379 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3c706-c812-443f-81d5-846c5ddb9838 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:56.561963 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a3c706-c812-443f-81d5-846c5ddb9838 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:56.562875 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3db7c1d-3054-48e1-899c-84de5cb51c37 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:56.563400 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a3c706-c812-443f-81d5-846c5ddb9838 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:56.577806 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-03a3c706-c812-443f-81d5-846c5ddb9838 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 11 05:16:56.577806 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:16:56.577806 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:16:56.577806 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:16:56.577806 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:16:56.577806 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:16:56.577806 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:16:56.577806 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:16:56.577806 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:16:56.577806 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:16:56.577806 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:16:56.577806 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:16:56.577806 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 05:16:56.577806 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 05:16:56.577806 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 05:16:56.577806 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 05:16:56.578767 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:16:56.578767 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:16:56.578767 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 05:16:56.578767 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 05:16:56.578767 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 05:16:56.578767 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 05:16:56.578767 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:16:56.578767 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:16:56.578767 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:16:56.578767 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:16:56.578767 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:16:56.578767 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:16:56.578767 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:16:56.578767 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:16:56.578767 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:16:56.578767 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:16:56.578767 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:16:56.578767 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:16:56.585394 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:16:56.585394 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:16:56.585394 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 05:16:56.585394 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 05:16:56.585394 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 05:16:56.585394 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 05:16:56.585394 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 05:16:56.585394 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 05:16:56.585394 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 11 05:16:56.585394 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:16:56.585394 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 287/575] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 05:16:56 2022] GET /identity/v3/users/glance => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:16:56.585394 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a3c706-c812-443f-81d5-846c5ddb9838 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:56.596781 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d3c42b-8ce1-4765-9cd6-ef5fd4655429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:56.597504 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d3c42b-8ce1-4765-9cd6-ef5fd4655429 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:56.597778 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d3c42b-8ce1-4765-9cd6-ef5fd4655429 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:56.598045 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d3c42b-8ce1-4765-9cd6-ef5fd4655429 None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:56.598717 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d3c42b-8ce1-4765-9cd6-ef5fd4655429 None admin] RBAC: Adding query filter params (name=service) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:56.599020 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d3c42b-8ce1-4765-9cd6-ef5fd4655429 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:56.600654 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d3c42b-8ce1-4765-9cd6-ef5fd4655429 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:56.610200 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 289/576] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 11 05:16:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:56.610917 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d3c42b-8ce1-4765-9cd6-ef5fd4655429 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:56.621675 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:56.700078 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:56.711882 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a3c706-c812-443f-81d5-846c5ddb9838 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:56.713475 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d3c42b-8ce1-4765-9cd6-ef5fd4655429 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:56.752888 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db96e6-b17e-4ab5-9455-695bc2aa8bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:56.753524 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db96e6-b17e-4ab5-9455-695bc2aa8bc9 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:56.753804 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db96e6-b17e-4ab5-9455-695bc2aa8bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:56.754073 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db96e6-b17e-4ab5-9455-695bc2aa8bc9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:56.762053 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32fdb11-92a3-44d0-be94-7e6a79c8c610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:56.762690 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32fdb11-92a3-44d0-be94-7e6a79c8c610 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:56.762970 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32fdb11-92a3-44d0-be94-7e6a79c8c610 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:56.763078 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4db96e6-b17e-4ab5-9455-695bc2aa8bc9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:56.763245 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32fdb11-92a3-44d0-be94-7e6a79c8c610 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:56.764449 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4db96e6-b17e-4ab5-9455-695bc2aa8bc9 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:56.774057 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32fdb11-92a3-44d0-be94-7e6a79c8c610 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:56.775499 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32fdb11-92a3-44d0-be94-7e6a79c8c610 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:56.776963 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-d4db96e6-b17e-4ab5-9455-695bc2aa8bc9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 11 05:16:56.776963 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:16:56.776963 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:16:56.776963 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:16:56.776963 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:16:56.776963 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:16:56.776963 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:16:56.776963 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:16:56.776963 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:16:56.776963 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:16:56.776963 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:16:56.776963 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:16:56.776963 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 05:16:56.776963 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 05:16:56.776963 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 05:16:56.776963 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 05:16:56.777854 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:16:56.777854 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:16:56.777854 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 05:16:56.777854 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 05:16:56.777854 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 05:16:56.777854 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 05:16:56.777854 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:16:56.777854 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:16:56.777854 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:16:56.777854 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:16:56.777854 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:16:56.777854 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:16:56.777854 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:16:56.777854 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:16:56.777854 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:16:56.777854 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:16:56.777854 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:16:56.777854 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:16:56.778805 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:16:56.778805 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:16:56.778805 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 05:16:56.778805 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 05:16:56.778805 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 05:16:56.778805 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 05:16:56.778805 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 05:16:56.778805 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 05:16:56.778805 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 11 05:16:56.778805 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:16:56.778805 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 290/577] 10.222.0.16 () {56 vars in 1093 bytes} [Sun Sep 11 05:16:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:16:56.779395 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db96e6-b17e-4ab5-9455-695bc2aa8bc9 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:56.795514 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-b32fdb11-92a3-44d0-be94-7e6a79c8c610 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:16:56.795514 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:16:56.795514 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:16:56.795514 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:16:56.795514 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:16:56.795514 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:16:56.795514 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:16:56.795514 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:16:56.795514 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:16:56.795514 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:16:56.795514 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:16:56.795514 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:16:56.795514 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 05:16:56.795514 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 05:16:56.795514 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 05:16:56.795514 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 05:16:56.796495 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:16:56.796495 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:16:56.796495 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:16:56.796495 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:16:56.796495 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:16:56.796495 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:16:56.796495 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:16:56.796495 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:16:56.796495 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:16:56.796495 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:16:56.796495 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:16:56.796495 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:16:56.796495 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:16:56.796495 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:16:56.796495 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:16:56.796495 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:16:56.796495 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 05:16:56.797385 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 05:16:56.797385 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:16:56.797385 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:16:56.798069 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 288/578] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:16:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:16:56.799279 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32fdb11-92a3-44d0-be94-7e6a79c8c610 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:56.857406 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:56.899448 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db96e6-b17e-4ab5-9455-695bc2aa8bc9 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:56.907230 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32fdb11-92a3-44d0-be94-7e6a79c8c610 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:56.934760 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c4cf2-a2ac-4653-b717-8750b8d05296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:56.935371 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c4cf2-a2ac-4653-b717-8750b8d05296 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:56.935727 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c4cf2-a2ac-4653-b717-8750b8d05296 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:56.936011 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c4cf2-a2ac-4653-b717-8750b8d05296 None admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:56.936767 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9c4cf2-a2ac-4653-b717-8750b8d05296 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:56.937073 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9c4cf2-a2ac-4653-b717-8750b8d05296 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:56.938507 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9c4cf2-a2ac-4653-b717-8750b8d05296 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:56.942906 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c53f50c-f0c1-4dff-a85b-3c54200cf456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:56.944096 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c53f50c-f0c1-4dff-a85b-3c54200cf456 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:56.944375 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c53f50c-f0c1-4dff-a85b-3c54200cf456 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:56.944644 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c53f50c-f0c1-4dff-a85b-3c54200cf456 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:56.955596 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c53f50c-f0c1-4dff-a85b-3c54200cf456 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:56.961578 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 291/579] 10.222.0.16 () {56 vars in 1137 bytes} [Sun Sep 11 05:16:56 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:56.961721 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c53f50c-f0c1-4dff-a85b-3c54200cf456 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:56.961802 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c4cf2-a2ac-4653-b717-8750b8d05296 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:56.964757 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:56.978015 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-9c53f50c-f0c1-4dff-a85b-3c54200cf456 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:16:56.978015 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:16:56.978015 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:16:56.978015 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:16:56.978015 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:16:56.978015 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:16:56.978015 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:16:56.978015 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:16:56.978015 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:16:56.978015 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:16:56.978015 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:16:56.978015 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:16:56.978015 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 05:16:56.978015 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 05:16:56.978015 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 05:16:56.978015 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 05:16:56.978946 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:16:56.978946 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:16:56.978946 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:16:56.978946 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:16:56.978946 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:16:56.978946 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:16:56.978946 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:16:56.978946 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:16:56.978946 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:16:56.978946 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:16:56.978946 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:16:56.978946 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:16:56.978946 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:16:56.978946 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:16:56.978946 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:16:56.978946 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:16:56.978946 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 05:16:56.979872 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 05:16:56.979872 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:16:56.979872 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:16:56.979872 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 289/580] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:16:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:16:56.980093 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c53f50c-f0c1-4dff-a85b-3c54200cf456 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:57.078184 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c4cf2-a2ac-4653-b717-8750b8d05296 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:57.098077 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c53f50c-f0c1-4dff-a85b-3c54200cf456 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:57.103408 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:57.114592 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca534bd-8030-4380-b945-7a59bb6b50ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:57.115775 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca534bd-8030-4380-b945-7a59bb6b50ed None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:57.116053 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca534bd-8030-4380-b945-7a59bb6b50ed None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:57.116574 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca534bd-8030-4380-b945-7a59bb6b50ed None admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:57.117325 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca534bd-8030-4380-b945-7a59bb6b50ed None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:57.117609 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca534bd-8030-4380-b945-7a59bb6b50ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:57.119053 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca534bd-8030-4380-b945-7a59bb6b50ed None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:57.137877 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 292/581] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Sep 11 05:16:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:57.138873 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca534bd-8030-4380-b945-7a59bb6b50ed None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:57.147579 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9a4502-b571-49bb-a0c6-b9f9b417fbf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:57.148242 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a4502-b571-49bb-a0c6-b9f9b417fbf1 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:57.148522 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a4502-b571-49bb-a0c6-b9f9b417fbf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:57.148795 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a4502-b571-49bb-a0c6-b9f9b417fbf1 None admin] PATH_INFO: `/v3/domains` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:57.149432 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9a4502-b571-49bb-a0c6-b9f9b417fbf1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:57.149736 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9a4502-b571-49bb-a0c6-b9f9b417fbf1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:57.151160 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9a4502-b571-49bb-a0c6-b9f9b417fbf1 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:57.169295 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 290/582] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 05:16:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:57.169295 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9a4502-b571-49bb-a0c6-b9f9b417fbf1 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:57.227959 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:57.243451 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca534bd-8030-4380-b945-7a59bb6b50ed None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:57.276383 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9a4502-b571-49bb-a0c6-b9f9b417fbf1 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:57.279545 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0b3db8-b0bc-4694-82e3-01af2dcfc380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:57.280212 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b3db8-b0bc-4694-82e3-01af2dcfc380 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:57.280490 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b3db8-b0bc-4694-82e3-01af2dcfc380 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:57.280759 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b3db8-b0bc-4694-82e3-01af2dcfc380 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:57.291523 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0b3db8-b0bc-4694-82e3-01af2dcfc380 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:57.293006 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0b3db8-b0bc-4694-82e3-01af2dcfc380 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:57.308018 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-6c0b3db8-b0bc-4694-82e3-01af2dcfc380 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:16:57.308018 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:16:57.308018 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:16:57.308018 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:16:57.308018 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:16:57.308018 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:16:57.308018 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:16:57.308018 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:16:57.308018 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:16:57.308018 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:16:57.308018 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:16:57.308018 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:16:57.308018 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 05:16:57.308018 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 05:16:57.308018 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 05:16:57.308018 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 05:16:57.308972 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:16:57.308972 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:16:57.308972 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:16:57.308972 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:16:57.308972 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:16:57.308972 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:16:57.308972 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:16:57.308972 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:16:57.308972 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:16:57.308972 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:16:57.308972 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:16:57.308972 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:16:57.308972 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:16:57.308972 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:16:57.308972 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:16:57.308972 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:16:57.308972 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 05:16:57.309856 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 05:16:57.309856 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:16:57.309856 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:16:57.309856 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 293/583] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:16:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:16:57.309856 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0b3db8-b0bc-4694-82e3-01af2dcfc380 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:57.318524 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78a7498-e761-4884-a0e5-fa82d5bfe820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:57.319141 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78a7498-e761-4884-a0e5-fa82d5bfe820 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:57.319420 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78a7498-e761-4884-a0e5-fa82d5bfe820 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:57.319703 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78a7498-e761-4884-a0e5-fa82d5bfe820 None admin] PATH_INFO: `/v3/domains` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:57.320370 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78a7498-e761-4884-a0e5-fa82d5bfe820 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:57.320672 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78a7498-e761-4884-a0e5-fa82d5bfe820 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:57.322036 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78a7498-e761-4884-a0e5-fa82d5bfe820 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:57.333309 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 291/584] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 05:16:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:57.334654 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78a7498-e761-4884-a0e5-fa82d5bfe820 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:57.351854 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:57.428851 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0b3db8-b0bc-4694-82e3-01af2dcfc380 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:57.455012 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78a7498-e761-4884-a0e5-fa82d5bfe820 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:57.467394 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85104fdd-2682-4c57-b2cb-61fad2fec4d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:57.468060 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85104fdd-2682-4c57-b2cb-61fad2fec4d5 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:57.468341 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85104fdd-2682-4c57-b2cb-61fad2fec4d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:57.468612 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85104fdd-2682-4c57-b2cb-61fad2fec4d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:57.473420 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:57.481594 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85104fdd-2682-4c57-b2cb-61fad2fec4d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:57.483090 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85104fdd-2682-4c57-b2cb-61fad2fec4d5 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:57.494625 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f15ab15-c163-487b-9896-a5012ea8b9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:57.495261 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f15ab15-c163-487b-9896-a5012ea8b9c0 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:57.495545 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f15ab15-c163-487b-9896-a5012ea8b9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:57.495857 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f15ab15-c163-487b-9896-a5012ea8b9c0 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:57.499450 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-85104fdd-2682-4c57-b2cb-61fad2fec4d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:16:57.499450 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:16:57.499450 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:16:57.499450 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:16:57.499450 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:16:57.499450 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:16:57.499450 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:16:57.499450 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:16:57.499450 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:16:57.499450 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:16:57.499450 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:16:57.499450 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:16:57.499450 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 05:16:57.499450 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 05:16:57.499450 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 05:16:57.499450 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 05:16:57.500429 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:16:57.500429 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:16:57.500429 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:16:57.500429 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:16:57.500429 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:16:57.500429 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:16:57.500429 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:16:57.500429 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:16:57.500429 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:16:57.500429 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:16:57.500429 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:16:57.500429 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:16:57.500429 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:16:57.500429 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:16:57.500429 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:16:57.500429 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:16:57.500429 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 05:16:57.501351 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 05:16:57.501351 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:16:57.501351 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:16:57.501351 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 294/585] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:16:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:16:57.502041 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85104fdd-2682-4c57-b2cb-61fad2fec4d5 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:57.508332 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f15ab15-c163-487b-9896-a5012ea8b9c0 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:57.509785 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f15ab15-c163-487b-9896-a5012ea8b9c0 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:57.522031 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-3f15ab15-c163-487b-9896-a5012ea8b9c0 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 11 05:16:57.522031 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:16:57.522031 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:16:57.522031 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:16:57.522031 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:16:57.522031 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:16:57.522031 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:16:57.522031 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:16:57.522031 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:16:57.522031 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:16:57.522031 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:16:57.522031 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:16:57.522031 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 05:16:57.522031 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 05:16:57.522031 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 05:16:57.522031 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 05:16:57.522991 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:16:57.522991 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:16:57.522991 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 05:16:57.522991 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 05:16:57.522991 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 05:16:57.522991 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 05:16:57.522991 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:16:57.522991 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:16:57.522991 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:16:57.522991 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:16:57.522991 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:16:57.522991 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:16:57.522991 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:16:57.522991 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:16:57.522991 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:16:57.522991 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:16:57.522991 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:16:57.522991 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:16:57.523998 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:16:57.523998 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:16:57.523998 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 05:16:57.523998 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 05:16:57.523998 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 05:16:57.523998 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 05:16:57.523998 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 05:16:57.523998 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 05:16:57.523998 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 11 05:16:57.523998 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:16:57.527855 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 292/586] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 11 05:16:57 2022] GET /identity/v3/users/neutron => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:16:57.528743 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f15ab15-c163-487b-9896-a5012ea8b9c0 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:57.591405 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:57.608483 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85104fdd-2682-4c57-b2cb-61fad2fec4d5 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:57.639586 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f15ab15-c163-487b-9896-a5012ea8b9c0 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:57.645818 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821c6a4b-7178-4dfe-a693-02e098c8a4ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:57.646989 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c6a4b-7178-4dfe-a693-02e098c8a4ee None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:57.647281 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c6a4b-7178-4dfe-a693-02e098c8a4ee None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:57.647557 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c6a4b-7178-4dfe-a693-02e098c8a4ee None admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:57.648241 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821c6a4b-7178-4dfe-a693-02e098c8a4ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:57.649002 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821c6a4b-7178-4dfe-a693-02e098c8a4ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:57.650822 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821c6a4b-7178-4dfe-a693-02e098c8a4ee None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:57.668398 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 295/587] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 05:16:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:57.668398 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821c6a4b-7178-4dfe-a693-02e098c8a4ee None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:57.681266 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d73de1a-9ef5-4d97-a8d7-0c987bdbaff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:57.682090 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d73de1a-9ef5-4d97-a8d7-0c987bdbaff9 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:57.682436 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d73de1a-9ef5-4d97-a8d7-0c987bdbaff9 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:57.682774 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d73de1a-9ef5-4d97-a8d7-0c987bdbaff9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:57.690865 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d73de1a-9ef5-4d97-a8d7-0c987bdbaff9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:57.692435 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d73de1a-9ef5-4d97-a8d7-0c987bdbaff9 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:57.705075 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-2d73de1a-9ef5-4d97-a8d7-0c987bdbaff9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 11 05:16:57.705075 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:16:57.705075 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:16:57.705075 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:16:57.705075 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:16:57.705075 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:16:57.705075 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:16:57.705075 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:16:57.705075 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:16:57.705075 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:16:57.705075 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:16:57.705075 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:16:57.705075 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 05:16:57.705075 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 05:16:57.705075 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 05:16:57.705075 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 05:16:57.706221 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:16:57.706221 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:16:57.706221 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 05:16:57.706221 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 05:16:57.706221 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 05:16:57.706221 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 05:16:57.706221 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:16:57.706221 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:16:57.706221 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:16:57.706221 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:16:57.706221 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:16:57.706221 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:16:57.706221 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:16:57.706221 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:16:57.706221 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:16:57.706221 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:16:57.706221 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:16:57.706221 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:16:57.707520 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:16:57.707520 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:16:57.707520 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 05:16:57.707520 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 05:16:57.707520 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 05:16:57.707520 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 05:16:57.707520 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 05:16:57.707520 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 05:16:57.707520 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 11 05:16:57.707520 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:16:57.710960 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 293/588] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 05:16:57 2022] GET /identity/v3/users/cinder => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:16:57.711810 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d73de1a-9ef5-4d97-a8d7-0c987bdbaff9 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:57.751934 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:57.777842 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821c6a4b-7178-4dfe-a693-02e098c8a4ee None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:57.815385 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f4995d-1889-4546-88ae-51037402a50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:57.816023 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f4995d-1889-4546-88ae-51037402a50e None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:57.816303 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f4995d-1889-4546-88ae-51037402a50e None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:57.816570 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f4995d-1889-4546-88ae-51037402a50e None admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:57.817218 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f4995d-1889-4546-88ae-51037402a50e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:57.817525 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f4995d-1889-4546-88ae-51037402a50e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:57.819437 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f4995d-1889-4546-88ae-51037402a50e None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:57.835051 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 296/589] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 05:16:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:57.835051 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f4995d-1889-4546-88ae-51037402a50e None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:57.839446 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d73de1a-9ef5-4d97-a8d7-0c987bdbaff9 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:57.844767 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:57.881092 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e385074a-ac24-49ca-9f79-6c659b339b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:57.881790 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e385074a-ac24-49ca-9f79-6c659b339b39 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:57.882426 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e385074a-ac24-49ca-9f79-6c659b339b39 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:57.882704 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e385074a-ac24-49ca-9f79-6c659b339b39 None admin] PATH_INFO: `/v3/users` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:57.883439 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e385074a-ac24-49ca-9f79-6c659b339b39 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:57.883774 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e385074a-ac24-49ca-9f79-6c659b339b39 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:57.885490 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e385074a-ac24-49ca-9f79-6c659b339b39 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:57.902650 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 294/590] 10.222.0.16 () {56 vars in 1139 bytes} [Sun Sep 11 05:16:57 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:57.903446 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e385074a-ac24-49ca-9f79-6c659b339b39 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:57.938727 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f4995d-1889-4546-88ae-51037402a50e None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:57.972115 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3502b73-a0e4-434b-8845-8789d99615f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:57.972740 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3502b73-a0e4-434b-8845-8789d99615f5 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:57.973020 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3502b73-a0e4-434b-8845-8789d99615f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:57.973294 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3502b73-a0e4-434b-8845-8789d99615f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:57.979894 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3502b73-a0e4-434b-8845-8789d99615f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:57.981358 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3502b73-a0e4-434b-8845-8789d99615f5 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:57.993173 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-d3502b73-a0e4-434b-8845-8789d99615f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 05:16:57.993173 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:16:57.993173 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:16:57.993173 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:16:57.993173 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:16:57.993173 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:16:57.993173 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:16:57.993173 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:16:57.993173 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:16:57.993173 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:16:57.993173 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:16:57.993173 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:16:57.993173 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 05:16:57.993173 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 05:16:57.993173 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 05:16:57.994190 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 05:16:57.994190 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:16:57.994190 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:16:57.994190 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:16:57.994190 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:16:57.994190 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:16:57.994190 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:16:57.994190 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:16:57.994190 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:16:57.994190 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:16:57.994190 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:16:57.994190 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:16:57.994190 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:16:57.994190 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:16:57.994190 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:16:57.994190 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:16:57.994190 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:16:57.995134 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 05:16:57.995134 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 05:16:57.995134 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 05:16:57.995134 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 05:16:57.995134 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 05:16:57.995134 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 05:16:57.995134 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 05:16:57.995134 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:16:57.995832 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:57.995909 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 297/591] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 05:16:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:16:57.995909 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3502b73-a0e4-434b-8845-8789d99615f5 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:58.000692 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e385074a-ac24-49ca-9f79-6c659b339b39 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:58.035491 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426ab17b-04b6-4443-bda1-e527d81080b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:58.036056 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426ab17b-04b6-4443-bda1-e527d81080b6 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:58.036335 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426ab17b-04b6-4443-bda1-e527d81080b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:58.036608 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426ab17b-04b6-4443-bda1-e527d81080b6 None admin] PATH_INFO: `/v3/users` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:58.037382 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426ab17b-04b6-4443-bda1-e527d81080b6 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:58.037685 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426ab17b-04b6-4443-bda1-e527d81080b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:58.039096 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426ab17b-04b6-4443-bda1-e527d81080b6 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:58.056200 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 295/592] 10.222.0.16 () {56 vars in 1137 bytes} [Sun Sep 11 05:16:57 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:58.057345 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a902cb-9a85-4bf6-b5ce-0338b2395183 None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:58.057619 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a902cb-9a85-4bf6-b5ce-0338b2395183 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:58.057889 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a902cb-9a85-4bf6-b5ce-0338b2395183 None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:58.059221 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 296/593] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:16:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:16:58.060514 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:58.061728 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a902cb-9a85-4bf6-b5ce-0338b2395183 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:58.096396 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3502b73-a0e4-434b-8845-8789d99615f5 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:58.129365 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9634a726-6b68-48a8-b80f-4925a03a587f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:58.129983 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9634a726-6b68-48a8-b80f-4925a03a587f None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:58.130263 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9634a726-6b68-48a8-b80f-4925a03a587f None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:58.130587 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9634a726-6b68-48a8-b80f-4925a03a587f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:58.137068 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9634a726-6b68-48a8-b80f-4925a03a587f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:58.138506 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9634a726-6b68-48a8-b80f-4925a03a587f None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:58.150617 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-9634a726-6b68-48a8-b80f-4925a03a587f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 05:16:58.150617 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:16:58.150617 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:16:58.150617 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:16:58.150617 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:16:58.150617 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:16:58.150617 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:16:58.150617 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:16:58.150617 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:16:58.150617 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:16:58.150617 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:16:58.150617 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:16:58.150617 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 05:16:58.150617 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 05:16:58.150617 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 05:16:58.152165 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 05:16:58.152165 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:16:58.152165 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:16:58.152165 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:16:58.152165 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:16:58.152165 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:16:58.152165 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:16:58.152165 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:16:58.152165 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:16:58.152165 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:16:58.152165 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:16:58.152165 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:16:58.152165 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:16:58.152165 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:16:58.152165 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:16:58.152165 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:16:58.152165 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:16:58.153098 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 05:16:58.153098 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 05:16:58.153098 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 05:16:58.153098 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 05:16:58.153098 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 05:16:58.153098 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 05:16:58.153098 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 05:16:58.153098 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:16:58.153098 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 298/594] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 05:16:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:16:58.153098 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9634a726-6b68-48a8-b80f-4925a03a587f None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:58.167118 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a902cb-9a85-4bf6-b5ce-0338b2395183 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:58.200626 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19846839-5f07-4bed-b2b0-a8eca005f6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:58.201251 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19846839-5f07-4bed-b2b0-a8eca005f6f0 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:58.201532 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19846839-5f07-4bed-b2b0-a8eca005f6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:58.201804 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19846839-5f07-4bed-b2b0-a8eca005f6f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:58.212154 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19846839-5f07-4bed-b2b0-a8eca005f6f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:58.213597 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19846839-5f07-4bed-b2b0-a8eca005f6f0 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:58.228412 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-19846839-5f07-4bed-b2b0-a8eca005f6f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:16:58.228412 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:16:58.228412 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:16:58.228412 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:16:58.228412 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:16:58.228412 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:16:58.228412 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:16:58.228412 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:16:58.228412 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:16:58.228412 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:16:58.228412 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:16:58.228412 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:16:58.228412 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 05:16:58.228412 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 05:16:58.228412 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 05:16:58.228412 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 05:16:58.229543 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:16:58.229543 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:16:58.229543 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:16:58.229543 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:16:58.229543 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:16:58.229543 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:16:58.229543 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:16:58.229543 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:16:58.229543 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:16:58.229543 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:16:58.229543 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:16:58.229543 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:16:58.229543 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:16:58.229543 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:16:58.229543 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:16:58.229543 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:16:58.229543 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 05:16:58.230422 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 05:16:58.230422 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:16:58.230422 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:16:58.230422 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 297/595] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:16:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:16:58.230718 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19846839-5f07-4bed-b2b0-a8eca005f6f0 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:58.235015 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:58.253054 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9634a726-6b68-48a8-b80f-4925a03a587f None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:58.283524 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:58.293764 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a285bfd-1b12-47ca-94ed-0b747036e187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:58.294308 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a285bfd-1b12-47ca-94ed-0b747036e187 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:58.294587 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a285bfd-1b12-47ca-94ed-0b747036e187 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:58.294858 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a285bfd-1b12-47ca-94ed-0b747036e187 None admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:58.295548 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a285bfd-1b12-47ca-94ed-0b747036e187 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:58.295884 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a285bfd-1b12-47ca-94ed-0b747036e187 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:58.297322 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a285bfd-1b12-47ca-94ed-0b747036e187 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:58.309327 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 299/596] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 05:16:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:58.310616 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b27bd9e-55ba-4269-94da-71e0bb1780eb None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:58.310906 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b27bd9e-55ba-4269-94da-71e0bb1780eb None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:58.311180 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b27bd9e-55ba-4269-94da-71e0bb1780eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:58.328955 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-3b27bd9e-55ba-4269-94da-71e0bb1780eb None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:16:58.330159 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-3b27bd9e-55ba-4269-94da-71e0bb1780eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:16:58.338954 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19846839-5f07-4bed-b2b0-a8eca005f6f0 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:58.373051 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8252bb12-fdbd-4ef6-8f4b-451346c5c8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:58.373680 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252bb12-fdbd-4ef6-8f4b-451346c5c8fa None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:58.373955 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252bb12-fdbd-4ef6-8f4b-451346c5c8fa None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:58.374222 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252bb12-fdbd-4ef6-8f4b-451346c5c8fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:58.384904 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8252bb12-fdbd-4ef6-8f4b-451346c5c8fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:58.386353 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8252bb12-fdbd-4ef6-8f4b-451346c5c8fa None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:58.395815 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 300/597] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:16:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 05:16:58.396749 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b27bd9e-55ba-4269-94da-71e0bb1780eb None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:58.400010 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-8252bb12-fdbd-4ef6-8f4b-451346c5c8fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:16:58.400010 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:16:58.400010 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:16:58.400010 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:16:58.400010 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:16:58.400010 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:16:58.400010 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:16:58.400010 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:16:58.400010 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:16:58.400010 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:16:58.400010 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:16:58.400010 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:16:58.400010 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 05:16:58.400010 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 05:16:58.400010 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 05:16:58.400010 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 05:16:58.405479 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:16:58.405479 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:16:58.405479 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:16:58.405479 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:16:58.405479 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:16:58.405479 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:16:58.405479 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:16:58.405479 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:16:58.405479 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:16:58.405479 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:16:58.405479 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:16:58.405479 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:16:58.405479 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:16:58.405479 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:16:58.405479 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:16:58.405479 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:16:58.405479 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 05:16:58.406721 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 05:16:58.406721 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:16:58.406721 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:16:58.406721 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 298/598] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:16:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:16:58.406721 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8252bb12-fdbd-4ef6-8f4b-451346c5c8fa None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:58.469750 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:58.518397 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b27bd9e-55ba-4269-94da-71e0bb1780eb None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:58.519383 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8252bb12-fdbd-4ef6-8f4b-451346c5c8fa None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:58.535882 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:58.556339 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a8d673-5b96-4562-aec2-db58da4761cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:58.556643 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be870edd-a61b-42e2-addf-1cbd5fe6dd73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:58.557034 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8d673-5b96-4562-aec2-db58da4761cd None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:58.557369 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be870edd-a61b-42e2-addf-1cbd5fe6dd73 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:58.557470 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8d673-5b96-4562-aec2-db58da4761cd None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:58.557757 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be870edd-a61b-42e2-addf-1cbd5fe6dd73 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:58.557858 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8d673-5b96-4562-aec2-db58da4761cd None admin] PATH_INFO: `/v3/domains` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:58.558151 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be870edd-a61b-42e2-addf-1cbd5fe6dd73 None admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:58.558633 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a8d673-5b96-4562-aec2-db58da4761cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:58.558954 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be870edd-a61b-42e2-addf-1cbd5fe6dd73 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:58.559052 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a8d673-5b96-4562-aec2-db58da4761cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:58.559365 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be870edd-a61b-42e2-addf-1cbd5fe6dd73 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:58.560606 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a8d673-5b96-4562-aec2-db58da4761cd None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:58.560973 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be870edd-a61b-42e2-addf-1cbd5fe6dd73 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:58.577209 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 301/599] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 05:16:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:58.577366 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 299/600] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 05:16:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:58.577366 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a8d673-5b96-4562-aec2-db58da4761cd None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:58.577830 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be870edd-a61b-42e2-addf-1cbd5fe6dd73 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:58.679209 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a8d673-5b96-4562-aec2-db58da4761cd None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:58.681069 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be870edd-a61b-42e2-addf-1cbd5fe6dd73 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:58.696264 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:58.714563 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ef586-f3f0-47e8-bbe4-7a7d8d97dff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:58.714839 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6941b868-a809-4fce-bf57-9edd0a82c872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:58.715320 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ef586-f3f0-47e8-bbe4-7a7d8d97dff6 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:58.715484 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6941b868-a809-4fce-bf57-9edd0a82c872 None admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:58.715762 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ef586-f3f0-47e8-bbe4-7a7d8d97dff6 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:58.715879 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6941b868-a809-4fce-bf57-9edd0a82c872 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:58.716047 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6941b868-a809-4fce-bf57-9edd0a82c872 None admin] PATH_INFO: `/v3/projects/61ffb079d9e1437084945554bcc0747b/users/bdd09106382447e9bf8b3a6a9ada89b0/roles/82bd224e8afc480782a85b833a2aa03e` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:58.716228 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ef586-f3f0-47e8-bbe4-7a7d8d97dff6 None admin] PATH_INFO: `/v3/domains` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:58.716941 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303ef586-f3f0-47e8-bbe4-7a7d8d97dff6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:58.717314 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303ef586-f3f0-47e8-bbe4-7a7d8d97dff6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:58.718745 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303ef586-f3f0-47e8-bbe4-7a7d8d97dff6 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:58.730407 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 300/601] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 05:16:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:58.730531 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6941b868-a809-4fce-bf57-9edd0a82c872 None admin] RBAC: Authorizing `identity:create_grant(project_id=61ffb079d9e1437084945554bcc0747b, user_id=bdd09106382447e9bf8b3a6a9ada89b0, role_id=82bd224e8afc480782a85b833a2aa03e)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:58.731194 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ef586-f3f0-47e8-bbe4-7a7d8d97dff6 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:58.731993 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6941b868-a809-4fce-bf57-9edd0a82c872 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:58.746212 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 302/602] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 11 05:16:58 2022] PUT /identity/v3/projects/61ffb079d9e1437084945554bcc0747b/users/bdd09106382447e9bf8b3a6a9ada89b0/roles/82bd224e8afc480782a85b833a2aa03e => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:16:58.747764 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6941b868-a809-4fce-bf57-9edd0a82c872 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:58.790038 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:58.857988 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ef586-f3f0-47e8-bbe4-7a7d8d97dff6 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:58.890493 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6941b868-a809-4fce-bf57-9edd0a82c872 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:58.902318 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbef030-48d6-4736-9cf8-5656a2fdde82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:58.903514 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbef030-48d6-4736-9cf8-5656a2fdde82 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:58.903926 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbef030-48d6-4736-9cf8-5656a2fdde82 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:58.904411 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbef030-48d6-4736-9cf8-5656a2fdde82 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:58.911885 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbef030-48d6-4736-9cf8-5656a2fdde82 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:58.913461 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbef030-48d6-4736-9cf8-5656a2fdde82 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:58.930125 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-1cbef030-48d6-4736-9cf8-5656a2fdde82 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 05:16:58.930125 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:16:58.930125 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:16:58.930125 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:16:58.930125 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:16:58.930125 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:16:58.930125 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:16:58.930125 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:16:58.930125 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:16:58.930125 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:16:58.930125 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:16:58.930125 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:16:58.930125 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 05:16:58.930125 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 05:16:58.930125 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 05:16:58.931240 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 05:16:58.931240 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:16:58.931240 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:16:58.931240 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:16:58.931240 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:16:58.931240 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:16:58.931240 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:16:58.931240 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:16:58.931240 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:16:58.931240 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:16:58.931240 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:16:58.931240 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:16:58.931240 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:16:58.931240 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:16:58.931240 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:16:58.931240 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:16:58.931240 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:16:58.932338 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 05:16:58.932338 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 05:16:58.932338 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 05:16:58.932338 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 05:16:58.932338 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 05:16:58.932338 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 05:16:58.932338 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 05:16:58.932338 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:16:58.932338 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 301/603] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 05:16:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:16:58.932913 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbef030-48d6-4736-9cf8-5656a2fdde82 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:58.933091 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fbf83b-991b-4b09-addd-85ed4b8fde3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:58.933886 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fbf83b-991b-4b09-addd-85ed4b8fde3b None admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:58.934157 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fbf83b-991b-4b09-addd-85ed4b8fde3b None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:58.934432 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fbf83b-991b-4b09-addd-85ed4b8fde3b None admin] PATH_INFO: `/v3/projects/61ffb079d9e1437084945554bcc0747b/users/6cd6136036bd467c946cae90d5c29263/roles/82bd224e8afc480782a85b833a2aa03e` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:58.953087 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fbf83b-991b-4b09-addd-85ed4b8fde3b None admin] RBAC: Authorizing `identity:create_grant(project_id=61ffb079d9e1437084945554bcc0747b, user_id=6cd6136036bd467c946cae90d5c29263, role_id=82bd224e8afc480782a85b833a2aa03e)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:58.954556 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fbf83b-991b-4b09-addd-85ed4b8fde3b None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:58.967258 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 303/604] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 11 05:16:58 2022] PUT /identity/v3/projects/61ffb079d9e1437084945554bcc0747b/users/6cd6136036bd467c946cae90d5c29263/roles/82bd224e8afc480782a85b833a2aa03e => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:16:58.968113 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fbf83b-991b-4b09-addd-85ed4b8fde3b None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:58.973213 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:59.062387 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbef030-48d6-4736-9cf8-5656a2fdde82 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:59.076185 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:59.113842 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15dfeed-b6df-4cfa-8b39-405d9c533c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:59.114511 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15dfeed-b6df-4cfa-8b39-405d9c533c9d None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:59.114866 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fbf83b-991b-4b09-addd-85ed4b8fde3b None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:59.115506 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15dfeed-b6df-4cfa-8b39-405d9c533c9d None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:59.115879 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15dfeed-b6df-4cfa-8b39-405d9c533c9d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:59.131976 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15dfeed-b6df-4cfa-8b39-405d9c533c9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:16:59.142047 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-c15dfeed-b6df-4cfa-8b39-405d9c533c9d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 05:16:59.142047 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:16:59.142047 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:16:59.142047 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:16:59.142047 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:16:59.142047 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:16:59.142047 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:16:59.142047 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:16:59.142047 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:16:59.142047 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:16:59.142047 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:16:59.142047 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:16:59.142047 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:16:59.142047 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:16:59.142047 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:16:59.142047 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:16:59.143333 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:16:59.143333 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:16:59.143333 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:16:59.143333 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:16:59.143333 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:16:59.143333 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:16:59.143333 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:16:59.143333 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:16:59.143333 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:16:59.143333 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:16:59.143333 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:16:59.143333 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:16:59.143333 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:16:59.143333 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:16:59.143333 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:16:59.143333 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:16:59.145714 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:16:59.145714 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:16:59.145714 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:16:59.145714 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:16:59.145714 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:16:59.145714 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:16:59.145714 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:16:59.145714 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:16:59.145714 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:16:59.145714 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:16:59.145714 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 05:16:59.145714 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:16:59.145714 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 302/605] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 11 05:16:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:16:59.147306 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15dfeed-b6df-4cfa-8b39-405d9c533c9d None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:59.170486 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5dee30-ac08-46f9-a0db-d805a7be2509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:59.171610 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5dee30-ac08-46f9-a0db-d805a7be2509 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:59.172088 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5dee30-ac08-46f9-a0db-d805a7be2509 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:59.172564 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5dee30-ac08-46f9-a0db-d805a7be2509 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:59.180938 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5dee30-ac08-46f9-a0db-d805a7be2509 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:59.182577 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5dee30-ac08-46f9-a0db-d805a7be2509 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:59.194870 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-8a5dee30-ac08-46f9-a0db-d805a7be2509 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 05:16:59.194870 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:16:59.194870 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:16:59.194870 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:16:59.194870 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:16:59.194870 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:16:59.194870 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:16:59.194870 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:16:59.194870 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:16:59.194870 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:16:59.194870 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:16:59.194870 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:16:59.194870 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 05:16:59.194870 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 05:16:59.194870 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 05:16:59.195999 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 05:16:59.195999 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:16:59.195999 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:16:59.195999 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:16:59.195999 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:16:59.195999 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:16:59.195999 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:16:59.195999 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:16:59.195999 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:16:59.195999 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:16:59.195999 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:16:59.195999 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:16:59.195999 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:16:59.195999 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:16:59.195999 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:16:59.195999 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:16:59.195999 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:16:59.197108 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 05:16:59.197108 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 05:16:59.197108 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 05:16:59.197108 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 05:16:59.197108 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 05:16:59.197108 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 05:16:59.197108 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 05:16:59.197108 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:16:59.203661 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 304/606] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 05:16:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:16:59.204751 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5dee30-ac08-46f9-a0db-d805a7be2509 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:59.265606 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:59.274306 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15dfeed-b6df-4cfa-8b39-405d9c533c9d None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:59.315019 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5dee30-ac08-46f9-a0db-d805a7be2509 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:59.316183 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105efa88-e9e8-44bb-a963-0fba00fdff24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:59.316801 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105efa88-e9e8-44bb-a963-0fba00fdff24 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:59.317083 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105efa88-e9e8-44bb-a963-0fba00fdff24 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:59.317360 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105efa88-e9e8-44bb-a963-0fba00fdff24 None admin] PATH_INFO: `/v3/projects` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:59.318305 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105efa88-e9e8-44bb-a963-0fba00fdff24 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:59.318677 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105efa88-e9e8-44bb-a963-0fba00fdff24 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:59.321189 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105efa88-e9e8-44bb-a963-0fba00fdff24 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:59.342987 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 303/607] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 05:16:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:59.342987 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105efa88-e9e8-44bb-a963-0fba00fdff24 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:59.360303 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26276711-58f9-4428-9d59-244574be66b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:59.361082 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26276711-58f9-4428-9d59-244574be66b2 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:59.361495 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26276711-58f9-4428-9d59-244574be66b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:59.361950 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26276711-58f9-4428-9d59-244574be66b2 None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:59.362724 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26276711-58f9-4428-9d59-244574be66b2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:59.363133 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26276711-58f9-4428-9d59-244574be66b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:59.364720 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26276711-58f9-4428-9d59-244574be66b2 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:59.368185 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:59.375658 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 305/608] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 11 05:16:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:59.376633 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26276711-58f9-4428-9d59-244574be66b2 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:59.459819 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105efa88-e9e8-44bb-a963-0fba00fdff24 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:59.487167 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26276711-58f9-4428-9d59-244574be66b2 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:59.506637 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e37b6d-17b6-49f2-8cc2-62933ad74b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:59.507340 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e37b6d-17b6-49f2-8cc2-62933ad74b6c None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:59.507628 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e37b6d-17b6-49f2-8cc2-62933ad74b6c None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:59.508032 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e37b6d-17b6-49f2-8cc2-62933ad74b6c None admin] PATH_INFO: `/v3/projects` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:59.508737 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e37b6d-17b6-49f2-8cc2-62933ad74b6c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:59.509046 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e37b6d-17b6-49f2-8cc2-62933ad74b6c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:59.510482 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e37b6d-17b6-49f2-8cc2-62933ad74b6c None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:59.525651 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 304/609] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 05:16:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:16:59.526090 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ac12d8-ebf0-4a6e-a7f5-a3233a97d61b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:59.526509 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e37b6d-17b6-49f2-8cc2-62933ad74b6c None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:59.526820 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ac12d8-ebf0-4a6e-a7f5-a3233a97d61b None admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:59.527103 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ac12d8-ebf0-4a6e-a7f5-a3233a97d61b None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:59.527536 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ac12d8-ebf0-4a6e-a7f5-a3233a97d61b None admin] PATH_INFO: `/v3/projects/61ffb079d9e1437084945554bcc0747b/users/72086abb4e0547dc96d76a44886805ff/roles/82bd224e8afc480782a85b833a2aa03e` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:59.548633 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ac12d8-ebf0-4a6e-a7f5-a3233a97d61b None admin] RBAC: Authorizing `identity:create_grant(project_id=61ffb079d9e1437084945554bcc0747b, user_id=72086abb4e0547dc96d76a44886805ff, role_id=82bd224e8afc480782a85b833a2aa03e)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:59.550139 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:59.550996 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ac12d8-ebf0-4a6e-a7f5-a3233a97d61b None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:59.577772 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 306/610] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 11 05:16:59 2022] PUT /identity/v3/projects/61ffb079d9e1437084945554bcc0747b/users/72086abb4e0547dc96d76a44886805ff/roles/82bd224e8afc480782a85b833a2aa03e => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:16:59.577772 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ac12d8-ebf0-4a6e-a7f5-a3233a97d61b None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:59.697786 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e37b6d-17b6-49f2-8cc2-62933ad74b6c None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:59.714019 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:59.742503 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0be36a-f1a9-44b9-9a63-741347196854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:59.743379 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0be36a-f1a9-44b9-9a63-741347196854 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:59.744927 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0be36a-f1a9-44b9-9a63-741347196854 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:59.745212 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0be36a-f1a9-44b9-9a63-741347196854 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:59.776472 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0be36a-f1a9-44b9-9a63-741347196854 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:59.778999 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0be36a-f1a9-44b9-9a63-741347196854 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:59.801297 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-3c0be36a-f1a9-44b9-9a63-741347196854 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:16:59.801297 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:16:59.801297 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:16:59.801297 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:16:59.801297 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:16:59.801297 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:16:59.801297 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:16:59.801297 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:16:59.801297 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:16:59.801297 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:16:59.801297 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:16:59.801297 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:16:59.801297 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 05:16:59.801297 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 05:16:59.801297 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 05:16:59.801297 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 05:16:59.802314 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:16:59.802314 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:16:59.802314 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:16:59.802314 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:16:59.802314 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:16:59.802314 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:16:59.802314 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:16:59.802314 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:16:59.802314 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:16:59.802314 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:16:59.802314 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:16:59.802314 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:16:59.802314 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:16:59.802314 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:16:59.802314 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:16:59.802314 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:16:59.802314 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 05:16:59.803820 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 05:16:59.803820 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:16:59.803820 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:16:59.803820 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 305/611] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:16:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:16:59.809824 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ac12d8-ebf0-4a6e-a7f5-a3233a97d61b None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:59.809971 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0be36a-f1a9-44b9-9a63-741347196854 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:16:59.858020 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f6f4c7-17c4-4b49-9406-ef209307465c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:59.858692 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f6f4c7-17c4-4b49-9406-ef209307465c None admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:59.859020 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f6f4c7-17c4-4b49-9406-ef209307465c None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:59.859881 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f6f4c7-17c4-4b49-9406-ef209307465c None admin] PATH_INFO: `/v3/projects/61ffb079d9e1437084945554bcc0747b/users/5a147e14b61d481db1cac02c58ac3500/roles/82bd224e8afc480782a85b833a2aa03e` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:59.881730 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f6f4c7-17c4-4b49-9406-ef209307465c None admin] RBAC: Authorizing `identity:create_grant(project_id=61ffb079d9e1437084945554bcc0747b, user_id=5a147e14b61d481db1cac02c58ac3500, role_id=82bd224e8afc480782a85b833a2aa03e)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:59.883247 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f6f4c7-17c4-4b49-9406-ef209307465c None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:59.897303 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:16:59.909021 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 307/612] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 11 05:16:59 2022] PUT /identity/v3/projects/61ffb079d9e1437084945554bcc0747b/users/5a147e14b61d481db1cac02c58ac3500/roles/82bd224e8afc480782a85b833a2aa03e => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:16:59.944647 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0be36a-f1a9-44b9-9a63-741347196854 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:16:59.982310 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a6c6f-07ca-42e9-b55d-161557287037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:16:59.982851 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a6c6f-07ca-42e9-b55d-161557287037 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:16:59.983139 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a6c6f-07ca-42e9-b55d-161557287037 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:16:59.983480 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a6c6f-07ca-42e9-b55d-161557287037 None admin] PATH_INFO: `/v3/domains` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:16:59.984169 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567a6c6f-07ca-42e9-b55d-161557287037 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:16:59.984481 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567a6c6f-07ca-42e9-b55d-161557287037 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:16:59.985875 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567a6c6f-07ca-42e9-b55d-161557287037 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:16:59.999221 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 306/613] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 05:16:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:00.004960 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f6f4c7-17c4-4b49-9406-ef209307465c None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:00.132349 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:00.137217 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f6f4c7-17c4-4b49-9406-ef209307465c None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:00.189212 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2023ca0d-ac4f-4211-8070-435b7396bb9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:00.189874 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2023ca0d-ac4f-4211-8070-435b7396bb9e None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:00.190159 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2023ca0d-ac4f-4211-8070-435b7396bb9e None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:00.190437 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2023ca0d-ac4f-4211-8070-435b7396bb9e None admin] PATH_INFO: `/v3/users/swift` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:00.200844 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2023ca0d-ac4f-4211-8070-435b7396bb9e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:00.202353 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2023ca0d-ac4f-4211-8070-435b7396bb9e None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:00.218881 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-2023ca0d-ac4f-4211-8070-435b7396bb9e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 11 05:17:00.218881 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:00.218881 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:00.218881 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:00.218881 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:00.218881 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:00.218881 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:00.218881 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:00.218881 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:00.218881 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:00.218881 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:00.218881 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:00.218881 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 05:17:00.218881 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 05:17:00.218881 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 05:17:00.218881 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 05:17:00.219932 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:00.219932 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:00.219932 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 05:17:00.219932 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 05:17:00.219932 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 05:17:00.219932 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 05:17:00.219932 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:00.219932 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:00.219932 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:00.219932 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:00.219932 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:00.219932 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:00.219932 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:00.219932 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:00.219932 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:00.219932 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:00.219932 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:00.219932 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:00.221309 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:00.221309 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:00.221309 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 05:17:00.221309 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 05:17:00.221309 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 05:17:00.221309 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 05:17:00.221309 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 05:17:00.221309 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 05:17:00.221309 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 11 05:17:00.221309 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:17:00.221309 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 308/614] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 05:17:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:00.228273 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a6c6f-07ca-42e9-b55d-161557287037 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:00.339791 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a6c6f-07ca-42e9-b55d-161557287037 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:00.368418 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:00.376674 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28883dca-3e55-49d0-95ef-4401c9078c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:00.377596 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28883dca-3e55-49d0-95ef-4401c9078c43 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:00.378220 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28883dca-3e55-49d0-95ef-4401c9078c43 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:00.378499 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28883dca-3e55-49d0-95ef-4401c9078c43 None admin] PATH_INFO: `/v3/users` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:00.379239 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28883dca-3e55-49d0-95ef-4401c9078c43 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:00.379813 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28883dca-3e55-49d0-95ef-4401c9078c43 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:00.381732 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28883dca-3e55-49d0-95ef-4401c9078c43 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:00.400206 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 307/615] 10.222.0.16 () {56 vars in 1135 bytes} [Sun Sep 11 05:17:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:00.408757 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2023ca0d-ac4f-4211-8070-435b7396bb9e None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:00.573968 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2023ca0d-ac4f-4211-8070-435b7396bb9e None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:00.626353 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd0f018-f816-4ab7-a8ae-81d09adf30ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:00.626909 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd0f018-f816-4ab7-a8ae-81d09adf30ab None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:00.627194 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd0f018-f816-4ab7-a8ae-81d09adf30ab None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:00.627467 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd0f018-f816-4ab7-a8ae-81d09adf30ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:00.643843 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd0f018-f816-4ab7-a8ae-81d09adf30ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:00.645339 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd0f018-f816-4ab7-a8ae-81d09adf30ab None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:00.664306 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-1cd0f018-f816-4ab7-a8ae-81d09adf30ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:17:00.664306 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:00.664306 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:00.664306 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:00.664306 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:00.664306 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:00.664306 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:00.664306 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:00.664306 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:00.664306 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:00.664306 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:00.664306 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:00.664306 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 05:17:00.664306 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 05:17:00.664306 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 05:17:00.664306 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 05:17:00.665296 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:00.665296 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:00.665296 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:00.665296 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:00.665296 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:00.665296 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:00.665296 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:00.665296 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:00.665296 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:00.665296 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:00.665296 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:00.665296 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:00.665296 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:00.665296 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:00.665296 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:00.665296 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:00.665296 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 05:17:00.666782 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 05:17:00.666782 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:17:00.666782 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:17:00.666782 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 309/616] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:17:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:00.671149 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28883dca-3e55-49d0-95ef-4401c9078c43 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:00.833439 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28883dca-3e55-49d0-95ef-4401c9078c43 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:00.878492 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed5c03-be0f-4512-b1e5-992e81585e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:00.879042 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed5c03-be0f-4512-b1e5-992e81585e2a None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:00.879330 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed5c03-be0f-4512-b1e5-992e81585e2a None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:00.879612 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed5c03-be0f-4512-b1e5-992e81585e2a None admin] PATH_INFO: `/v3/domains` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:00.880304 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ed5c03-be0f-4512-b1e5-992e81585e2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:00.881139 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ed5c03-be0f-4512-b1e5-992e81585e2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:00.882665 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ed5c03-be0f-4512-b1e5-992e81585e2a None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:00.894761 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 308/617] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 05:17:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:00.904819 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd0f018-f816-4ab7-a8ae-81d09adf30ab None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:00.931956 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:01.057207 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd0f018-f816-4ab7-a8ae-81d09adf30ab None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:01.105545 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b8548b-e959-4824-9107-fd287653c530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:01.106192 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8548b-e959-4824-9107-fd287653c530 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:01.106528 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8548b-e959-4824-9107-fd287653c530 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:01.106808 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8548b-e959-4824-9107-fd287653c530 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:01.121053 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b8548b-e959-4824-9107-fd287653c530 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:01.122533 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b8548b-e959-4824-9107-fd287653c530 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:01.137326 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-36b8548b-e959-4824-9107-fd287653c530 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 05:17:01.137326 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:01.137326 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:01.137326 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:01.137326 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:01.137326 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:01.137326 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:01.137326 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:01.137326 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:01.137326 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:01.137326 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:01.137326 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:01.137326 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 05:17:01.137326 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 05:17:01.137326 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 05:17:01.138401 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 05:17:01.138401 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:01.138401 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:01.138401 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:01.138401 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:01.138401 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:01.138401 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:01.138401 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:01.138401 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:01.138401 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:01.138401 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:01.138401 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:01.138401 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:01.138401 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:01.138401 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:01.138401 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:01.138401 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:01.139927 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 05:17:01.139927 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 05:17:01.139927 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 05:17:01.139927 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 05:17:01.139927 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 05:17:01.139927 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 05:17:01.139927 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 05:17:01.139927 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:17:01.139927 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 310/618] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 05:17:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:01.144346 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed5c03-be0f-4512-b1e5-992e81585e2a None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:01.264200 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:01.341066 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed5c03-be0f-4512-b1e5-992e81585e2a None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:01.378353 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06031161-bbbf-43c1-b74c-e6425d69c09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:01.378975 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06031161-bbbf-43c1-b74c-e6425d69c09e None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:01.379262 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06031161-bbbf-43c1-b74c-e6425d69c09e None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:01.379543 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06031161-bbbf-43c1-b74c-e6425d69c09e None admin] PATH_INFO: `/v3/projects` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:01.380288 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06031161-bbbf-43c1-b74c-e6425d69c09e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:01.381142 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06031161-bbbf-43c1-b74c-e6425d69c09e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:01.382600 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06031161-bbbf-43c1-b74c-e6425d69c09e None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:01.395393 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 309/619] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 05:17:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:01.400896 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a72c6d-b8ba-4b11-b65e-531ba2e73157 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:01.401206 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06031161-bbbf-43c1-b74c-e6425d69c09e None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:01.401317 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a72c6d-b8ba-4b11-b65e-531ba2e73157 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:01.401476 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a72c6d-b8ba-4b11-b65e-531ba2e73157 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:01.403005 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 311/620] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:17:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:17:01.408115 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226828c7-ab8b-4991-ac4b-666601cb669e None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:01.408398 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226828c7-ab8b-4991-ac4b-666601cb669e None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:01.408674 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226828c7-ab8b-4991-ac4b-666601cb669e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:01.447670 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-226828c7-ab8b-4991-ac4b-666601cb669e None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:17:01.448836 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-226828c7-ab8b-4991-ac4b-666601cb669e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:17:01.518642 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06031161-bbbf-43c1-b74c-e6425d69c09e None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:01.527060 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:01.530048 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:01.532216 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 312/621] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:17:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 05:17:01.533660 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e6c201-40a4-45ca-923b-95c581da9ffe None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:01.534020 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e6c201-40a4-45ca-923b-95c581da9ffe None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:01.534356 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e6c201-40a4-45ca-923b-95c581da9ffe None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:01.540457 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 313/622] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:17:01 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:17:01.541669 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a494b4e5-6e8e-4227-ad96-4b921ce85204 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:01.542025 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a494b4e5-6e8e-4227-ad96-4b921ce85204 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:01.542358 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a494b4e5-6e8e-4227-ad96-4b921ce85204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:01.560421 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-a494b4e5-6e8e-4227-ad96-4b921ce85204 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:17:01.561902 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-a494b4e5-6e8e-4227-ad96-4b921ce85204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:17:01.563001 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d9b4d2-44d1-4ebe-97a8-af4dc20b0def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:01.564155 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d9b4d2-44d1-4ebe-97a8-af4dc20b0def None admin] REQUEST_METHOD: `PUT` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:01.565696 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d9b4d2-44d1-4ebe-97a8-af4dc20b0def None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:01.566153 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d9b4d2-44d1-4ebe-97a8-af4dc20b0def None admin] PATH_INFO: `/v3/projects/61ffb079d9e1437084945554bcc0747b/users/2bbe4555380345e485572d2da8b78be1/roles/82bd224e8afc480782a85b833a2aa03e` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:01.585042 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d9b4d2-44d1-4ebe-97a8-af4dc20b0def None admin] RBAC: Authorizing `identity:create_grant(project_id=61ffb079d9e1437084945554bcc0747b, user_id=2bbe4555380345e485572d2da8b78be1, role_id=82bd224e8afc480782a85b833a2aa03e)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:01.586668 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d9b4d2-44d1-4ebe-97a8-af4dc20b0def None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:01.612535 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 310/623] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 11 05:17:01 2022] PUT /identity/v3/projects/61ffb079d9e1437084945554bcc0747b/users/2bbe4555380345e485572d2da8b78be1/roles/82bd224e8afc480782a85b833a2aa03e => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 05:17:01.653584 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 314/624] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:17:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 05:17:01.859632 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d9b4d2-44d1-4ebe-97a8-af4dc20b0def None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:01.979550 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d9b4d2-44d1-4ebe-97a8-af4dc20b0def None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:02.002089 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a494b4e5-6e8e-4227-ad96-4b921ce85204 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:02.028068 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fc7e3c-f4ba-4c24-a73d-f154f8ba690c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:02.028709 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc7e3c-f4ba-4c24-a73d-f154f8ba690c None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:02.028992 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc7e3c-f4ba-4c24-a73d-f154f8ba690c None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:02.029267 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc7e3c-f4ba-4c24-a73d-f154f8ba690c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:02.053758 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fc7e3c-f4ba-4c24-a73d-f154f8ba690c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:17:02.059567 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-d0fc7e3c-f4ba-4c24-a73d-f154f8ba690c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 05:17:02.059567 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:02.059567 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:02.059567 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:02.059567 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:02.059567 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:02.059567 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:02.059567 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:02.059567 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:02.059567 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:02.059567 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:02.059567 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:02.059567 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:17:02.059567 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:17:02.059567 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:17:02.059567 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:17:02.060524 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:17:02.060524 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:17:02.060524 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:17:02.060524 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:17:02.060524 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:02.060524 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:02.060524 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:02.060524 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:02.060524 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:02.060524 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:02.060524 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:02.060524 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:02.060524 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:02.060524 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:02.060524 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:02.060524 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:02.061363 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:02.061363 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:02.061363 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:02.061363 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:02.061363 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:17:02.061363 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:17:02.061363 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:17:02.061363 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:17:02.061363 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:17:02.061363 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:17:02.061363 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 05:17:02.061363 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:02.071218 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 311/625] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 11 05:17:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:02.072921 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fc7e3c-f4ba-4c24-a73d-f154f8ba690c None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:02.100618 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:02.225825 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a494b4e5-6e8e-4227-ad96-4b921ce85204 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:02.251207 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fc7e3c-f4ba-4c24-a73d-f154f8ba690c None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:02.282875 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:02.289449 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a6b15e-26a0-4762-bbef-6309c16eaeb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:02.290141 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6b15e-26a0-4762-bbef-6309c16eaeb8 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:02.290422 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6b15e-26a0-4762-bbef-6309c16eaeb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:02.290706 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6b15e-26a0-4762-bbef-6309c16eaeb8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:02.303181 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a6b15e-26a0-4762-bbef-6309c16eaeb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:17:02.303553 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bb4d61-f834-4bc2-a45e-a015b2adc83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:02.304357 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb4d61-f834-4bc2-a45e-a015b2adc83f None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:02.304804 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb4d61-f834-4bc2-a45e-a015b2adc83f None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:02.305223 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb4d61-f834-4bc2-a45e-a015b2adc83f None admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:02.306103 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bb4d61-f834-4bc2-a45e-a015b2adc83f None admin] RBAC: Adding query filter params (name=service) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:02.306556 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bb4d61-f834-4bc2-a45e-a015b2adc83f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:02.308004 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-e9a6b15e-26a0-4762-bbef-6309c16eaeb8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 05:17:02.308004 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:02.308004 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:02.308004 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:02.308004 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:02.308004 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:02.308004 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:02.308004 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:02.308004 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:02.308004 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:02.308004 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:02.308004 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:02.308004 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:17:02.308004 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:17:02.308004 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:17:02.308004 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:17:02.309137 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:17:02.309137 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:17:02.309137 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:17:02.309137 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:17:02.309137 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:02.309137 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:02.309137 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:02.309137 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:02.309137 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:02.309137 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:02.309137 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:02.309137 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:02.309137 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:02.309137 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:02.309137 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:02.309137 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:02.310312 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:02.310312 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:02.310312 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:02.310312 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:02.310312 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:17:02.310312 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:17:02.310312 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:17:02.310312 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:17:02.310312 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:17:02.310312 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:17:02.310312 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 05:17:02.310312 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:17:02.310312 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 315/626] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 11 05:17:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:02.311054 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e888d4ab-e4e1-48f4-98ba-71eea9c2c9d0 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:02.311054 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e888d4ab-e4e1-48f4-98ba-71eea9c2c9d0 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:02.311181 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e888d4ab-e4e1-48f4-98ba-71eea9c2c9d0 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:02.311602 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bb4d61-f834-4bc2-a45e-a015b2adc83f None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:02.315761 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 316/627] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:17:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:17:02.317919 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e888d4ab-e4e1-48f4-98ba-71eea9c2c9d0 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:02.327041 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 312/628] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 11 05:17:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:02.328577 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd624785-ef47-4622-ad34-e37245101ad1 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:02.329058 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd624785-ef47-4622-ad34-e37245101ad1 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:02.329525 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd624785-ef47-4622-ad34-e37245101ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:02.349006 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-fd624785-ef47-4622-ad34-e37245101ad1 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:17:02.350616 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-fd624785-ef47-4622-ad34-e37245101ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:17:02.422757 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 313/629] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:17:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 05:17:02.432111 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd624785-ef47-4622-ad34-e37245101ad1 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:02.434905 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e888d4ab-e4e1-48f4-98ba-71eea9c2c9d0 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:02.446444 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:02.506761 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7c5f52-12a3-42d7-9008-d1c6c91ef42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:02.508086 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c5f52-12a3-42d7-9008-d1c6c91ef42e None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:02.508564 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c5f52-12a3-42d7-9008-d1c6c91ef42e None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:02.509031 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c5f52-12a3-42d7-9008-d1c6c91ef42e None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:02.511074 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7c5f52-12a3-42d7-9008-d1c6c91ef42e None admin] RBAC: Adding query filter params (name=service) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:02.511864 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7c5f52-12a3-42d7-9008-d1c6c91ef42e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:02.514401 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7c5f52-12a3-42d7-9008-d1c6c91ef42e None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:02.534092 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 317/630] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 11 05:17:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:17:02.539625 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7c5f52-12a3-42d7-9008-d1c6c91ef42e None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:02.574223 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd624785-ef47-4622-ad34-e37245101ad1 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:02.617059 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68875047-e9f9-4201-9e28-b996b43d3141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:02.618270 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68875047-e9f9-4201-9e28-b996b43d3141 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:02.620012 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68875047-e9f9-4201-9e28-b996b43d3141 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:02.620510 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68875047-e9f9-4201-9e28-b996b43d3141 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:02.640636 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68875047-e9f9-4201-9e28-b996b43d3141 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:02.642615 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68875047-e9f9-4201-9e28-b996b43d3141 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:02.649795 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:02.677010 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-68875047-e9f9-4201-9e28-b996b43d3141 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:17:02.677010 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:02.677010 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:02.677010 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:02.677010 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:02.677010 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:02.677010 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:02.677010 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:02.677010 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:02.677010 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:02.677010 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:02.677010 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:02.677010 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 05:17:02.677010 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 05:17:02.677010 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 05:17:02.677010 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 05:17:02.678564 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:02.678564 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:02.678564 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:02.678564 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:02.678564 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:02.678564 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:02.678564 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:02.678564 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:02.678564 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:02.678564 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:02.678564 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:02.678564 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:02.678564 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:02.678564 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:02.678564 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:02.678564 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:02.678564 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 05:17:02.679446 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 05:17:02.679446 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:17:02.679446 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:02.679446 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 314/631] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:17:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:02.685294 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68875047-e9f9-4201-9e28-b996b43d3141 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:02.710252 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7c5f52-12a3-42d7-9008-d1c6c91ef42e None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:02.779773 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4cf4da-7bfc-4926-af1c-e6c3bc2089d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:02.780751 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4cf4da-7bfc-4926-af1c-e6c3bc2089d7 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:02.781262 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4cf4da-7bfc-4926-af1c-e6c3bc2089d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:02.781744 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4cf4da-7bfc-4926-af1c-e6c3bc2089d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:02.798856 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4cf4da-7bfc-4926-af1c-e6c3bc2089d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:02.800359 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4cf4da-7bfc-4926-af1c-e6c3bc2089d7 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:02.802866 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:02.821144 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-9b4cf4da-7bfc-4926-af1c-e6c3bc2089d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:17:02.821144 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:02.821144 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:02.821144 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:02.821144 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:02.821144 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:02.821144 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:02.821144 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:02.821144 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:02.821144 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:02.821144 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:02.821144 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:02.821144 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 05:17:02.821144 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 05:17:02.821144 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 05:17:02.821144 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 05:17:02.822379 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:02.822379 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:02.822379 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:02.822379 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:02.822379 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:02.822379 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:02.822379 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:02.822379 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:02.822379 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:02.822379 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:02.822379 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:02.822379 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:02.822379 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:02.822379 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:02.822379 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:02.822379 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:02.822379 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 05:17:02.823491 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 05:17:02.823491 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:17:02.823491 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:17:02.825223 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 318/632] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:17:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 05:17:02.826265 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4cf4da-7bfc-4926-af1c-e6c3bc2089d7 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:02.861221 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68875047-e9f9-4201-9e28-b996b43d3141 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:02.903927 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd5b86d-43b6-450f-806c-0cd3727fa82a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:02.904605 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd5b86d-43b6-450f-806c-0cd3727fa82a None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:02.904887 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd5b86d-43b6-450f-806c-0cd3727fa82a None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:02.905180 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd5b86d-43b6-450f-806c-0cd3727fa82a None admin] PATH_INFO: `/v3/domains` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:02.905827 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd5b86d-43b6-450f-806c-0cd3727fa82a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:02.906135 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd5b86d-43b6-450f-806c-0cd3727fa82a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:02.907506 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd5b86d-43b6-450f-806c-0cd3727fa82a None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:02.929394 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 315/633] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 05:17:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:17:02.929394 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd5b86d-43b6-450f-806c-0cd3727fa82a None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:02.936084 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4cf4da-7bfc-4926-af1c-e6c3bc2089d7 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:02.938554 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:02.970577 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8486a046-75ee-46bc-abf2-3b1cc2e6cdd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:02.971196 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8486a046-75ee-46bc-abf2-3b1cc2e6cdd4 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:02.971473 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8486a046-75ee-46bc-abf2-3b1cc2e6cdd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:02.971768 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8486a046-75ee-46bc-abf2-3b1cc2e6cdd4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:02.982633 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8486a046-75ee-46bc-abf2-3b1cc2e6cdd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:17:02.987800 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-8486a046-75ee-46bc-abf2-3b1cc2e6cdd4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 05:17:02.987800 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:02.987800 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:02.987800 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:02.987800 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:02.987800 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:02.987800 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:02.987800 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:02.987800 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:02.987800 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:02.987800 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:02.987800 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:02.987800 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:17:02.987800 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:17:02.987800 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:17:02.987800 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:17:02.988744 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:17:02.988744 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:17:02.988744 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:17:02.988744 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:17:02.988744 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:02.988744 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:02.988744 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:02.988744 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:02.988744 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:02.988744 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:02.988744 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:02.988744 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:02.988744 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:02.988744 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:02.988744 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:02.988744 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:02.989649 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:02.989649 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:02.989649 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:02.989649 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:02.989649 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:17:02.989649 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:17:02.989649 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:17:02.989649 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:17:02.989649 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:17:02.989649 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:17:02.989649 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 05:17:02.989649 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:17:02.989649 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 319/634] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 11 05:17:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:02.990458 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a66a7-3ab1-4c1a-9306-5bb0fbc2d9ac None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:02.991242 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a66a7-3ab1-4c1a-9306-5bb0fbc2d9ac None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:02.991242 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a66a7-3ab1-4c1a-9306-5bb0fbc2d9ac None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:02.995908 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 320/635] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:17:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:17:02.995908 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71a66a7-3ab1-4c1a-9306-5bb0fbc2d9ac None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:03.040635 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd5b86d-43b6-450f-806c-0cd3727fa82a None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:03.066648 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:03.081143 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cc5ebb-4b1d-43ba-82af-80bff6903dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:03.081753 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc5ebb-4b1d-43ba-82af-80bff6903dd7 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:03.082034 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc5ebb-4b1d-43ba-82af-80bff6903dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:03.082313 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc5ebb-4b1d-43ba-82af-80bff6903dd7 None admin] PATH_INFO: `/v3/domains` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:03.082985 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cc5ebb-4b1d-43ba-82af-80bff6903dd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:03.083288 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cc5ebb-4b1d-43ba-82af-80bff6903dd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:03.084724 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cc5ebb-4b1d-43ba-82af-80bff6903dd7 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:03.097327 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 316/636] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 05:17:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:03.098606 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cc5ebb-4b1d-43ba-82af-80bff6903dd7 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:03.108059 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71a66a7-3ab1-4c1a-9306-5bb0fbc2d9ac None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:03.144783 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba22ec0a-e6a2-43d4-adcc-c2bb20ec978d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:03.145412 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba22ec0a-e6a2-43d4-adcc-c2bb20ec978d None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:03.145691 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba22ec0a-e6a2-43d4-adcc-c2bb20ec978d None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:03.145961 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba22ec0a-e6a2-43d4-adcc-c2bb20ec978d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:03.153953 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba22ec0a-e6a2-43d4-adcc-c2bb20ec978d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:03.155453 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba22ec0a-e6a2-43d4-adcc-c2bb20ec978d None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:03.168242 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-ba22ec0a-e6a2-43d4-adcc-c2bb20ec978d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 11 05:17:03.168242 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:03.168242 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:03.168242 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:03.168242 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:03.168242 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:03.168242 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:03.168242 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:03.168242 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:03.168242 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:03.168242 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:03.168242 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:03.168242 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 05:17:03.168242 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 05:17:03.168242 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 05:17:03.168242 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 05:17:03.169278 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:03.169278 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:03.169278 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 05:17:03.169278 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 05:17:03.169278 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 05:17:03.169278 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 05:17:03.169278 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:03.169278 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:03.169278 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:03.169278 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:03.169278 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:03.169278 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:03.169278 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:03.169278 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:03.169278 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:03.169278 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:03.169278 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:03.169278 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:03.170237 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:03.170237 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:03.170237 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 05:17:03.170237 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 05:17:03.170237 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 05:17:03.170237 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 05:17:03.170237 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 05:17:03.170237 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 05:17:03.170237 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 11 05:17:03.170237 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:17:03.170237 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 321/637] 10.222.0.16 () {56 vars in 1093 bytes} [Sun Sep 11 05:17:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:03.175105 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d2560-1392-4c02-852b-564b61931807 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:03.175393 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d2560-1392-4c02-852b-564b61931807 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:03.175670 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d2560-1392-4c02-852b-564b61931807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:03.193785 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-a55d2560-1392-4c02-852b-564b61931807 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:17:03.194953 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-a55d2560-1392-4c02-852b-564b61931807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:17:03.216322 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:03.219967 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cc5ebb-4b1d-43ba-82af-80bff6903dd7 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:03.256031 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb7ac6c-a574-4902-90c4-b1b84e19f35d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:03.256642 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb7ac6c-a574-4902-90c4-b1b84e19f35d None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:03.256924 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb7ac6c-a574-4902-90c4-b1b84e19f35d None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:03.257213 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb7ac6c-a574-4902-90c4-b1b84e19f35d None admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:03.257854 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb7ac6c-a574-4902-90c4-b1b84e19f35d None admin] RBAC: Adding query filter params (name=service) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:03.258163 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb7ac6c-a574-4902-90c4-b1b84e19f35d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:03.259522 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb7ac6c-a574-4902-90c4-b1b84e19f35d None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:03.266170 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 322/638] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:17:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 05:17:03.267009 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d2560-1392-4c02-852b-564b61931807 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:03.282583 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 317/639] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 11 05:17:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:03.283704 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb7ac6c-a574-4902-90c4-b1b84e19f35d None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:03.336590 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:03.384922 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d2560-1392-4c02-852b-564b61931807 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:03.410658 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb7ac6c-a574-4902-90c4-b1b84e19f35d None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:03.421317 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173b4d40-4f73-40e6-a156-b2daf4aa911c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:03.422178 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173b4d40-4f73-40e6-a156-b2daf4aa911c None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:03.422729 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173b4d40-4f73-40e6-a156-b2daf4aa911c None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:03.423191 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173b4d40-4f73-40e6-a156-b2daf4aa911c None admin] PATH_INFO: `/v3/users/glance` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:03.431242 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173b4d40-4f73-40e6-a156-b2daf4aa911c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:03.432945 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173b4d40-4f73-40e6-a156-b2daf4aa911c None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:03.445540 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-173b4d40-4f73-40e6-a156-b2daf4aa911c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 11 05:17:03.445540 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:03.445540 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:03.445540 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:03.445540 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:03.445540 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:03.445540 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:03.445540 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:03.445540 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:03.445540 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:03.445540 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:03.445540 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:03.445540 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 05:17:03.445540 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 05:17:03.445540 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 05:17:03.445540 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 05:17:03.446641 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:03.446641 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:03.446641 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 05:17:03.446641 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 05:17:03.446641 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 05:17:03.446641 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 05:17:03.446641 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:03.446641 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:03.446641 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:03.446641 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:03.446641 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:03.446641 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:03.446641 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:03.446641 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:03.446641 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:03.446641 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:03.446641 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:03.446641 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:03.447809 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:03.447809 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:03.447809 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 05:17:03.447809 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 05:17:03.447809 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 05:17:03.447809 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 05:17:03.447809 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 05:17:03.447809 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 05:17:03.447809 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 11 05:17:03.447809 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:17:03.454000 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d838ed3f-b242-450a-93ed-e70b2b465719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:03.454000 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d838ed3f-b242-450a-93ed-e70b2b465719 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:03.454000 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d838ed3f-b242-450a-93ed-e70b2b465719 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:03.454000 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d838ed3f-b242-450a-93ed-e70b2b465719 None admin] PATH_INFO: `/v3/users` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:03.454387 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d838ed3f-b242-450a-93ed-e70b2b465719 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:03.454387 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d838ed3f-b242-450a-93ed-e70b2b465719 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:03.454789 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d838ed3f-b242-450a-93ed-e70b2b465719 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:03.454936 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 323/640] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 05:17:03 2022] GET /identity/v3/users/glance => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:03.456004 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173b4d40-4f73-40e6-a156-b2daf4aa911c None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:03.472844 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:03.479766 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 318/641] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Sep 11 05:17:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:03.480832 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d838ed3f-b242-450a-93ed-e70b2b465719 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:03.569369 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173b4d40-4f73-40e6-a156-b2daf4aa911c None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:03.597836 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:03.602492 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d838ed3f-b242-450a-93ed-e70b2b465719 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:03.605381 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0ec66e-1f73-4232-b373-5089ea567b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:03.606025 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ec66e-1f73-4232-b373-5089ea567b6f None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:03.606306 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ec66e-1f73-4232-b373-5089ea567b6f None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:03.606607 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ec66e-1f73-4232-b373-5089ea567b6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:03.618278 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0ec66e-1f73-4232-b373-5089ea567b6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:03.619776 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0ec66e-1f73-4232-b373-5089ea567b6f None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:03.634289 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-fc0ec66e-1f73-4232-b373-5089ea567b6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:17:03.634289 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:03.634289 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:03.634289 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:03.634289 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:03.634289 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:03.634289 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:03.634289 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:03.634289 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:03.634289 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:03.634289 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:03.634289 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:03.634289 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 05:17:03.634289 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 05:17:03.634289 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 05:17:03.634289 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 05:17:03.635308 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:03.635308 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:03.635308 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:03.635308 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:03.635308 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:03.635308 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:03.635308 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:03.635308 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:03.635308 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:03.635308 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:03.635308 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:03.635308 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:03.635308 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:03.635308 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:03.635308 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:03.635308 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:03.635308 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 05:17:03.636264 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 05:17:03.636264 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:17:03.636264 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:17:03.636264 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 324/642] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:17:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:03.636501 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0ec66e-1f73-4232-b373-5089ea567b6f None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:03.647223 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f34f5c1-4ab2-4909-b7d9-c6815950b0df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:03.647954 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f34f5c1-4ab2-4909-b7d9-c6815950b0df None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:03.648237 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f34f5c1-4ab2-4909-b7d9-c6815950b0df None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:03.648509 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f34f5c1-4ab2-4909-b7d9-c6815950b0df None admin] PATH_INFO: `/v3/users` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:03.649240 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f34f5c1-4ab2-4909-b7d9-c6815950b0df None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:03.649546 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f34f5c1-4ab2-4909-b7d9-c6815950b0df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:03.650971 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f34f5c1-4ab2-4909-b7d9-c6815950b0df None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:03.669273 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 319/643] 10.222.0.16 () {56 vars in 1137 bytes} [Sun Sep 11 05:17:03 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:03.670082 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f34f5c1-4ab2-4909-b7d9-c6815950b0df None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:03.708251 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:03.745490 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0ec66e-1f73-4232-b373-5089ea567b6f None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:03.780245 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753e9e00-0047-4b9d-87d2-e23fd27cc0ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:03.780862 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e9e00-0047-4b9d-87d2-e23fd27cc0ad None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:03.781134 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e9e00-0047-4b9d-87d2-e23fd27cc0ad None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:03.781407 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e9e00-0047-4b9d-87d2-e23fd27cc0ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:03.783653 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f34f5c1-4ab2-4909-b7d9-c6815950b0df None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:03.821961 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dda7c2-7f77-47bf-8ede-053713b26b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:03.822591 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dda7c2-7f77-47bf-8ede-053713b26b38 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:03.822874 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dda7c2-7f77-47bf-8ede-053713b26b38 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:03.823143 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dda7c2-7f77-47bf-8ede-053713b26b38 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:03.833180 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dda7c2-7f77-47bf-8ede-053713b26b38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:17:03.838037 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-d2dda7c2-7f77-47bf-8ede-053713b26b38 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 05:17:03.838037 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:03.838037 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:03.838037 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:03.838037 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:03.838037 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:03.838037 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:03.838037 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:03.838037 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:03.838037 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:03.838037 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:03.838037 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:03.838037 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:17:03.838037 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:17:03.838037 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:17:03.838037 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:17:03.839184 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:17:03.839184 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:17:03.839184 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:17:03.839184 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:17:03.839184 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:03.839184 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:03.839184 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:03.839184 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:03.839184 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:03.839184 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:03.839184 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:03.839184 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:03.839184 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:03.839184 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:03.839184 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:03.839184 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:03.840314 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:03.840314 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:03.840314 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:03.840314 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:03.840314 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:17:03.840314 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:17:03.840314 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:17:03.840314 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:17:03.840314 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:17:03.840314 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:17:03.840314 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 05:17:03.840314 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:03.844261 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 320/644] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 11 05:17:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:03.845108 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dda7c2-7f77-47bf-8ede-053713b26b38 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:03.856991 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753e9e00-0047-4b9d-87d2-e23fd27cc0ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:03.858397 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753e9e00-0047-4b9d-87d2-e23fd27cc0ad None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:03.866963 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:03.924230 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:03.959134 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dda7c2-7f77-47bf-8ede-053713b26b38 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:03.963718 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 325/645] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 05:17:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 05:17:03.964637 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753e9e00-0047-4b9d-87d2-e23fd27cc0ad None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:04.004335 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c09f697-a73a-4409-9fee-92ee23136cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:04.006556 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c09f697-a73a-4409-9fee-92ee23136cf1 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:04.006907 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c09f697-a73a-4409-9fee-92ee23136cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:04.007246 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c09f697-a73a-4409-9fee-92ee23136cf1 None admin] PATH_INFO: `/v3/domains` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:04.008004 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c09f697-a73a-4409-9fee-92ee23136cf1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:04.008378 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c09f697-a73a-4409-9fee-92ee23136cf1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:04.009874 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c09f697-a73a-4409-9fee-92ee23136cf1 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:04.028545 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 321/646] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 05:17:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:04.028545 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c09f697-a73a-4409-9fee-92ee23136cf1 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:04.073783 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753e9e00-0047-4b9d-87d2-e23fd27cc0ad None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:04.109621 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ae49b1-45a1-486c-9278-21f07bf5bd44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:04.110158 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae49b1-45a1-486c-9278-21f07bf5bd44 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:04.110437 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae49b1-45a1-486c-9278-21f07bf5bd44 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:04.110712 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae49b1-45a1-486c-9278-21f07bf5bd44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:04.114500 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:04.138086 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c09f697-a73a-4409-9fee-92ee23136cf1 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:04.144816 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:04.172071 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3e6ece-2e63-4309-a6b7-2469b807d567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:04.172675 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e6ece-2e63-4309-a6b7-2469b807d567 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:04.172949 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e6ece-2e63-4309-a6b7-2469b807d567 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:04.173216 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e6ece-2e63-4309-a6b7-2469b807d567 None admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:04.173869 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3e6ece-2e63-4309-a6b7-2469b807d567 None admin] RBAC: Adding query filter params (name=service) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:04.174196 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3e6ece-2e63-4309-a6b7-2469b807d567 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:04.175552 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3e6ece-2e63-4309-a6b7-2469b807d567 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:04.182087 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ae49b1-45a1-486c-9278-21f07bf5bd44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:04.183557 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ae49b1-45a1-486c-9278-21f07bf5bd44 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:04.184034 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 322/647] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 11 05:17:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:04.184823 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3e6ece-2e63-4309-a6b7-2469b807d567 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:04.282513 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3e6ece-2e63-4309-a6b7-2469b807d567 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:04.283017 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 326/648] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 05:17:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 05:17:04.283916 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ae49b1-45a1-486c-9278-21f07bf5bd44 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:04.316594 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e233a2-6c11-4aba-8400-30bc01c02ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:04.317239 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e233a2-6c11-4aba-8400-30bc01c02ebd None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:04.317515 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e233a2-6c11-4aba-8400-30bc01c02ebd None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:04.317781 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e233a2-6c11-4aba-8400-30bc01c02ebd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:04.326724 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:04.329207 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e233a2-6c11-4aba-8400-30bc01c02ebd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:04.331104 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e233a2-6c11-4aba-8400-30bc01c02ebd None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:04.345595 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-24e233a2-6c11-4aba-8400-30bc01c02ebd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:17:04.345595 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:04.345595 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:04.345595 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:04.345595 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:04.345595 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:04.345595 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:04.345595 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:04.345595 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:04.345595 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:04.345595 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:04.345595 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:04.345595 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 05:17:04.345595 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 05:17:04.345595 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 05:17:04.345595 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 05:17:04.346554 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:04.346554 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:04.346554 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:04.346554 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:04.346554 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:04.346554 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:04.346554 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:04.346554 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:04.346554 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:04.346554 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:04.346554 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:04.346554 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:04.346554 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:04.346554 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:04.346554 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:04.346554 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:04.346554 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 05:17:04.347430 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 05:17:04.347430 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:17:04.347430 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:04.347430 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 323/649] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:17:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:04.348181 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af41429-e1f3-40ab-b707-a12509560d73 None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:04.348388 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af41429-e1f3-40ab-b707-a12509560d73 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:04.348657 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af41429-e1f3-40ab-b707-a12509560d73 None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:04.350504 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 324/650] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:17:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:17:04.352486 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af41429-e1f3-40ab-b707-a12509560d73 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:04.352787 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:04.386098 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ae49b1-45a1-486c-9278-21f07bf5bd44 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:04.419603 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f735618e-0f37-410d-ae80-951ade4e8f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:04.420257 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f735618e-0f37-410d-ae80-951ade4e8f93 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:04.420530 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f735618e-0f37-410d-ae80-951ade4e8f93 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:04.420806 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f735618e-0f37-410d-ae80-951ade4e8f93 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:04.427649 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f735618e-0f37-410d-ae80-951ade4e8f93 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:04.429112 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f735618e-0f37-410d-ae80-951ade4e8f93 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:04.440212 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-f735618e-0f37-410d-ae80-951ade4e8f93 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 11 05:17:04.440212 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:04.440212 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:04.440212 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:04.440212 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:04.440212 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:04.440212 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:04.440212 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:04.440212 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:04.440212 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:04.440212 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:04.440212 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:04.440212 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 05:17:04.440212 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 05:17:04.440212 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 05:17:04.440212 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 05:17:04.441226 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:04.441226 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:04.441226 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 05:17:04.441226 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 05:17:04.441226 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 05:17:04.441226 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 05:17:04.441226 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:04.441226 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:04.441226 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:04.441226 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:04.441226 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:04.441226 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:04.441226 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:04.441226 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:04.441226 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:04.441226 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:04.441226 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:04.441226 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:04.442168 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:04.442168 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:04.442168 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 05:17:04.442168 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 05:17:04.442168 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 05:17:04.442168 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 05:17:04.442168 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 05:17:04.442168 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 05:17:04.442168 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 11 05:17:04.442168 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:17:04.442168 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 327/651] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 11 05:17:04 2022] GET /identity/v3/users/neutron => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:04.442800 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f735618e-0f37-410d-ae80-951ade4e8f93 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:04.457780 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af41429-e1f3-40ab-b707-a12509560d73 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:04.490751 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7510c616-2b4d-40c2-9561-6283157d48fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:04.491366 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7510c616-2b4d-40c2-9561-6283157d48fa None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:04.491932 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7510c616-2b4d-40c2-9561-6283157d48fa None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:04.492205 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7510c616-2b4d-40c2-9561-6283157d48fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:04.502370 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7510c616-2b4d-40c2-9561-6283157d48fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:04.503881 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7510c616-2b4d-40c2-9561-6283157d48fa None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:04.518081 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-7510c616-2b4d-40c2-9561-6283157d48fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:17:04.518081 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:04.518081 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:04.518081 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:04.518081 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:04.518081 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:04.518081 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:04.518081 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:04.518081 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:04.518081 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:04.518081 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:04.518081 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:04.518081 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 05:17:04.518081 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 05:17:04.518081 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 05:17:04.518081 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 05:17:04.519053 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:04.519053 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:04.519053 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:04.519053 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:04.519053 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:04.519053 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:04.519053 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:04.519053 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:04.519053 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:04.519053 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:04.519053 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:04.519053 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:04.519053 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:04.519053 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:04.519053 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:04.519053 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:04.519053 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 05:17:04.520037 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 05:17:04.520037 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:17:04.520037 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:04.520037 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 325/652] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:17:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:04.520262 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7510c616-2b4d-40c2-9561-6283157d48fa None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:04.545182 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f735618e-0f37-410d-ae80-951ade4e8f93 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:04.566363 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:04.569771 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:04.578726 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaec3430-ba6f-4eac-93f7-c6a13bfc09bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:04.579357 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec3430-ba6f-4eac-93f7-c6a13bfc09bd None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:04.579636 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec3430-ba6f-4eac-93f7-c6a13bfc09bd None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:04.579947 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec3430-ba6f-4eac-93f7-c6a13bfc09bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:04.590220 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaec3430-ba6f-4eac-93f7-c6a13bfc09bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:04.591666 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaec3430-ba6f-4eac-93f7-c6a13bfc09bd None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:04.605851 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-eaec3430-ba6f-4eac-93f7-c6a13bfc09bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:17:04.605851 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:04.605851 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:04.605851 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:04.605851 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:04.605851 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:04.605851 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:04.605851 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:04.605851 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:04.605851 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:04.605851 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:04.605851 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:04.605851 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 05:17:04.605851 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 05:17:04.605851 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 05:17:04.605851 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 05:17:04.607074 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:04.607074 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:04.607074 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:04.607074 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:04.607074 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:04.607074 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:04.607074 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:04.607074 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:04.607074 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:04.607074 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:04.607074 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:04.607074 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:04.607074 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:04.607074 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:04.607074 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:04.607074 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:04.607074 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 05:17:04.608219 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 05:17:04.608219 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:17:04.608219 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:17:04.608219 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 328/653] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:17:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:04.608219 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f34c6c-98bc-4d8c-8a7c-9aa340f3e3d5 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:04.608568 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f34c6c-98bc-4d8c-8a7c-9aa340f3e3d5 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:04.608780 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f34c6c-98bc-4d8c-8a7c-9aa340f3e3d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:04.624855 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7510c616-2b4d-40c2-9561-6283157d48fa None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:04.625993 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-84f34c6c-98bc-4d8c-8a7c-9aa340f3e3d5 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:17:04.627174 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-84f34c6c-98bc-4d8c-8a7c-9aa340f3e3d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:17:04.658933 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d76e05b-a7cf-4513-9e78-2660cd987223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:04.659537 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d76e05b-a7cf-4513-9e78-2660cd987223 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:04.659848 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d76e05b-a7cf-4513-9e78-2660cd987223 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:04.660127 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d76e05b-a7cf-4513-9e78-2660cd987223 None admin] PATH_INFO: `/v3/domains` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:04.660768 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d76e05b-a7cf-4513-9e78-2660cd987223 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:04.661071 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d76e05b-a7cf-4513-9e78-2660cd987223 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:04.662985 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d76e05b-a7cf-4513-9e78-2660cd987223 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:04.675153 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 326/654] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 05:17:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:04.676047 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d76e05b-a7cf-4513-9e78-2660cd987223 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:04.693319 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 329/655] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:17:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 05:17:04.694153 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f34c6c-98bc-4d8c-8a7c-9aa340f3e3d5 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:04.798176 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f34c6c-98bc-4d8c-8a7c-9aa340f3e3d5 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:04.798869 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d76e05b-a7cf-4513-9e78-2660cd987223 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:04.801964 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:04.807961 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:04.831867 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e27fd89-2b65-4d4b-bf90-7c21622071d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:04.832477 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e27fd89-2b65-4d4b-bf90-7c21622071d0 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:04.832750 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e27fd89-2b65-4d4b-bf90-7c21622071d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:04.833022 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e27fd89-2b65-4d4b-bf90-7c21622071d0 None admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:04.834176 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e27fd89-2b65-4d4b-bf90-7c21622071d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:04.834478 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e27fd89-2b65-4d4b-bf90-7c21622071d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:04.835892 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e27fd89-2b65-4d4b-bf90-7c21622071d0 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:04.839723 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a303b17-5faf-40f4-bd73-4eee3d21ede0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:04.840561 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a303b17-5faf-40f4-bd73-4eee3d21ede0 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:04.841023 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a303b17-5faf-40f4-bd73-4eee3d21ede0 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:04.841489 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a303b17-5faf-40f4-bd73-4eee3d21ede0 None admin] PATH_INFO: `/v3/users` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:04.842526 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a303b17-5faf-40f4-bd73-4eee3d21ede0 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:04.843155 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a303b17-5faf-40f4-bd73-4eee3d21ede0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:04.845039 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a303b17-5faf-40f4-bd73-4eee3d21ede0 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:04.846681 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 330/656] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 05:17:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:04.847463 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e27fd89-2b65-4d4b-bf90-7c21622071d0 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:04.869100 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 327/657] 10.222.0.16 () {56 vars in 1139 bytes} [Sun Sep 11 05:17:04 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:04.870527 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a303b17-5faf-40f4-bd73-4eee3d21ede0 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:04.961140 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e27fd89-2b65-4d4b-bf90-7c21622071d0 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:04.976683 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a303b17-5faf-40f4-bd73-4eee3d21ede0 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:04.994897 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82231d9b-ebab-44e3-9332-281ea9b5b08c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:04.995507 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82231d9b-ebab-44e3-9332-281ea9b5b08c None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:04.995825 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82231d9b-ebab-44e3-9332-281ea9b5b08c None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:04.996103 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82231d9b-ebab-44e3-9332-281ea9b5b08c None admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:04.996748 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82231d9b-ebab-44e3-9332-281ea9b5b08c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:04.997057 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82231d9b-ebab-44e3-9332-281ea9b5b08c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:04.998437 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82231d9b-ebab-44e3-9332-281ea9b5b08c None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:05.010573 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2b5b4d-4015-4839-afe8-d695aac9b627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:05.010930 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 331/658] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 05:17:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:05.011205 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2b5b4d-4015-4839-afe8-d695aac9b627 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:05.011485 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2b5b4d-4015-4839-afe8-d695aac9b627 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:05.011748 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82231d9b-ebab-44e3-9332-281ea9b5b08c None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:05.011846 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2b5b4d-4015-4839-afe8-d695aac9b627 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:05.020528 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2b5b4d-4015-4839-afe8-d695aac9b627 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:05.021995 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2b5b4d-4015-4839-afe8-d695aac9b627 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:05.032887 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-1d2b5b4d-4015-4839-afe8-d695aac9b627 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 05:17:05.032887 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:05.032887 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:05.032887 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:05.032887 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:05.032887 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:05.032887 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:05.032887 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:05.032887 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:05.032887 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:05.032887 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:05.032887 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:05.032887 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 05:17:05.032887 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 05:17:05.032887 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 05:17:05.033982 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 05:17:05.033982 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:05.033982 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:05.033982 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:05.033982 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:05.033982 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:05.033982 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:05.033982 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:05.033982 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:05.033982 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:05.033982 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:05.033982 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:05.033982 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:05.033982 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:05.033982 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:05.033982 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:05.033982 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:05.035130 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 05:17:05.035130 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 05:17:05.035130 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 05:17:05.035130 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 05:17:05.035130 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 05:17:05.035130 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 05:17:05.035130 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 05:17:05.035130 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:05.035130 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 328/659] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 05:17:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:05.035130 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2b5b4d-4015-4839-afe8-d695aac9b627 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:05.044283 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:05.059946 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:05.118656 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82231d9b-ebab-44e3-9332-281ea9b5b08c None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:05.134681 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2b5b4d-4015-4839-afe8-d695aac9b627 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:05.151587 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f158fa-e572-4296-ba88-52ab02f72962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:05.152265 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f158fa-e572-4296-ba88-52ab02f72962 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:05.152544 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f158fa-e572-4296-ba88-52ab02f72962 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:05.152816 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f158fa-e572-4296-ba88-52ab02f72962 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:05.160489 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f158fa-e572-4296-ba88-52ab02f72962 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:05.162476 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f158fa-e572-4296-ba88-52ab02f72962 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:05.167805 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c649f0b-d5b8-45c7-b80c-7a6e78f1cf23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:05.168399 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c649f0b-d5b8-45c7-b80c-7a6e78f1cf23 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:05.168675 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c649f0b-d5b8-45c7-b80c-7a6e78f1cf23 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:05.168942 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c649f0b-d5b8-45c7-b80c-7a6e78f1cf23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:05.173803 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-d1f158fa-e572-4296-ba88-52ab02f72962 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 11 05:17:05.173803 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:05.173803 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:05.173803 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:05.173803 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:05.173803 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:05.173803 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:05.173803 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:05.173803 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:05.173803 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:05.173803 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:05.173803 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:05.173803 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 05:17:05.173803 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 05:17:05.173803 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 05:17:05.173803 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 05:17:05.174939 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:05.174939 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:05.174939 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 05:17:05.174939 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 05:17:05.174939 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 05:17:05.174939 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 05:17:05.174939 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:05.174939 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:05.174939 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:05.174939 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:05.174939 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:05.174939 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:05.174939 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:05.174939 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:05.174939 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:05.174939 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:05.174939 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:05.174939 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:05.176305 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:05.176305 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:05.176305 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 05:17:05.176305 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 05:17:05.176305 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 05:17:05.176305 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 05:17:05.176305 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 05:17:05.176305 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 05:17:05.176305 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 11 05:17:05.176305 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:17:05.176305 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 332/660] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 05:17:05 2022] GET /identity/v3/users/cinder => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:05.176305 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f158fa-e572-4296-ba88-52ab02f72962 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:05.239419 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c649f0b-d5b8-45c7-b80c-7a6e78f1cf23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:05.240896 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c649f0b-d5b8-45c7-b80c-7a6e78f1cf23 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:05.262847 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:05.268038 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:05.276247 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f158fa-e572-4296-ba88-52ab02f72962 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:05.313669 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5832f278-948a-4d95-9754-403be6f01bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:05.314307 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5832f278-948a-4d95-9754-403be6f01bdd None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:05.314576 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5832f278-948a-4d95-9754-403be6f01bdd None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:05.314907 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5832f278-948a-4d95-9754-403be6f01bdd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:05.325409 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5832f278-948a-4d95-9754-403be6f01bdd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:17:05.330589 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-5832f278-948a-4d95-9754-403be6f01bdd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 05:17:05.330589 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:05.330589 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:05.330589 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:05.330589 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:05.330589 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:05.330589 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:05.330589 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:05.330589 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:05.330589 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:05.330589 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:05.330589 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:05.330589 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:17:05.330589 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:17:05.330589 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:17:05.330589 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:17:05.331758 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:17:05.331758 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:17:05.331758 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:17:05.331758 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:17:05.331758 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:05.331758 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:05.331758 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:05.331758 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:05.331758 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:05.331758 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:05.331758 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:05.331758 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:05.331758 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:05.331758 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:05.331758 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:05.331758 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:05.332623 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:05.332623 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:05.332623 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:05.332623 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:05.332623 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:17:05.332623 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:17:05.332623 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:17:05.332623 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:17:05.332623 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:17:05.332623 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:17:05.332623 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 05:17:05.332623 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:17:05.332623 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 333/661] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 11 05:17:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:05.333417 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5832f278-948a-4d95-9754-403be6f01bdd None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:05.347391 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 329/662] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 05:17:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 05:17:05.348261 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c649f0b-d5b8-45c7-b80c-7a6e78f1cf23 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:05.438548 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5832f278-948a-4d95-9754-403be6f01bdd None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:05.446598 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c649f0b-d5b8-45c7-b80c-7a6e78f1cf23 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:05.468675 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:05.471060 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deecafec-4e00-4e73-a3b5-569b71f1ac7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:05.471699 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deecafec-4e00-4e73-a3b5-569b71f1ac7c None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:05.471982 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deecafec-4e00-4e73-a3b5-569b71f1ac7c None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:05.472249 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deecafec-4e00-4e73-a3b5-569b71f1ac7c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:05.479202 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deecafec-4e00-4e73-a3b5-569b71f1ac7c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:05.480691 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deecafec-4e00-4e73-a3b5-569b71f1ac7c None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:05.481167 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179dcf66-bf33-4802-8e6b-c87da56544e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:05.481765 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179dcf66-bf33-4802-8e6b-c87da56544e2 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:05.482043 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179dcf66-bf33-4802-8e6b-c87da56544e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:05.482315 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179dcf66-bf33-4802-8e6b-c87da56544e2 None admin] PATH_INFO: `/v3/projects` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:05.483003 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179dcf66-bf33-4802-8e6b-c87da56544e2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:05.483306 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179dcf66-bf33-4802-8e6b-c87da56544e2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:05.484769 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179dcf66-bf33-4802-8e6b-c87da56544e2 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:05.491973 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-deecafec-4e00-4e73-a3b5-569b71f1ac7c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 05:17:05.491973 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:05.491973 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:05.491973 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:05.491973 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:05.491973 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:05.491973 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:05.491973 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:05.491973 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:05.491973 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:05.491973 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:05.491973 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:05.491973 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 05:17:05.491973 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 05:17:05.491973 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 05:17:05.492817 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 05:17:05.492817 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:05.492817 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:05.492817 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:05.492817 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:05.492817 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:05.492817 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:05.492817 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:05.492817 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:05.492817 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:05.492817 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:05.492817 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:05.492817 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:05.492817 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:05.492817 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:05.492817 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:05.492817 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:05.493711 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 05:17:05.493711 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 05:17:05.493711 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 05:17:05.493711 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 05:17:05.493711 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 05:17:05.493711 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 05:17:05.493711 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 05:17:05.493711 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:17:05.495809 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 334/663] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 05:17:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:05.496782 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deecafec-4e00-4e73-a3b5-569b71f1ac7c None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:05.496892 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 330/664] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 05:17:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:05.497824 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179dcf66-bf33-4802-8e6b-c87da56544e2 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:05.508061 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:05.600980 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deecafec-4e00-4e73-a3b5-569b71f1ac7c None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:05.607508 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179dcf66-bf33-4802-8e6b-c87da56544e2 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:05.640162 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6a3ffe-6411-45fe-a7ad-3aa965fdad50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:05.640914 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a3ffe-6411-45fe-a7ad-3aa965fdad50 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:05.641206 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a3ffe-6411-45fe-a7ad-3aa965fdad50 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:05.641482 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a3ffe-6411-45fe-a7ad-3aa965fdad50 None admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:05.642236 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6a3ffe-6411-45fe-a7ad-3aa965fdad50 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:05.642544 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6a3ffe-6411-45fe-a7ad-3aa965fdad50 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:05.644100 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6a3ffe-6411-45fe-a7ad-3aa965fdad50 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:05.646864 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562c1306-02db-447e-9e6d-3de620427f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:05.647470 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c1306-02db-447e-9e6d-3de620427f85 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:05.647770 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c1306-02db-447e-9e6d-3de620427f85 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:05.648041 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c1306-02db-447e-9e6d-3de620427f85 None admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:05.648720 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562c1306-02db-447e-9e6d-3de620427f85 None admin] RBAC: Adding query filter params (name=service) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:05.649022 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562c1306-02db-447e-9e6d-3de620427f85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:05.650363 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562c1306-02db-447e-9e6d-3de620427f85 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:05.663725 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 331/665] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 11 05:17:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:05.663725 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562c1306-02db-447e-9e6d-3de620427f85 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:05.663960 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 335/666] 10.222.0.16 () {56 vars in 1137 bytes} [Sun Sep 11 05:17:05 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:05.663960 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6a3ffe-6411-45fe-a7ad-3aa965fdad50 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:05.719071 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:05.740910 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:05.779361 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6a3ffe-6411-45fe-a7ad-3aa965fdad50 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:05.781083 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562c1306-02db-447e-9e6d-3de620427f85 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:05.818731 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ee6bf9-85bf-4c26-9ef6-640875e4426e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:05.819374 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ee6bf9-85bf-4c26-9ef6-640875e4426e None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:05.819656 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ee6bf9-85bf-4c26-9ef6-640875e4426e None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:05.819959 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ee6bf9-85bf-4c26-9ef6-640875e4426e None admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:05.820653 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ee6bf9-85bf-4c26-9ef6-640875e4426e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:05.820967 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ee6bf9-85bf-4c26-9ef6-640875e4426e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:05.821456 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cd4f32-d7b5-411b-b07e-c9b32c065930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:05.822143 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd4f32-d7b5-411b-b07e-c9b32c065930 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:05.822428 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd4f32-d7b5-411b-b07e-c9b32c065930 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:05.822520 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ee6bf9-85bf-4c26-9ef6-640875e4426e None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:05.822701 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd4f32-d7b5-411b-b07e-c9b32c065930 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:05.839446 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 336/667] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 05:17:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:05.839623 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cd4f32-d7b5-411b-b07e-c9b32c065930 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:05.839759 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ee6bf9-85bf-4c26-9ef6-640875e4426e None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:05.839864 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cd4f32-d7b5-411b-b07e-c9b32c065930 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:05.857469 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-36cd4f32-d7b5-411b-b07e-c9b32c065930 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:17:05.857469 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:05.857469 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:05.857469 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:05.857469 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:05.857469 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:05.857469 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:05.857469 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:05.857469 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:05.857469 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:05.857469 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:05.857469 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:05.857469 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 05:17:05.857469 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 05:17:05.857469 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 05:17:05.857469 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 05:17:05.858656 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:05.858656 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:05.858656 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:05.858656 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:05.858656 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:05.858656 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:05.858656 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:05.858656 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:05.858656 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:05.858656 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:05.858656 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:05.858656 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:05.858656 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:05.858656 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:05.858656 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:05.858656 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:05.858656 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 05:17:05.859541 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 05:17:05.859541 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:17:05.859541 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:05.859541 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 332/668] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:17:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:05.859799 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cd4f32-d7b5-411b-b07e-c9b32c065930 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:05.946627 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ee6bf9-85bf-4c26-9ef6-640875e4426e None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:05.956350 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:05.962255 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cd4f32-d7b5-411b-b07e-c9b32c065930 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:05.971100 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:05.980687 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b90e67e-679e-42b5-a1e4-f32ec15e10bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:05.981285 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b90e67e-679e-42b5-a1e4-f32ec15e10bc None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:05.981558 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b90e67e-679e-42b5-a1e4-f32ec15e10bc None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:05.981823 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b90e67e-679e-42b5-a1e4-f32ec15e10bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:05.982533 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b90e67e-679e-42b5-a1e4-f32ec15e10bc None admin] RBAC: Adding query filter params (role.id=82bd224e8afc480782a85b833a2aa03e, scope.project.id=61ffb079d9e1437084945554bcc0747b, user.id=6cd6136036bd467c946cae90d5c29263) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:05.982841 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b90e67e-679e-42b5-a1e4-f32ec15e10bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:05.984303 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b90e67e-679e-42b5-a1e4-f32ec15e10bc None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:05.990493 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 337/669] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 05:17:05 2022] GET /identity/v3/role_assignments?user.id=6cd6136036bd467c946cae90d5c29263&scope.project.id=61ffb079d9e1437084945554bcc0747b&role.id=82bd224e8afc480782a85b833a2aa03e => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:05.991268 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b90e67e-679e-42b5-a1e4-f32ec15e10bc None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:06.007407 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32cb0e8-42f1-42c5-aa88-f709cf7ee9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:06.008239 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32cb0e8-42f1-42c5-aa88-f709cf7ee9b7 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:06.008518 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32cb0e8-42f1-42c5-aa88-f709cf7ee9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:06.008788 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32cb0e8-42f1-42c5-aa88-f709cf7ee9b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:06.021915 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32cb0e8-42f1-42c5-aa88-f709cf7ee9b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:06.023457 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32cb0e8-42f1-42c5-aa88-f709cf7ee9b7 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:06.042626 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-b32cb0e8-42f1-42c5-aa88-f709cf7ee9b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:17:06.042626 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:06.042626 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:06.042626 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:06.042626 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:06.042626 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:06.042626 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:06.042626 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:06.042626 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:06.042626 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:06.042626 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:06.042626 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:06.042626 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 05:17:06.042626 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 05:17:06.042626 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 05:17:06.042626 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 05:17:06.043638 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:06.043638 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:06.043638 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:06.043638 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:06.043638 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:06.043638 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:06.043638 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:06.043638 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:06.043638 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:06.043638 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:06.043638 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:06.043638 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:06.043638 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:06.043638 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:06.043638 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:06.043638 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:06.043638 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 05:17:06.044548 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 05:17:06.044548 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:17:06.044548 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:06.044548 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 333/670] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:17:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:06.045307 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32cb0e8-42f1-42c5-aa88-f709cf7ee9b7 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:06.105248 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b90e67e-679e-42b5-a1e4-f32ec15e10bc None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:06.144875 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1d2e26-6d55-4e68-9eb7-b6d496c22aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:06.145499 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d2e26-6d55-4e68-9eb7-b6d496c22aa1 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:06.145776 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d2e26-6d55-4e68-9eb7-b6d496c22aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:06.146083 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d2e26-6d55-4e68-9eb7-b6d496c22aa1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:06.159553 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32cb0e8-42f1-42c5-aa88-f709cf7ee9b7 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:06.201172 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1732a9-45a5-47c7-b50c-2f65872ebbc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:06.201787 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1732a9-45a5-47c7-b50c-2f65872ebbc3 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:06.202067 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1732a9-45a5-47c7-b50c-2f65872ebbc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:06.202513 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1732a9-45a5-47c7-b50c-2f65872ebbc3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:06.203622 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1732a9-45a5-47c7-b50c-2f65872ebbc3 None admin] RBAC: Adding query filter params (role.id=82bd224e8afc480782a85b833a2aa03e, scope.project.id=61ffb079d9e1437084945554bcc0747b, user.id=bdd09106382447e9bf8b3a6a9ada89b0) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:06.203987 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1732a9-45a5-47c7-b50c-2f65872ebbc3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:06.205727 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1732a9-45a5-47c7-b50c-2f65872ebbc3 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:06.212715 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 334/671] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 05:17:06 2022] GET /identity/v3/role_assignments?user.id=bdd09106382447e9bf8b3a6a9ada89b0&scope.project.id=61ffb079d9e1437084945554bcc0747b&role.id=82bd224e8afc480782a85b833a2aa03e => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:06.213524 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1732a9-45a5-47c7-b50c-2f65872ebbc3 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:06.218918 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:06.238886 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1d2e26-6d55-4e68-9eb7-b6d496c22aa1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:06.240685 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:06.242740 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1d2e26-6d55-4e68-9eb7-b6d496c22aa1 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:06.360747 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1732a9-45a5-47c7-b50c-2f65872ebbc3 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:06.371235 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 338/672] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 05:17:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 05:17:06.372497 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1d2e26-6d55-4e68-9eb7-b6d496c22aa1 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:06.405774 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4df77fa-22fd-43ed-af5d-e6fdb64b26fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:06.407041 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df77fa-22fd-43ed-af5d-e6fdb64b26fc None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:06.407041 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df77fa-22fd-43ed-af5d-e6fdb64b26fc None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:06.407041 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df77fa-22fd-43ed-af5d-e6fdb64b26fc None admin] PATH_INFO: `/v3/domains` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:06.407666 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4df77fa-22fd-43ed-af5d-e6fdb64b26fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:06.407985 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4df77fa-22fd-43ed-af5d-e6fdb64b26fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:06.409368 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4df77fa-22fd-43ed-af5d-e6fdb64b26fc None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:06.428087 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 335/673] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 05:17:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:06.429422 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4df77fa-22fd-43ed-af5d-e6fdb64b26fc None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:06.488450 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:06.504295 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1d2e26-6d55-4e68-9eb7-b6d496c22aa1 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:06.516976 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:06.546597 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe77dbe-4c23-473e-8f4d-078fb10d1fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:06.547458 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe77dbe-4c23-473e-8f4d-078fb10d1fe3 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:06.547756 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe77dbe-4c23-473e-8f4d-078fb10d1fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:06.548030 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe77dbe-4c23-473e-8f4d-078fb10d1fe3 None admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:06.548718 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4df77fa-22fd-43ed-af5d-e6fdb64b26fc None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:06.548846 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe77dbe-4c23-473e-8f4d-078fb10d1fe3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:06.549027 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe77dbe-4c23-473e-8f4d-078fb10d1fe3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:06.550637 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe77dbe-4c23-473e-8f4d-078fb10d1fe3 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:06.565735 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 339/674] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 05:17:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:06.566890 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe77dbe-4c23-473e-8f4d-078fb10d1fe3 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:06.587279 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d97e5e3-a2a5-488c-9106-f0e63068b598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:06.587999 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d97e5e3-a2a5-488c-9106-f0e63068b598 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:06.588278 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d97e5e3-a2a5-488c-9106-f0e63068b598 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:06.588547 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d97e5e3-a2a5-488c-9106-f0e63068b598 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:06.599095 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d97e5e3-a2a5-488c-9106-f0e63068b598 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:06.601096 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d97e5e3-a2a5-488c-9106-f0e63068b598 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:06.616340 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-9d97e5e3-a2a5-488c-9106-f0e63068b598 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:17:06.616340 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:06.616340 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:06.616340 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:06.616340 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:06.616340 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:06.616340 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:06.616340 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:06.616340 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:06.616340 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:06.616340 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:06.616340 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:06.616340 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 05:17:06.616340 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 05:17:06.616340 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 05:17:06.616340 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 05:17:06.617573 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:06.617573 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:06.617573 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:06.617573 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:06.617573 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:06.617573 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:06.617573 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:06.617573 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:06.617573 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:06.617573 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:06.617573 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:06.617573 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:06.617573 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:06.617573 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:06.617573 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:06.617573 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:06.617573 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 05:17:06.618499 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 05:17:06.618499 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:17:06.618499 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:06.618499 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 336/675] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:17:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:06.618741 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d97e5e3-a2a5-488c-9106-f0e63068b598 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:06.689467 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe77dbe-4c23-473e-8f4d-078fb10d1fe3 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:06.725740 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eb036b-1991-43ca-a793-9f138029b1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:06.726374 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb036b-1991-43ca-a793-9f138029b1a5 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:06.726684 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb036b-1991-43ca-a793-9f138029b1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:06.726965 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb036b-1991-43ca-a793-9f138029b1a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:06.728599 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d97e5e3-a2a5-488c-9106-f0e63068b598 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:06.734118 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eb036b-1991-43ca-a793-9f138029b1a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:06.735638 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eb036b-1991-43ca-a793-9f138029b1a5 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:06.749404 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-b6eb036b-1991-43ca-a793-9f138029b1a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 05:17:06.749404 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:06.749404 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:06.749404 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:06.749404 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:06.749404 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:06.749404 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:06.749404 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:06.749404 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:06.749404 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:06.749404 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:06.749404 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:06.749404 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 05:17:06.749404 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 05:17:06.749404 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 05:17:06.750379 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 05:17:06.750379 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:06.750379 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:06.750379 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:06.750379 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:06.750379 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:06.750379 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:06.750379 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:06.750379 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:06.750379 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:06.750379 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:06.750379 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:06.750379 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:06.750379 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:06.750379 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:06.750379 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:06.750379 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:06.751278 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 05:17:06.751278 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 05:17:06.751278 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 05:17:06.751278 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 05:17:06.751278 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 05:17:06.751278 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 05:17:06.751278 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 05:17:06.751278 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:17:06.755530 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 340/676] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 05:17:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:06.756466 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eb036b-1991-43ca-a793-9f138029b1a5 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:06.758153 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:06.769759 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb13521e-c8e7-4529-bb00-bbc8dc2582d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:06.770546 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13521e-c8e7-4529-bb00-bbc8dc2582d9 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:06.771248 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13521e-c8e7-4529-bb00-bbc8dc2582d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:06.771248 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13521e-c8e7-4529-bb00-bbc8dc2582d9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:06.777952 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:06.779999 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb13521e-c8e7-4529-bb00-bbc8dc2582d9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:06.781649 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb13521e-c8e7-4529-bb00-bbc8dc2582d9 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:06.796541 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-fb13521e-c8e7-4529-bb00-bbc8dc2582d9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 11 05:17:06.796541 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:06.796541 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:06.796541 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:06.796541 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:06.796541 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:06.796541 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:06.796541 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:06.796541 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:06.796541 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:06.796541 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:06.796541 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:06.796541 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 05:17:06.796541 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 05:17:06.796541 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 05:17:06.796541 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 05:17:06.797570 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:06.797570 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:06.797570 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 05:17:06.797570 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 05:17:06.797570 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 05:17:06.797570 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 05:17:06.797570 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:06.797570 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:06.797570 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:06.797570 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:06.797570 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:06.797570 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:06.797570 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:06.797570 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:06.797570 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:06.797570 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:06.797570 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:06.797570 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:06.798509 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:06.798509 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:06.798509 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 05:17:06.798509 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 05:17:06.798509 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 05:17:06.798509 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 05:17:06.798509 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 05:17:06.798509 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 05:17:06.798509 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 11 05:17:06.798509 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:06.802901 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 337/677] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 05:17:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:06.804530 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb13521e-c8e7-4529-bb00-bbc8dc2582d9 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:06.882002 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eb036b-1991-43ca-a793-9f138029b1a5 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:06.915061 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb13521e-c8e7-4529-bb00-bbc8dc2582d9 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:06.927861 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9137ed0-fa86-4bfd-b224-ece98864c836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:06.928492 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9137ed0-fa86-4bfd-b224-ece98864c836 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:06.928769 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9137ed0-fa86-4bfd-b224-ece98864c836 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:06.929035 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9137ed0-fa86-4bfd-b224-ece98864c836 None admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:06.929677 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9137ed0-fa86-4bfd-b224-ece98864c836 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:06.929977 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9137ed0-fa86-4bfd-b224-ece98864c836 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:06.931352 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9137ed0-fa86-4bfd-b224-ece98864c836 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:06.948008 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 341/678] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 05:17:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:06.948912 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9137ed0-fa86-4bfd-b224-ece98864c836 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:06.964697 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff36116-336e-4552-a426-3316b5fb75a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:06.966100 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff36116-336e-4552-a426-3316b5fb75a8 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:06.966674 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff36116-336e-4552-a426-3316b5fb75a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:06.967154 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff36116-336e-4552-a426-3316b5fb75a8 None admin] PATH_INFO: `/v3/projects` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:06.968089 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff36116-336e-4552-a426-3316b5fb75a8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:06.968591 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff36116-336e-4552-a426-3316b5fb75a8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:06.970539 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff36116-336e-4552-a426-3316b5fb75a8 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:06.987661 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 338/679] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 05:17:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:06.988904 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff36116-336e-4552-a426-3316b5fb75a8 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:07.029916 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:07.049325 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:07.063450 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9137ed0-fa86-4bfd-b224-ece98864c836 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:07.099946 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fede54c4-460e-42cd-9a88-4103a4ad2921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:07.100560 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede54c4-460e-42cd-9a88-4103a4ad2921 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:07.100838 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede54c4-460e-42cd-9a88-4103a4ad2921 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:07.101114 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede54c4-460e-42cd-9a88-4103a4ad2921 None admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:07.101955 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fede54c4-460e-42cd-9a88-4103a4ad2921 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:07.102207 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fede54c4-460e-42cd-9a88-4103a4ad2921 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:07.103784 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fede54c4-460e-42cd-9a88-4103a4ad2921 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:07.114497 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff36116-336e-4552-a426-3316b5fb75a8 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:07.124300 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 342/680] 10.222.0.16 () {56 vars in 1135 bytes} [Sun Sep 11 05:17:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:07.125093 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fede54c4-460e-42cd-9a88-4103a4ad2921 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:07.155541 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02f854e-27a7-4dad-af2c-83ae8b527936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:07.156650 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02f854e-27a7-4dad-af2c-83ae8b527936 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:07.157380 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02f854e-27a7-4dad-af2c-83ae8b527936 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:07.157999 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02f854e-27a7-4dad-af2c-83ae8b527936 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:07.166141 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02f854e-27a7-4dad-af2c-83ae8b527936 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:07.167949 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02f854e-27a7-4dad-af2c-83ae8b527936 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:07.181362 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-a02f854e-27a7-4dad-af2c-83ae8b527936 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 05:17:07.181362 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:07.181362 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:07.181362 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:07.181362 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:07.181362 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:07.181362 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:07.181362 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:07.181362 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:07.181362 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:07.181362 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:07.181362 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:07.181362 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 05:17:07.181362 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 05:17:07.181362 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 05:17:07.182253 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 05:17:07.182253 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:07.182253 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:07.182253 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:07.182253 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:07.182253 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:07.182253 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:07.182253 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:07.182253 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:07.182253 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:07.182253 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:07.182253 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:07.182253 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:07.182253 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:07.182253 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:07.182253 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:07.182253 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:07.183224 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 05:17:07.183224 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 05:17:07.183224 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 05:17:07.183224 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 05:17:07.183224 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 05:17:07.183224 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 05:17:07.183224 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 05:17:07.183224 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:07.185728 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 339/681] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 05:17:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:07.187387 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02f854e-27a7-4dad-af2c-83ae8b527936 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:07.240531 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fede54c4-460e-42cd-9a88-4103a4ad2921 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:07.270296 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:07.281525 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c66985-1b57-4c22-95b2-33564ec4ae32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:07.282418 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c66985-1b57-4c22-95b2-33564ec4ae32 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:07.282902 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c66985-1b57-4c22-95b2-33564ec4ae32 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:07.283349 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c66985-1b57-4c22-95b2-33564ec4ae32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:07.284844 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c66985-1b57-4c22-95b2-33564ec4ae32 None admin] RBAC: Adding query filter params (role.id=82bd224e8afc480782a85b833a2aa03e, scope.project.id=61ffb079d9e1437084945554bcc0747b, user.id=72086abb4e0547dc96d76a44886805ff) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:07.285361 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c66985-1b57-4c22-95b2-33564ec4ae32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:07.287656 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c66985-1b57-4c22-95b2-33564ec4ae32 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:07.296895 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 343/682] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 05:17:07 2022] GET /identity/v3/role_assignments?user.id=72086abb4e0547dc96d76a44886805ff&scope.project.id=61ffb079d9e1437084945554bcc0747b&role.id=82bd224e8afc480782a85b833a2aa03e => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:07.298072 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c66985-1b57-4c22-95b2-33564ec4ae32 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:07.332962 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02f854e-27a7-4dad-af2c-83ae8b527936 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:07.348080 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:07.390794 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc659253-4a64-49b3-b2a7-5cb3b77e838f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:07.394056 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc659253-4a64-49b3-b2a7-5cb3b77e838f None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:07.394194 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc659253-4a64-49b3-b2a7-5cb3b77e838f None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:07.394461 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc659253-4a64-49b3-b2a7-5cb3b77e838f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:07.506983 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c66985-1b57-4c22-95b2-33564ec4ae32 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:07.533674 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc659253-4a64-49b3-b2a7-5cb3b77e838f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:07.536012 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc659253-4a64-49b3-b2a7-5cb3b77e838f None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:07.550787 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ba7702-6766-48ba-9851-8c0344aad761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:07.551716 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba7702-6766-48ba-9851-8c0344aad761 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:07.551830 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba7702-6766-48ba-9851-8c0344aad761 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:07.552072 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba7702-6766-48ba-9851-8c0344aad761 None admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:07.552871 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ba7702-6766-48ba-9851-8c0344aad761 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:07.553262 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ba7702-6766-48ba-9851-8c0344aad761 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:07.554606 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ba7702-6766-48ba-9851-8c0344aad761 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:07.568813 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 344/683] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 05:17:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:07.574538 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ba7702-6766-48ba-9851-8c0344aad761 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:07.644228 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:07.660917 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 340/684] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 05:17:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 05:17:07.667725 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc659253-4a64-49b3-b2a7-5cb3b77e838f None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:07.679601 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:07.713883 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ba7702-6766-48ba-9851-8c0344aad761 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:07.759728 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974fb92d-ce78-476a-8582-33e09d1acdb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:07.760679 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974fb92d-ce78-476a-8582-33e09d1acdb4 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:07.761664 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974fb92d-ce78-476a-8582-33e09d1acdb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:07.762140 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974fb92d-ce78-476a-8582-33e09d1acdb4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:07.763072 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974fb92d-ce78-476a-8582-33e09d1acdb4 None admin] RBAC: Adding query filter params (role.id=82bd224e8afc480782a85b833a2aa03e, scope.project.id=61ffb079d9e1437084945554bcc0747b, user.id=5a147e14b61d481db1cac02c58ac3500) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:07.763985 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974fb92d-ce78-476a-8582-33e09d1acdb4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:07.765677 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974fb92d-ce78-476a-8582-33e09d1acdb4 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:07.775075 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 345/685] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 05:17:07 2022] GET /identity/v3/role_assignments?user.id=5a147e14b61d481db1cac02c58ac3500&scope.project.id=61ffb079d9e1437084945554bcc0747b&role.id=82bd224e8afc480782a85b833a2aa03e => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:17:07.797631 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc659253-4a64-49b3-b2a7-5cb3b77e838f None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:07.841349 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0576a0-e88f-4b5f-9d9b-1b30ebd83e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:07.842016 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0576a0-e88f-4b5f-9d9b-1b30ebd83e63 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:07.842295 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0576a0-e88f-4b5f-9d9b-1b30ebd83e63 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:07.842565 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0576a0-e88f-4b5f-9d9b-1b30ebd83e63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:07.854476 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0576a0-e88f-4b5f-9d9b-1b30ebd83e63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:07.855984 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0576a0-e88f-4b5f-9d9b-1b30ebd83e63 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:07.872554 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-2e0576a0-e88f-4b5f-9d9b-1b30ebd83e63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:17:07.872554 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:07.872554 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:07.872554 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:07.872554 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:07.872554 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:07.872554 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:07.872554 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:07.872554 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:07.872554 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:07.872554 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:07.872554 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:07.872554 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 05:17:07.872554 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 05:17:07.872554 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 05:17:07.872554 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 05:17:07.873545 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:07.873545 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:07.873545 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:07.873545 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:07.873545 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:07.873545 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:07.873545 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:07.873545 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:07.873545 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:07.873545 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:07.873545 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:07.873545 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:07.873545 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:07.873545 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:07.873545 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:07.873545 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:07.873545 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 05:17:07.874429 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 05:17:07.874429 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:17:07.874429 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:07.874429 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 341/686] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:17:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:07.881528 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974fb92d-ce78-476a-8582-33e09d1acdb4 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:07.994963 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974fb92d-ce78-476a-8582-33e09d1acdb4 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:08.013448 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:08.034956 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb84a57-ff1a-4ad9-abd4-3762dd6d7aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:08.036012 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb84a57-ff1a-4ad9-abd4-3762dd6d7aac None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:08.036545 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb84a57-ff1a-4ad9-abd4-3762dd6d7aac None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:08.037581 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb84a57-ff1a-4ad9-abd4-3762dd6d7aac None admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:08.038472 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb84a57-ff1a-4ad9-abd4-3762dd6d7aac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:08.038978 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb84a57-ff1a-4ad9-abd4-3762dd6d7aac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:08.040735 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb84a57-ff1a-4ad9-abd4-3762dd6d7aac None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:08.054642 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 346/687] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 05:17:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:08.059871 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0576a0-e88f-4b5f-9d9b-1b30ebd83e63 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:08.132669 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:08.185100 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0576a0-e88f-4b5f-9d9b-1b30ebd83e63 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:08.229205 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8a08ab-db91-4ef8-8a40-8af66250e18e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:08.229849 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a08ab-db91-4ef8-8a40-8af66250e18e None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:08.230124 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a08ab-db91-4ef8-8a40-8af66250e18e None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:08.230391 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a08ab-db91-4ef8-8a40-8af66250e18e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:08.239149 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8a08ab-db91-4ef8-8a40-8af66250e18e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:08.240702 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8a08ab-db91-4ef8-8a40-8af66250e18e None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:08.254812 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-8d8a08ab-db91-4ef8-8a40-8af66250e18e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 05:17:08.254812 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:08.254812 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:08.254812 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:08.254812 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:08.254812 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:08.254812 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:08.254812 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:08.254812 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:08.254812 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:08.254812 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:08.254812 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:08.254812 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 05:17:08.254812 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 05:17:08.254812 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 05:17:08.256473 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 05:17:08.256473 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:08.256473 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:08.256473 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:08.256473 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:08.256473 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:08.256473 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:08.256473 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:08.256473 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:08.256473 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:08.256473 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:08.256473 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:08.256473 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:08.256473 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:08.256473 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:08.256473 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:08.256473 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:08.257353 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 05:17:08.257353 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 05:17:08.257353 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 05:17:08.257353 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 05:17:08.257353 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 05:17:08.257353 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 05:17:08.257353 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 05:17:08.257353 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:08.257353 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 342/688] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 05:17:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:08.262601 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb84a57-ff1a-4ad9-abd4-3762dd6d7aac None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:08.431897 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc37804-bb0c-4309-aa31-f84ebc87f428 None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:08.432277 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc37804-bb0c-4309-aa31-f84ebc87f428 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:08.432456 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc37804-bb0c-4309-aa31-f84ebc87f428 None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:08.433907 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 343/689] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:17:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 05:17:08.439073 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874cf668-d0dd-4337-94c9-9dbd1032b114 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:08.439352 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874cf668-d0dd-4337-94c9-9dbd1032b114 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:08.439622 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874cf668-d0dd-4337-94c9-9dbd1032b114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:08.439822 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb84a57-ff1a-4ad9-abd4-3762dd6d7aac None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:08.479665 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-874cf668-d0dd-4337-94c9-9dbd1032b114 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:17:08.482021 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-874cf668-d0dd-4337-94c9-9dbd1032b114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:17:08.501652 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b9cd79-dc09-483e-9892-8e12f0e09cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:08.502595 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b9cd79-dc09-483e-9892-8e12f0e09cb7 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:08.503068 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b9cd79-dc09-483e-9892-8e12f0e09cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:08.503550 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b9cd79-dc09-483e-9892-8e12f0e09cb7 None admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:08.504482 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b9cd79-dc09-483e-9892-8e12f0e09cb7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:08.505083 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b9cd79-dc09-483e-9892-8e12f0e09cb7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:08.507888 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b9cd79-dc09-483e-9892-8e12f0e09cb7 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:08.522030 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 347/690] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 05:17:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:08.529011 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b9cd79-dc09-483e-9892-8e12f0e09cb7 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:08.588157 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:08.634997 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 344/691] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:17:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 05:17:08.667335 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b9cd79-dc09-483e-9892-8e12f0e09cb7 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:08.704160 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831de9a7-ea93-44ab-8eef-c9a483060178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:08.704678 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831de9a7-ea93-44ab-8eef-c9a483060178 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:08.704954 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831de9a7-ea93-44ab-8eef-c9a483060178 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:08.705223 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831de9a7-ea93-44ab-8eef-c9a483060178 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:08.705937 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831de9a7-ea93-44ab-8eef-c9a483060178 None admin] RBAC: Adding query filter params (role.id=82bd224e8afc480782a85b833a2aa03e, scope.project.id=61ffb079d9e1437084945554bcc0747b, user.id=2bbe4555380345e485572d2da8b78be1) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:08.706243 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831de9a7-ea93-44ab-8eef-c9a483060178 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:08.707805 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831de9a7-ea93-44ab-8eef-c9a483060178 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:08.714695 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 348/692] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 05:17:08 2022] GET /identity/v3/role_assignments?user.id=2bbe4555380345e485572d2da8b78be1&scope.project.id=61ffb079d9e1437084945554bcc0747b&role.id=82bd224e8afc480782a85b833a2aa03e => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:08.793037 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7311c-7bff-47a2-97d8-8482c0b85437 None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:08.793655 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7311c-7bff-47a2-97d8-8482c0b85437 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:08.794128 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7311c-7bff-47a2-97d8-8482c0b85437 None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:08.795733 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 345/693] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:17:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:17:08.801516 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10bba4b-d8ce-4331-a8f8-56be9c4597fd None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:08.801794 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10bba4b-d8ce-4331-a8f8-56be9c4597fd None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:08.802054 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10bba4b-d8ce-4331-a8f8-56be9c4597fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:08.822329 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-f10bba4b-d8ce-4331-a8f8-56be9c4597fd None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:17:08.823511 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-f10bba4b-d8ce-4331-a8f8-56be9c4597fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:17:08.914449 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 349/694] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:17:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 05:17:09.039155 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e7311c-7bff-47a2-97d8-8482c0b85437 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:09.100761 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:09.162161 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e7311c-7bff-47a2-97d8-8482c0b85437 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:09.198236 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc1d999-2b68-48bc-9110-be0c31e40e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:09.199224 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc1d999-2b68-48bc-9110-be0c31e40e5b None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:09.199793 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc1d999-2b68-48bc-9110-be0c31e40e5b None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:09.200270 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc1d999-2b68-48bc-9110-be0c31e40e5b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:09.210943 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc1d999-2b68-48bc-9110-be0c31e40e5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:17:09.216360 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-4cc1d999-2b68-48bc-9110-be0c31e40e5b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 05:17:09.216360 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:09.216360 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:09.216360 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:09.216360 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:09.216360 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:09.216360 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:09.216360 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:09.216360 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:09.216360 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:09.216360 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:09.216360 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:09.216360 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:17:09.216360 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:17:09.216360 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:17:09.216360 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:17:09.217324 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:17:09.217324 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:17:09.217324 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:17:09.217324 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:17:09.217324 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:09.217324 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:09.217324 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:09.217324 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:09.217324 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:09.217324 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:09.217324 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:09.217324 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:09.217324 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:09.217324 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:09.217324 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:09.217324 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:09.218158 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:09.218158 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:09.218158 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:09.218158 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:09.218158 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:17:09.218158 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:17:09.218158 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:17:09.218158 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:17:09.218158 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:17:09.218158 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:17:09.218158 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 05:17:09.218158 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:09.220976 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 346/695] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 05:17:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:09.222878 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10bba4b-d8ce-4331-a8f8-56be9c4597fd None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:09.226542 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc1d999-2b68-48bc-9110-be0c31e40e5b None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:09.265389 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:09.358712 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc1d999-2b68-48bc-9110-be0c31e40e5b None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:09.372727 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:09.375342 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10bba4b-d8ce-4331-a8f8-56be9c4597fd None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:09.406077 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca1caab-ba2f-4fcd-b294-96c266f82983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:09.406946 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca1caab-ba2f-4fcd-b294-96c266f82983 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:09.407228 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca1caab-ba2f-4fcd-b294-96c266f82983 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:09.407498 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca1caab-ba2f-4fcd-b294-96c266f82983 None admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:09.409484 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca1caab-ba2f-4fcd-b294-96c266f82983 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:09.409484 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca1caab-ba2f-4fcd-b294-96c266f82983 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:09.409863 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca1caab-ba2f-4fcd-b294-96c266f82983 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:09.426097 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 347/696] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 05:17:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:09.436883 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca1caab-ba2f-4fcd-b294-96c266f82983 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:09.448809 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2bf147-304b-4f82-8de0-c6cf668427d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:09.449454 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2bf147-304b-4f82-8de0-c6cf668427d0 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:09.449730 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2bf147-304b-4f82-8de0-c6cf668427d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:09.450001 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2bf147-304b-4f82-8de0-c6cf668427d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:09.471397 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2bf147-304b-4f82-8de0-c6cf668427d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:09.472940 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2bf147-304b-4f82-8de0-c6cf668427d0 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:09.501749 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-cb2bf147-304b-4f82-8de0-c6cf668427d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:17:09.501749 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:09.501749 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:09.501749 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:09.501749 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:09.501749 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:09.501749 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:09.501749 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:09.501749 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:09.501749 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:09.501749 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:09.501749 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:09.501749 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 05:17:09.501749 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 05:17:09.501749 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 05:17:09.501749 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 05:17:09.502736 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:09.502736 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:09.502736 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:09.502736 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:09.502736 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:09.502736 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:09.502736 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:09.502736 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:09.502736 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:09.502736 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:09.502736 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:09.502736 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:09.502736 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:09.502736 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:09.502736 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:09.502736 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:09.502736 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 05:17:09.503643 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 05:17:09.503643 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:17:09.503643 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:17:09.506060 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 350/697] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:17:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 05:17:09.513003 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2bf147-304b-4f82-8de0-c6cf668427d0 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:09.591432 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca1caab-ba2f-4fcd-b294-96c266f82983 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:09.637175 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c013e49-ffbc-474e-9774-f951ec1fd62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:09.637739 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c013e49-ffbc-474e-9774-f951ec1fd62d None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:09.638018 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c013e49-ffbc-474e-9774-f951ec1fd62d None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:09.638420 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c013e49-ffbc-474e-9774-f951ec1fd62d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:09.658435 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c013e49-ffbc-474e-9774-f951ec1fd62d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:09.658803 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c013e49-ffbc-474e-9774-f951ec1fd62d None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:09.680381 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-7c013e49-ffbc-474e-9774-f951ec1fd62d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:17:09.680381 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:09.680381 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:09.680381 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:09.680381 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:09.680381 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:09.680381 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:09.680381 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:09.680381 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:09.680381 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:09.680381 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:09.680381 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:09.680381 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 05:17:09.680381 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 05:17:09.680381 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 05:17:09.680381 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 05:17:09.681458 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:09.681458 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:09.681458 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:09.681458 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:09.681458 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:09.681458 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:09.681458 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:09.681458 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:09.681458 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:09.681458 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:09.681458 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:09.681458 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:09.681458 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:09.681458 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:09.681458 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:09.681458 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:09.681458 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 05:17:09.682336 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 05:17:09.682336 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:17:09.682336 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:09.682514 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 348/698] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:17:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:09.688984 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c013e49-ffbc-474e-9774-f951ec1fd62d None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:09.689425 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:09.721042 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:09.724686 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2bf147-304b-4f82-8de0-c6cf668427d0 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:09.800633 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc602fe-557b-45dc-b5a9-a6abc55a4ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:09.801347 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc602fe-557b-45dc-b5a9-a6abc55a4ac6 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:09.801627 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc602fe-557b-45dc-b5a9-a6abc55a4ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:09.801897 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc602fe-557b-45dc-b5a9-a6abc55a4ac6 None admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:09.802589 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc602fe-557b-45dc-b5a9-a6abc55a4ac6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:09.802889 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc602fe-557b-45dc-b5a9-a6abc55a4ac6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:09.803668 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c013e49-ffbc-474e-9774-f951ec1fd62d None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:09.804311 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc602fe-557b-45dc-b5a9-a6abc55a4ac6 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:09.839268 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbd95af-db35-48f1-8196-dd2d00d15071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:09.839911 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd95af-db35-48f1-8196-dd2d00d15071 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:09.840190 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd95af-db35-48f1-8196-dd2d00d15071 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:09.840460 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd95af-db35-48f1-8196-dd2d00d15071 None admin] PATH_INFO: `/v3/domains` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:09.841104 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbd95af-db35-48f1-8196-dd2d00d15071 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:09.841403 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbd95af-db35-48f1-8196-dd2d00d15071 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:09.841584 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 351/699] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 05:17:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:17:09.843101 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbd95af-db35-48f1-8196-dd2d00d15071 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:09.852666 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc602fe-557b-45dc-b5a9-a6abc55a4ac6 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:09.860690 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 349/700] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 05:17:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:09.866459 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbd95af-db35-48f1-8196-dd2d00d15071 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:09.968036 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:10.008334 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbd95af-db35-48f1-8196-dd2d00d15071 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:10.056557 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19045846-61af-4ad7-b63f-0661a8c2f7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:10.057534 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19045846-61af-4ad7-b63f-0661a8c2f7bc None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:10.057962 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19045846-61af-4ad7-b63f-0661a8c2f7bc None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:10.058238 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19045846-61af-4ad7-b63f-0661a8c2f7bc None admin] PATH_INFO: `/v3/users/nova` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:10.070698 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19045846-61af-4ad7-b63f-0661a8c2f7bc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:10.072195 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19045846-61af-4ad7-b63f-0661a8c2f7bc None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:10.087304 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc602fe-557b-45dc-b5a9-a6abc55a4ac6 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:10.101250 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-19045846-61af-4ad7-b63f-0661a8c2f7bc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 11 05:17:10.101250 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:10.101250 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:10.101250 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:10.101250 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:10.101250 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:10.101250 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:10.101250 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:10.101250 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:10.101250 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:10.101250 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:10.101250 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:10.101250 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 05:17:10.101250 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 05:17:10.101250 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 05:17:10.101250 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 05:17:10.102634 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:10.102634 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:10.102634 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 05:17:10.102634 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 05:17:10.102634 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 05:17:10.102634 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 05:17:10.102634 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:10.102634 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:10.102634 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:10.102634 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:10.102634 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:10.102634 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:10.102634 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:10.102634 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:10.102634 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:10.102634 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:10.102634 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:10.102634 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:10.103586 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:10.103586 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:10.103586 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 05:17:10.103586 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 05:17:10.103586 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 05:17:10.103586 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 05:17:10.103586 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 05:17:10.103586 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 05:17:10.103586 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 11 05:17:10.103586 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:10.109275 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 350/701] 10.222.0.16 () {56 vars in 1093 bytes} [Sun Sep 11 05:17:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 05:17:10.112685 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19045846-61af-4ad7-b63f-0661a8c2f7bc None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:10.167580 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce1970e-07c6-4bb0-837e-41c6f64e97f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:10.168222 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce1970e-07c6-4bb0-837e-41c6f64e97f5 None admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:10.168501 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce1970e-07c6-4bb0-837e-41c6f64e97f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:10.168775 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce1970e-07c6-4bb0-837e-41c6f64e97f5 None admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:10.169427 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce1970e-07c6-4bb0-837e-41c6f64e97f5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:10.170918 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce1970e-07c6-4bb0-837e-41c6f64e97f5 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:10.199559 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:10.205770 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 352/702] 10.222.0.16 () {60 vars in 1132 bytes} [Sun Sep 11 05:17:09 2022] POST /identity/v3/users => generated 254 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:17:10.259281 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19045846-61af-4ad7-b63f-0661a8c2f7bc None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:10.270845 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c03875c-107c-4ba4-ba00-62fea6aa7bc4 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:10.272062 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c03875c-107c-4ba4-ba00-62fea6aa7bc4 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:10.272341 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c03875c-107c-4ba4-ba00-62fea6aa7bc4 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:10.273699 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 353/703] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:17:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 05:17:10.282416 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9002dd8d-c123-43a8-8329-c030c4c0a467 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:10.282745 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9002dd8d-c123-43a8-8329-c030c4c0a467 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:10.282960 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9002dd8d-c123-43a8-8329-c030c4c0a467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:10.305244 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-9002dd8d-c123-43a8-8329-c030c4c0a467 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:17:10.306479 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-9002dd8d-c123-43a8-8329-c030c4c0a467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:17:10.325649 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53e22e2-068b-48ff-bcbc-0c81062779ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:10.326273 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e22e2-068b-48ff-bcbc-0c81062779ad None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:10.326557 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e22e2-068b-48ff-bcbc-0c81062779ad None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:10.327008 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e22e2-068b-48ff-bcbc-0c81062779ad None admin] PATH_INFO: `/v3/users` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:10.328284 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53e22e2-068b-48ff-bcbc-0c81062779ad None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:10.328896 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53e22e2-068b-48ff-bcbc-0c81062779ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:10.330481 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53e22e2-068b-48ff-bcbc-0c81062779ad None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:10.352672 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:10.365499 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 351/704] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Sep 11 05:17:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:10.371479 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53e22e2-068b-48ff-bcbc-0c81062779ad None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:10.415287 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 354/705] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:17:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 05:17:10.529317 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53e22e2-068b-48ff-bcbc-0c81062779ad None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:10.571671 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7fb54d-fd9e-4239-be63-62ce5ed6da0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:10.572324 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7fb54d-fd9e-4239-be63-62ce5ed6da0a None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:10.572607 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7fb54d-fd9e-4239-be63-62ce5ed6da0a None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:10.572943 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7fb54d-fd9e-4239-be63-62ce5ed6da0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:10.581229 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39edaa16-7062-40cd-9cf9-9e726a828b1f None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:10.581516 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39edaa16-7062-40cd-9cf9-9e726a828b1f None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:10.581786 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39edaa16-7062-40cd-9cf9-9e726a828b1f None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:10.583462 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 355/706] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:17:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:17:10.589406 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b315f513-ac07-4798-900d-078c9aa130e4 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:10.589406 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b315f513-ac07-4798-900d-078c9aa130e4 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:10.589406 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b315f513-ac07-4798-900d-078c9aa130e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:10.610773 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-b315f513-ac07-4798-900d-078c9aa130e4 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:17:10.612338 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-b315f513-ac07-4798-900d-078c9aa130e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:17:10.642454 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:10.644602 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7fb54d-fd9e-4239-be63-62ce5ed6da0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:10.646685 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7fb54d-fd9e-4239-be63-62ce5ed6da0a None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:10.695929 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 356/707] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:17:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 05:17:10.725017 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b315f513-ac07-4798-900d-078c9aa130e4 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:10.754251 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 352/708] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 05:17:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 05:17:10.760079 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7fb54d-fd9e-4239-be63-62ce5ed6da0a None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:10.806713 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:10.854414 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b315f513-ac07-4798-900d-078c9aa130e4 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:10.878942 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:10.885874 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7fb54d-fd9e-4239-be63-62ce5ed6da0a None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:10.931600 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188f598e-379e-4881-99e3-99a780fff34d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:10.933046 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188f598e-379e-4881-99e3-99a780fff34d None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:10.933849 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188f598e-379e-4881-99e3-99a780fff34d None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:10.934837 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188f598e-379e-4881-99e3-99a780fff34d None admin] PATH_INFO: `/v3/services/network` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:10.935632 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bacdc46-defd-40ab-a59a-4a072ef8a34d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:10.936394 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188f598e-379e-4881-99e3-99a780fff34d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:10.936739 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bacdc46-defd-40ab-a59a-4a072ef8a34d None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:10.937213 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bacdc46-defd-40ab-a59a-4a072ef8a34d None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:10.937679 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bacdc46-defd-40ab-a59a-4a072ef8a34d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:10.937850 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188f598e-379e-4881-99e3-99a780fff34d None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:10.949336 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bacdc46-defd-40ab-a59a-4a072ef8a34d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:10.951264 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bacdc46-defd-40ab-a59a-4a072ef8a34d None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:10.959407 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-188f598e-379e-4881-99e3-99a780fff34d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 11 05:17:10.959407 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:10.959407 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 05:17:10.959407 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 05:17:10.959407 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 05:17:10.959407 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 05:17:10.959407 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 05:17:10.959407 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 05:17:10.959407 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 11 05:17:10.959407 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:17:10.959407 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 05:17:10.959407 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:17:10.959407 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:10.959407 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:10.959407 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:10.959407 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:10.959407 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:10.960490 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:10.960490 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:10.960490 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:10.960490 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:10.960490 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:10.960490 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:10.960490 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 05:17:10.960490 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 05:17:10.960490 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 05:17:10.960490 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 05:17:10.960490 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:10.960490 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:10.960490 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:10.960490 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:10.960490 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:10.960490 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:10.961736 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:10.961736 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:10.961736 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:10.961736 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:10.961736 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:10.961736 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:10.961736 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:10.961736 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:10.961736 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:10.961736 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:10.961736 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 05:17:10.961736 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 05:17:10.961736 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 11 05:17:10.961736 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:17:10.961736 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 357/709] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 05:17:10 2022] GET /identity/v3/services/network => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:10.968656 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188f598e-379e-4881-99e3-99a780fff34d None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:10.970955 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-7bacdc46-defd-40ab-a59a-4a072ef8a34d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:17:10.970955 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:10.970955 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:10.970955 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:10.970955 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:10.970955 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:10.970955 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:10.970955 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:10.970955 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:10.970955 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:10.970955 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:10.970955 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:10.970955 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 05:17:10.970955 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 05:17:10.970955 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 05:17:10.970955 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 05:17:10.971907 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:10.971907 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:10.971907 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:10.971907 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:10.971907 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:10.971907 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:10.971907 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:10.971907 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:10.971907 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:10.971907 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:10.971907 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:10.971907 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:10.971907 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:10.971907 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:10.971907 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:10.971907 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:10.971907 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 05:17:10.972811 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 05:17:10.972811 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:17:10.972811 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:10.975329 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 353/710] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:17:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 05:17:10.980464 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bacdc46-defd-40ab-a59a-4a072ef8a34d None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:11.103282 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bacdc46-defd-40ab-a59a-4a072ef8a34d None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:11.125438 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188f598e-379e-4881-99e3-99a780fff34d None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:11.151053 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:11.151922 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223aa92f-8814-4602-92f2-1d48dbb13e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:11.152537 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223aa92f-8814-4602-92f2-1d48dbb13e72 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:11.152816 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223aa92f-8814-4602-92f2-1d48dbb13e72 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:11.153091 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223aa92f-8814-4602-92f2-1d48dbb13e72 None admin] PATH_INFO: `/v3/domains` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:11.153755 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223aa92f-8814-4602-92f2-1d48dbb13e72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:11.154031 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223aa92f-8814-4602-92f2-1d48dbb13e72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:11.155570 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223aa92f-8814-4602-92f2-1d48dbb13e72 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:11.169299 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7629d8a8-3f8c-4aaf-9cad-c16b0dc12a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:11.169884 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 354/711] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 05:17:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:17:11.170625 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7629d8a8-3f8c-4aaf-9cad-c16b0dc12a5c None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:11.170838 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223aa92f-8814-4602-92f2-1d48dbb13e72 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:11.171302 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7629d8a8-3f8c-4aaf-9cad-c16b0dc12a5c None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:11.171881 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7629d8a8-3f8c-4aaf-9cad-c16b0dc12a5c None admin] PATH_INFO: `/v3/services` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:11.172782 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7629d8a8-3f8c-4aaf-9cad-c16b0dc12a5c None admin] RBAC: Adding query filter params (name=network) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:11.173568 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7629d8a8-3f8c-4aaf-9cad-c16b0dc12a5c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:11.176319 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7629d8a8-3f8c-4aaf-9cad-c16b0dc12a5c None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:11.182924 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 358/712] 10.222.0.16 () {56 vars in 1112 bytes} [Sun Sep 11 05:17:10 2022] GET /identity/v3/services?name=network => generated 124 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:11.183886 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:11.185851 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7629d8a8-3f8c-4aaf-9cad-c16b0dc12a5c None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:11.280961 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223aa92f-8814-4602-92f2-1d48dbb13e72 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:11.318576 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad879543-35bd-473b-89e6-931ed09aa483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:11.319218 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad879543-35bd-473b-89e6-931ed09aa483 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:11.319493 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad879543-35bd-473b-89e6-931ed09aa483 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:11.319810 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad879543-35bd-473b-89e6-931ed09aa483 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:11.320389 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad879543-35bd-473b-89e6-931ed09aa483 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:11.321953 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad879543-35bd-473b-89e6-931ed09aa483 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:11.328697 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7629d8a8-3f8c-4aaf-9cad-c16b0dc12a5c None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:11.332866 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-ad879543-35bd-473b-89e6-931ed09aa483 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 11 05:17:11.332866 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:11.332866 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 05:17:11.332866 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 05:17:11.332866 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 05:17:11.332866 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 05:17:11.332866 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 05:17:11.332866 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 05:17:11.332866 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 11 05:17:11.332866 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:11.332866 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 05:17:11.332866 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:11.332866 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:11.332866 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:11.332866 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:11.332866 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:11.332866 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:11.333954 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:11.333954 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:11.333954 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:11.333954 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:11.333954 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:11.333954 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:11.333954 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 05:17:11.333954 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 05:17:11.333954 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 05:17:11.333954 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 05:17:11.333954 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:11.333954 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:11.333954 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:11.333954 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:11.333954 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:11.333954 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:11.335462 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:11.335462 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:11.335462 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:11.335462 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:11.335462 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:11.335462 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:11.335462 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:11.335462 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:11.335462 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:11.335462 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:11.335462 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 05:17:11.335462 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 05:17:11.335462 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 11 05:17:11.335462 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:11.335462 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 355/713] 10.222.0.16 () {56 vars in 1129 bytes} [Sun Sep 11 05:17:11 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:11.336297 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad879543-35bd-473b-89e6-931ed09aa483 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:11.378733 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4eb516-8755-4554-8962-3672acfa7591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:11.379766 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4eb516-8755-4554-8962-3672acfa7591 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:11.381230 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4eb516-8755-4554-8962-3672acfa7591 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:11.381711 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4eb516-8755-4554-8962-3672acfa7591 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:11.391868 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4eb516-8755-4554-8962-3672acfa7591 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:11.394775 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4eb516-8755-4554-8962-3672acfa7591 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:11.415175 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-8c4eb516-8755-4554-8962-3672acfa7591 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 05:17:11.415175 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:11.415175 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:11.415175 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:11.415175 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:11.415175 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:11.415175 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:11.415175 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:11.415175 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:11.415175 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:11.415175 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:11.415175 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:11.415175 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 05:17:11.415175 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 05:17:11.415175 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 05:17:11.416214 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 05:17:11.416214 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:11.416214 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:11.416214 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:11.416214 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:11.416214 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:11.416214 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:11.416214 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:11.416214 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:11.416214 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:11.416214 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:11.416214 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:11.416214 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:11.416214 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:11.416214 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:11.416214 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:11.416214 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:11.417104 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 05:17:11.417104 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 05:17:11.417104 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 05:17:11.417104 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 05:17:11.417104 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 05:17:11.417104 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 05:17:11.417104 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 05:17:11.417104 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:17:11.420056 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:11.420528 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 359/714] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 05:17:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:11.421539 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4eb516-8755-4554-8962-3672acfa7591 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:11.449736 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad879543-35bd-473b-89e6-931ed09aa483 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:11.483341 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:11.486354 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983ae241-7d24-4b1e-92e5-2763f26fb276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:11.487267 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983ae241-7d24-4b1e-92e5-2763f26fb276 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:11.487727 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983ae241-7d24-4b1e-92e5-2763f26fb276 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:11.488252 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983ae241-7d24-4b1e-92e5-2763f26fb276 None admin] PATH_INFO: `/v3/services` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:11.489125 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983ae241-7d24-4b1e-92e5-2763f26fb276 None admin] RBAC: Adding query filter params (type=network) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:11.489631 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983ae241-7d24-4b1e-92e5-2763f26fb276 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:11.493051 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983ae241-7d24-4b1e-92e5-2763f26fb276 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:11.500049 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 356/715] 10.222.0.16 () {56 vars in 1112 bytes} [Sun Sep 11 05:17:11 2022] GET /identity/v3/services?type=network => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:11.501199 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983ae241-7d24-4b1e-92e5-2763f26fb276 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:11.554279 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4eb516-8755-4554-8962-3672acfa7591 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:11.594966 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c3e727-121e-4dea-a1e0-47122e1f305b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:11.596067 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c3e727-121e-4dea-a1e0-47122e1f305b None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:11.596570 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c3e727-121e-4dea-a1e0-47122e1f305b None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:11.597052 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c3e727-121e-4dea-a1e0-47122e1f305b None admin] PATH_INFO: `/v3/services` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:11.598056 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c3e727-121e-4dea-a1e0-47122e1f305b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:11.598587 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c3e727-121e-4dea-a1e0-47122e1f305b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:11.600381 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c3e727-121e-4dea-a1e0-47122e1f305b None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:11.606366 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 360/716] 10.222.0.16 () {56 vars in 1124 bytes} [Sun Sep 11 05:17:11 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:11.608240 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c13f704-ae74-4dee-be0f-9cdf1e608dd9 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:11.608755 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c13f704-ae74-4dee-be0f-9cdf1e608dd9 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:11.609227 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c13f704-ae74-4dee-be0f-9cdf1e608dd9 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:11.611001 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 361/717] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:17:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:17:11.612002 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c13f704-ae74-4dee-be0f-9cdf1e608dd9 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:11.642743 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983ae241-7d24-4b1e-92e5-2763f26fb276 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:11.693675 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d072c88-042f-49d0-8abd-edcf58b38394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:11.694304 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d072c88-042f-49d0-8abd-edcf58b38394 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:11.694584 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d072c88-042f-49d0-8abd-edcf58b38394 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:11.694855 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d072c88-042f-49d0-8abd-edcf58b38394 None admin] PATH_INFO: `/v3/projects` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:11.695868 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d072c88-042f-49d0-8abd-edcf58b38394 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:11.696177 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d072c88-042f-49d0-8abd-edcf58b38394 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:11.698609 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d072c88-042f-49d0-8abd-edcf58b38394 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:11.707868 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:11.715876 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 357/718] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 05:17:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:11.715876 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de4236-d5f5-49c8-b002-aaebf1314675 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:11.715876 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de4236-d5f5-49c8-b002-aaebf1314675 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:11.715876 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de4236-d5f5-49c8-b002-aaebf1314675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:11.732240 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c13f704-ae74-4dee-be0f-9cdf1e608dd9 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:11.734284 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-66de4236-d5f5-49c8-b002-aaebf1314675 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:17:11.735476 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-66de4236-d5f5-49c8-b002-aaebf1314675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:17:11.745575 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:11.784781 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6089d07f-9066-4f6f-ba11-083067f6ff72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:11.786078 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6089d07f-9066-4f6f-ba11-083067f6ff72 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:11.786550 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6089d07f-9066-4f6f-ba11-083067f6ff72 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:11.787444 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6089d07f-9066-4f6f-ba11-083067f6ff72 None admin] PATH_INFO: `/v3/services` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:11.788207 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6089d07f-9066-4f6f-ba11-083067f6ff72 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:11.788631 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6089d07f-9066-4f6f-ba11-083067f6ff72 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:11.790305 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6089d07f-9066-4f6f-ba11-083067f6ff72 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:11.798988 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 362/719] 10.222.0.16 () {56 vars in 1124 bytes} [Sun Sep 11 05:17:11 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:11.800001 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6089d07f-9066-4f6f-ba11-083067f6ff72 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:11.823940 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 358/720] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:17:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 05:17:11.927571 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6089d07f-9066-4f6f-ba11-083067f6ff72 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:11.978438 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df74f58-bc4a-464b-9f9c-6d81ccc12da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:11.979053 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df74f58-bc4a-464b-9f9c-6d81ccc12da4 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:11.979330 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df74f58-bc4a-464b-9f9c-6d81ccc12da4 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:11.979604 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df74f58-bc4a-464b-9f9c-6d81ccc12da4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:11.980369 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df74f58-bc4a-464b-9f9c-6d81ccc12da4 None admin] RBAC: Adding query filter params (role.id=5b702713e40145b49e0b42abd0a5fba9, scope.project.id=61ffb079d9e1437084945554bcc0747b, user.id=6cd6136036bd467c946cae90d5c29263) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:11.980674 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df74f58-bc4a-464b-9f9c-6d81ccc12da4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:11.982236 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df74f58-bc4a-464b-9f9c-6d81ccc12da4 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:11.992841 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 363/721] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 05:17:11 2022] GET /identity/v3/role_assignments?user.id=6cd6136036bd467c946cae90d5c29263&scope.project.id=61ffb079d9e1437084945554bcc0747b&role.id=5b702713e40145b49e0b42abd0a5fba9 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:12.162854 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66de4236-d5f5-49c8-b002-aaebf1314675 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:12.288017 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66de4236-d5f5-49c8-b002-aaebf1314675 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:12.316516 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:12.329604 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946e276e-ab90-4c81-a2d2-616fdf135346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:12.330589 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e276e-ab90-4c81-a2d2-616fdf135346 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:12.331092 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e276e-ab90-4c81-a2d2-616fdf135346 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:12.331563 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e276e-ab90-4c81-a2d2-616fdf135346 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:12.350595 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946e276e-ab90-4c81-a2d2-616fdf135346 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:17:12.355917 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-946e276e-ab90-4c81-a2d2-616fdf135346 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 05:17:12.355917 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:12.355917 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:12.355917 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:12.355917 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:12.355917 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:12.355917 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:12.355917 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:12.355917 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:12.355917 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:12.355917 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:12.355917 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:12.355917 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:17:12.355917 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:17:12.355917 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:17:12.355917 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:17:12.356931 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:17:12.356931 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:17:12.356931 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:17:12.356931 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:17:12.356931 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:12.356931 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:12.356931 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:12.356931 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:12.356931 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:12.356931 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:12.356931 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:12.356931 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:12.356931 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:12.356931 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:12.356931 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:12.356931 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:12.357790 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:12.357790 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:12.357790 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:12.357790 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:12.357790 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:17:12.357790 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:17:12.357790 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:17:12.357790 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:17:12.357790 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:17:12.357790 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:17:12.357790 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 05:17:12.357790 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:12.360182 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 359/722] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 05:17:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:12.367398 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df74f58-bc4a-464b-9f9c-6d81ccc12da4 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:12.428857 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:12.513494 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df74f58-bc4a-464b-9f9c-6d81ccc12da4 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:12.551972 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb29c6e2-a827-47f4-919d-3c244a602fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:12.552576 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb29c6e2-a827-47f4-919d-3c244a602fac None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:12.552855 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb29c6e2-a827-47f4-919d-3c244a602fac None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:12.553127 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb29c6e2-a827-47f4-919d-3c244a602fac None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:12.553818 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb29c6e2-a827-47f4-919d-3c244a602fac None admin] RBAC: Adding query filter params (name=admin) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:12.554124 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb29c6e2-a827-47f4-919d-3c244a602fac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:12.555525 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb29c6e2-a827-47f4-919d-3c244a602fac None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:12.564959 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 364/723] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 05:17:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:12.571234 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946e276e-ab90-4c81-a2d2-616fdf135346 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:12.700154 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946e276e-ab90-4c81-a2d2-616fdf135346 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:12.736790 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8de766b-8c1e-45cc-9e44-be1e3331e900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:12.737427 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de766b-8c1e-45cc-9e44-be1e3331e900 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:12.737707 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de766b-8c1e-45cc-9e44-be1e3331e900 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:12.737979 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de766b-8c1e-45cc-9e44-be1e3331e900 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:12.748625 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8de766b-8c1e-45cc-9e44-be1e3331e900 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:12.752592 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8de766b-8c1e-45cc-9e44-be1e3331e900 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:12.765934 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-a8de766b-8c1e-45cc-9e44-be1e3331e900 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:17:12.765934 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:12.765934 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:12.765934 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:12.765934 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:12.765934 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:12.765934 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:12.765934 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:12.765934 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:12.765934 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:12.765934 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:12.765934 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:12.765934 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 05:17:12.765934 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 05:17:12.765934 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 05:17:12.765934 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 05:17:12.766925 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:12.766925 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:12.766925 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:12.766925 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:12.766925 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:12.766925 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:12.766925 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:12.766925 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:12.766925 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:12.766925 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:12.766925 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:12.766925 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:12.766925 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:12.766925 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:12.766925 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:12.766925 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:12.766925 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 05:17:12.767953 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 05:17:12.767953 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:17:12.767953 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:12.767953 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 360/724] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:17:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:12.772886 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb29c6e2-a827-47f4-919d-3c244a602fac None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:12.918508 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:12.924420 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb29c6e2-a827-47f4-919d-3c244a602fac None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:12.977228 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c55e8b-7c78-4d7e-9502-fd187d8a42ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:12.977864 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c55e8b-7c78-4d7e-9502-fd187d8a42ce None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:12.978141 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c55e8b-7c78-4d7e-9502-fd187d8a42ce None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:12.978413 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c55e8b-7c78-4d7e-9502-fd187d8a42ce None admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:12.979091 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c55e8b-7c78-4d7e-9502-fd187d8a42ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:12.979397 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c55e8b-7c78-4d7e-9502-fd187d8a42ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:12.980855 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c55e8b-7c78-4d7e-9502-fd187d8a42ce None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:12.998575 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 365/725] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 05:17:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:13.003656 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8de766b-8c1e-45cc-9e44-be1e3331e900 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:13.060904 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:13.153535 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b300c5-0add-4902-b097-2b525c8a7130 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:13.153959 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b300c5-0add-4902-b097-2b525c8a7130 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:13.154410 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b300c5-0add-4902-b097-2b525c8a7130 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:13.157943 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 366/726] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:17:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 05:17:13.159319 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8de766b-8c1e-45cc-9e44-be1e3331e900 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:13.172841 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a150a9-9aa6-4721-86a0-569dae6a2a96 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:13.173156 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a150a9-9aa6-4721-86a0-569dae6a2a96 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:13.173438 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a150a9-9aa6-4721-86a0-569dae6a2a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:13.199366 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca44920-6f51-4222-b19e-d40f6a68a8b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:13.200042 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca44920-6f51-4222-b19e-d40f6a68a8b8 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:13.200302 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca44920-6f51-4222-b19e-d40f6a68a8b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:13.200572 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca44920-6f51-4222-b19e-d40f6a68a8b8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:13.208314 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca44920-6f51-4222-b19e-d40f6a68a8b8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:13.209946 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca44920-6f51-4222-b19e-d40f6a68a8b8 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:13.216088 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-77a150a9-9aa6-4721-86a0-569dae6a2a96 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:17:13.217298 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-77a150a9-9aa6-4721-86a0-569dae6a2a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:17:13.221085 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-1ca44920-6f51-4222-b19e-d40f6a68a8b8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 11 05:17:13.221085 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:13.221085 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:13.221085 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:13.221085 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:13.221085 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:13.221085 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:13.221085 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:13.221085 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:13.221085 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:13.221085 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:13.221085 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:13.221085 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 05:17:13.221085 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 05:17:13.221085 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 05:17:13.221085 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 05:17:13.222015 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:13.222015 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:13.222015 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 05:17:13.222015 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 05:17:13.222015 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 05:17:13.222015 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 05:17:13.222015 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:13.222015 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:13.222015 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:13.222015 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:13.222015 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:13.222015 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:13.222015 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:13.222015 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:13.222015 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:13.222015 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:13.222015 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:13.222015 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:13.223339 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:13.223339 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:13.223339 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 05:17:13.223339 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 05:17:13.223339 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 05:17:13.223339 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 05:17:13.223339 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 05:17:13.223339 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 05:17:13.223339 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 11 05:17:13.223339 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:13.223339 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 361/727] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 05:17:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:13.227980 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca44920-6f51-4222-b19e-d40f6a68a8b8 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:13.329743 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca44920-6f51-4222-b19e-d40f6a68a8b8 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:13.340073 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:13.385297 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3cb2ea-629f-4b7e-8ab0-967e0e341ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:13.386336 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3cb2ea-629f-4b7e-8ab0-967e0e341ee5 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:13.386614 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3cb2ea-629f-4b7e-8ab0-967e0e341ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:13.386890 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3cb2ea-629f-4b7e-8ab0-967e0e341ee5 None admin] PATH_INFO: `/v3/users` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:13.387623 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3cb2ea-629f-4b7e-8ab0-967e0e341ee5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:13.387954 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3cb2ea-629f-4b7e-8ab0-967e0e341ee5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:13.390293 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 367/728] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:17:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 05:17:13.390983 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3cb2ea-629f-4b7e-8ab0-967e0e341ee5 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:13.428082 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 362/729] 10.222.0.16 () {56 vars in 1135 bytes} [Sun Sep 11 05:17:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:17:13.435618 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a150a9-9aa6-4721-86a0-569dae6a2a96 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:13.576897 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a150a9-9aa6-4721-86a0-569dae6a2a96 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:13.580016 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:13.634480 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351a45e1-a338-488d-83c2-521c285a1fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:13.635095 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a45e1-a338-488d-83c2-521c285a1fd7 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:13.635373 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a45e1-a338-488d-83c2-521c285a1fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:13.635644 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a45e1-a338-488d-83c2-521c285a1fd7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:13.739107 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351a45e1-a338-488d-83c2-521c285a1fd7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:13.741059 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351a45e1-a338-488d-83c2-521c285a1fd7 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:13.760322 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3cb2ea-629f-4b7e-8ab0-967e0e341ee5 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:13.908039 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:13.924739 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 368/730] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 05:17:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 05:17:13.934909 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3cb2ea-629f-4b7e-8ab0-967e0e341ee5 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:13.936791 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351a45e1-a338-488d-83c2-521c285a1fd7 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:13.974070 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efe76fe-b39c-4c47-a152-556ee853bc34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:13.975048 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe76fe-b39c-4c47-a152-556ee853bc34 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:13.975468 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe76fe-b39c-4c47-a152-556ee853bc34 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:13.975914 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe76fe-b39c-4c47-a152-556ee853bc34 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:13.986693 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efe76fe-b39c-4c47-a152-556ee853bc34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:17:13.992797 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-0efe76fe-b39c-4c47-a152-556ee853bc34 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 05:17:13.992797 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:13.992797 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:13.992797 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:13.992797 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:13.992797 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:13.992797 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:13.992797 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:13.992797 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:13.992797 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:13.992797 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:13.992797 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:13.992797 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:17:13.992797 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:17:13.992797 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:17:13.992797 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:17:13.993915 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:17:13.993915 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:17:13.993915 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:17:13.993915 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:17:13.993915 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:13.993915 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:13.993915 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:13.993915 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:13.993915 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:13.993915 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:13.993915 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:13.993915 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:13.993915 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:13.993915 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:13.993915 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:13.993915 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:13.994957 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:13.994957 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:13.994957 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:13.994957 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:13.994957 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:17:13.994957 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:17:13.994957 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:17:13.994957 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:17:13.994957 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:17:13.994957 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:17:13.994957 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 05:17:13.994957 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:13.997163 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 363/731] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 11 05:17:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 05:17:14.008874 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efe76fe-b39c-4c47-a152-556ee853bc34 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:14.044067 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:14.093660 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351a45e1-a338-488d-83c2-521c285a1fd7 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:14.129929 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517d4698-2aca-43ae-b701-eb0fa452e9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:14.131459 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d4698-2aca-43ae-b701-eb0fa452e9be None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:14.132008 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d4698-2aca-43ae-b701-eb0fa452e9be None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:14.132482 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d4698-2aca-43ae-b701-eb0fa452e9be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:14.142996 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517d4698-2aca-43ae-b701-eb0fa452e9be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:14.144770 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517d4698-2aca-43ae-b701-eb0fa452e9be None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:14.149665 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efe76fe-b39c-4c47-a152-556ee853bc34 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:14.161076 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-517d4698-2aca-43ae-b701-eb0fa452e9be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:17:14.161076 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:14.161076 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:14.161076 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:14.161076 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:14.161076 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:14.161076 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:14.161076 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:14.161076 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:14.161076 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:14.161076 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:14.161076 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:14.161076 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 05:17:14.161076 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 05:17:14.161076 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 05:17:14.161076 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 05:17:14.162639 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:14.162639 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:14.162639 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:14.162639 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:14.162639 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:14.162639 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:14.162639 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:14.162639 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:14.162639 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:14.162639 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:14.162639 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:14.162639 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:14.162639 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:14.162639 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:14.162639 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:14.162639 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:14.162639 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 05:17:14.163749 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 05:17:14.163749 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:17:14.163749 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:17:14.166301 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 369/732] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:17:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:14.167730 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e81b45-e076-49cb-985a-6d4c173afbe0 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:14.168219 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e81b45-e076-49cb-985a-6d4c173afbe0 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:14.168693 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e81b45-e076-49cb-985a-6d4c173afbe0 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:14.174344 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 370/733] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:17:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:17:14.175368 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e81b45-e076-49cb-985a-6d4c173afbe0 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:14.188206 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7f0804-14e8-4544-8843-00a474dd6b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:14.188819 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f0804-14e8-4544-8843-00a474dd6b31 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:14.189268 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f0804-14e8-4544-8843-00a474dd6b31 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:14.190029 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f0804-14e8-4544-8843-00a474dd6b31 None admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:14.191140 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7f0804-14e8-4544-8843-00a474dd6b31 None admin] RBAC: Adding query filter params (name=service) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:14.191594 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7f0804-14e8-4544-8843-00a474dd6b31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:14.193803 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7f0804-14e8-4544-8843-00a474dd6b31 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:14.204111 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 364/734] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 11 05:17:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:17:14.206022 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d597513-cd52-4f15-adbe-10fb27cfb732 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:14.206633 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d597513-cd52-4f15-adbe-10fb27cfb732 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:14.207057 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d597513-cd52-4f15-adbe-10fb27cfb732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:14.226194 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:14.233385 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-5d597513-cd52-4f15-adbe-10fb27cfb732 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:17:14.234964 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-5d597513-cd52-4f15-adbe-10fb27cfb732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:17:14.301309 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e81b45-e076-49cb-985a-6d4c173afbe0 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:14.323783 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 365/735] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:17:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 05:17:14.324917 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d597513-cd52-4f15-adbe-10fb27cfb732 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:14.350619 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:14.360084 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa38565a-dc82-4885-8b56-6128c04ec74a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:14.361389 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa38565a-dc82-4885-8b56-6128c04ec74a None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:14.362861 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa38565a-dc82-4885-8b56-6128c04ec74a None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:14.363289 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa38565a-dc82-4885-8b56-6128c04ec74a None admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:14.365658 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa38565a-dc82-4885-8b56-6128c04ec74a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:14.369446 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa38565a-dc82-4885-8b56-6128c04ec74a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:14.371033 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa38565a-dc82-4885-8b56-6128c04ec74a None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:14.397669 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 371/736] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 05:17:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:14.405131 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa38565a-dc82-4885-8b56-6128c04ec74a None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:14.472096 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d597513-cd52-4f15-adbe-10fb27cfb732 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:14.526053 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd93800f-3bcb-4637-a546-0727a5ea2a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:14.527043 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd93800f-3bcb-4637-a546-0727a5ea2a48 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:14.527468 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd93800f-3bcb-4637-a546-0727a5ea2a48 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:14.527916 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd93800f-3bcb-4637-a546-0727a5ea2a48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:14.550155 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd93800f-3bcb-4637-a546-0727a5ea2a48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:14.552778 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd93800f-3bcb-4637-a546-0727a5ea2a48 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:14.583173 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-bd93800f-3bcb-4637-a546-0727a5ea2a48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:17:14.583173 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:14.583173 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:14.583173 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:14.583173 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:14.583173 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:14.583173 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:14.583173 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:14.583173 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:14.583173 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:14.583173 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:14.583173 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:14.583173 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 05:17:14.583173 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 05:17:14.583173 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 05:17:14.583173 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 05:17:14.585166 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:14.585166 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:14.585166 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:14.585166 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:14.585166 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:14.585166 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:14.585166 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:14.585166 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:14.585166 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:14.585166 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:14.585166 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:14.585166 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:14.585166 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:14.585166 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:14.585166 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:14.585166 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:14.585166 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 05:17:14.586322 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 05:17:14.586322 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:17:14.586322 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:14.592504 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 366/737] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:17:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:14.593893 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade286c-a917-4510-a17b-bd43c3b12b9a None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:14.594343 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade286c-a917-4510-a17b-bd43c3b12b9a None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:14.594763 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade286c-a917-4510-a17b-bd43c3b12b9a None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:14.596392 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 367/738] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:17:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:17:14.600967 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cade286c-a917-4510-a17b-bd43c3b12b9a None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:14.631825 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa38565a-dc82-4885-8b56-6128c04ec74a None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:14.633611 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:14.666367 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:14.672093 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac54dc3-7d36-4e29-8905-103cffeef6cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:14.672734 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac54dc3-7d36-4e29-8905-103cffeef6cb None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:14.673010 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac54dc3-7d36-4e29-8905-103cffeef6cb None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:14.673284 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac54dc3-7d36-4e29-8905-103cffeef6cb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:14.680402 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac54dc3-7d36-4e29-8905-103cffeef6cb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:14.682012 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac54dc3-7d36-4e29-8905-103cffeef6cb None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:14.693350 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-fac54dc3-7d36-4e29-8905-103cffeef6cb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 05:17:14.693350 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:14.693350 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:14.693350 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:14.693350 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:14.693350 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:14.693350 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:14.693350 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:14.693350 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:14.693350 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:14.693350 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:14.693350 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:14.693350 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 05:17:14.693350 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 05:17:14.693350 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 05:17:14.694446 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 05:17:14.694446 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:14.694446 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:14.694446 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:14.694446 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:14.694446 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:14.694446 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:14.694446 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:14.694446 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:14.694446 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:14.694446 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:14.694446 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:14.694446 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:14.694446 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:14.694446 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:14.694446 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:14.694446 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:14.695640 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 05:17:14.695640 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 05:17:14.695640 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 05:17:14.695640 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 05:17:14.695640 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 05:17:14.695640 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 05:17:14.695640 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 05:17:14.695640 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:17:14.699193 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 372/739] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 05:17:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:14.700458 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e2c8a-bae1-46f3-990e-07bef34e9e14 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:14.700745 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e2c8a-bae1-46f3-990e-07bef34e9e14 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:14.701021 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e2c8a-bae1-46f3-990e-07bef34e9e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:14.715418 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cade286c-a917-4510-a17b-bd43c3b12b9a None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:14.720191 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-868e2c8a-bae1-46f3-990e-07bef34e9e14 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:17:14.721427 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-868e2c8a-bae1-46f3-990e-07bef34e9e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:17:14.757493 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec1f09b-523b-419c-9733-a49d1d8fc2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:14.758438 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1f09b-523b-419c-9733-a49d1d8fc2d0 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:14.758875 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1f09b-523b-419c-9733-a49d1d8fc2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:14.759148 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1f09b-523b-419c-9733-a49d1d8fc2d0 None admin] PATH_INFO: `/v3/domains` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:14.759829 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec1f09b-523b-419c-9733-a49d1d8fc2d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:14.760133 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec1f09b-523b-419c-9733-a49d1d8fc2d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:14.761498 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec1f09b-523b-419c-9733-a49d1d8fc2d0 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:14.773920 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 368/740] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 05:17:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:17:14.779509 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec1f09b-523b-419c-9733-a49d1d8fc2d0 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:14.807803 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 373/741] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:17:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 05:17:14.807803 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868e2c8a-bae1-46f3-990e-07bef34e9e14 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:14.903174 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec1f09b-523b-419c-9733-a49d1d8fc2d0 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:14.914149 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:14.923241 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868e2c8a-bae1-46f3-990e-07bef34e9e14 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:14.929574 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:14.943119 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aace86-873e-42a6-9074-203f75c037a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:14.944081 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aace86-873e-42a6-9074-203f75c037a9 None admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:14.944550 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aace86-873e-42a6-9074-203f75c037a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:14.944820 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aace86-873e-42a6-9074-203f75c037a9 None admin] PATH_INFO: `/v3/services` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:14.945472 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aace86-873e-42a6-9074-203f75c037a9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:14.946831 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aace86-873e-42a6-9074-203f75c037a9 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:14.959245 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0936236-8f11-46a5-ab4a-000bf604e232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:14.959902 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0936236-8f11-46a5-ab4a-000bf604e232 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:14.960185 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0936236-8f11-46a5-ab4a-000bf604e232 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:14.960458 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0936236-8f11-46a5-ab4a-000bf604e232 None admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:14.961142 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0936236-8f11-46a5-ab4a-000bf604e232 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:14.961451 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0936236-8f11-46a5-ab4a-000bf604e232 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:14.962918 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0936236-8f11-46a5-ab4a-000bf604e232 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:14.972066 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 369/742] 10.222.0.16 () {60 vars in 1141 bytes} [Sun Sep 11 05:17:14 2022] POST /identity/v3/services => generated 240 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:17:14.972908 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aace86-873e-42a6-9074-203f75c037a9 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:14.981485 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 374/743] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 05:17:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:14.981485 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816af72d-29f8-4433-b933-183a00dec2f4 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:14.981485 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816af72d-29f8-4433-b933-183a00dec2f4 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:14.981485 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816af72d-29f8-4433-b933-183a00dec2f4 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:14.981485 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 375/744] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:17:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:17:14.987140 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816af72d-29f8-4433-b933-183a00dec2f4 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:15.124547 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816af72d-29f8-4433-b933-183a00dec2f4 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:15.125075 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aace86-873e-42a6-9074-203f75c037a9 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:15.178317 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093c40a3-b65d-498e-99f8-28ca6897e48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:15.179041 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093c40a3-b65d-498e-99f8-28ca6897e48d None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:15.179215 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093c40a3-b65d-498e-99f8-28ca6897e48d None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:15.179483 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093c40a3-b65d-498e-99f8-28ca6897e48d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:15.181450 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2110969d-4124-4234-8983-77f1edfbcf57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:15.182470 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2110969d-4124-4234-8983-77f1edfbcf57 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:15.182747 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2110969d-4124-4234-8983-77f1edfbcf57 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:15.183012 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2110969d-4124-4234-8983-77f1edfbcf57 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:15.184577 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2110969d-4124-4234-8983-77f1edfbcf57 None admin] RBAC: Adding query filter params (role.id=5b702713e40145b49e0b42abd0a5fba9, scope.project.id=61ffb079d9e1437084945554bcc0747b, user.id=2bbe4555380345e485572d2da8b78be1) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:15.184878 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2110969d-4124-4234-8983-77f1edfbcf57 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:15.187116 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2110969d-4124-4234-8983-77f1edfbcf57 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:15.187764 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093c40a3-b65d-498e-99f8-28ca6897e48d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:15.189334 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093c40a3-b65d-498e-99f8-28ca6897e48d None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:15.194168 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 376/745] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 05:17:14 2022] GET /identity/v3/role_assignments?user.id=2bbe4555380345e485572d2da8b78be1&scope.project.id=61ffb079d9e1437084945554bcc0747b&role.id=5b702713e40145b49e0b42abd0a5fba9 => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:17:15.195670 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d0218-ed5f-43ae-9983-3169136f0ffd None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:15.196202 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d0218-ed5f-43ae-9983-3169136f0ffd None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:15.196967 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d0218-ed5f-43ae-9983-3169136f0ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:15.201931 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-093c40a3-b65d-498e-99f8-28ca6897e48d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 11 05:17:15.201931 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:15.201931 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:15.201931 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:15.201931 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:15.201931 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:15.201931 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:15.201931 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:15.201931 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:15.201931 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:15.201931 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:15.201931 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:15.201931 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 05:17:15.201931 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 05:17:15.201931 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 05:17:15.201931 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 05:17:15.202969 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:15.202969 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:15.202969 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 05:17:15.202969 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 05:17:15.202969 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 05:17:15.202969 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 05:17:15.202969 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:15.202969 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:15.202969 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:15.202969 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:15.202969 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:15.202969 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:15.202969 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:15.202969 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:15.202969 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:15.202969 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:15.202969 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:15.202969 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:15.203977 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:15.203977 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:15.203977 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 05:17:15.203977 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 05:17:15.203977 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 05:17:15.203977 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 05:17:15.203977 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 05:17:15.203977 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 05:17:15.203977 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 11 05:17:15.203977 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:15.207823 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 370/746] 10.222.0.16 () {56 vars in 1117 bytes} [Sun Sep 11 05:17:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:15.209083 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093c40a3-b65d-498e-99f8-28ca6897e48d None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:15.225597 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-5b9d0218-ed5f-43ae-9983-3169136f0ffd None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:17:15.228079 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-5b9d0218-ed5f-43ae-9983-3169136f0ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:17:15.240517 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:15.260786 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:15.322442 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093c40a3-b65d-498e-99f8-28ca6897e48d None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:15.328486 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 377/747] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:17:15 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 05:17:15.329758 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9d0218-ed5f-43ae-9983-3169136f0ffd None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:15.365692 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff6d260-82a2-459a-b4fa-a3407780ab43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:15.366315 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff6d260-82a2-459a-b4fa-a3407780ab43 None admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:15.366586 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff6d260-82a2-459a-b4fa-a3407780ab43 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:15.367102 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff6d260-82a2-459a-b4fa-a3407780ab43 None admin] PATH_INFO: `/v3/services` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:15.368094 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff6d260-82a2-459a-b4fa-a3407780ab43 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:15.369199 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff6d260-82a2-459a-b4fa-a3407780ab43 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:15.393920 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 371/748] 10.222.0.16 () {60 vars in 1141 bytes} [Sun Sep 11 05:17:15 2022] POST /identity/v3/services => generated 251 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:17:15.467790 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9d0218-ed5f-43ae-9983-3169136f0ffd None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:15.518537 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f6f6f3-1c99-42b9-9ea0-fe9b9dc24c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:15.519161 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f6f6f3-1c99-42b9-9ea0-fe9b9dc24c29 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:15.519445 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f6f6f3-1c99-42b9-9ea0-fe9b9dc24c29 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:15.519736 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f6f6f3-1c99-42b9-9ea0-fe9b9dc24c29 None admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:15.520476 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f6f6f3-1c99-42b9-9ea0-fe9b9dc24c29 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:15.520783 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f6f6f3-1c99-42b9-9ea0-fe9b9dc24c29 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:15.522794 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f6f6f3-1c99-42b9-9ea0-fe9b9dc24c29 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:15.531401 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:15.542759 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 378/749] 10.222.0.16 () {56 vars in 1149 bytes} [Sun Sep 11 05:17:15 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:15.548644 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff6d260-82a2-459a-b4fa-a3407780ab43 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:15.693568 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff6d260-82a2-459a-b4fa-a3407780ab43 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:15.695668 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:15.696561 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f6f6f3-1c99-42b9-9ea0-fe9b9dc24c29 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:15.738706 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412f0393-d87f-42c0-9351-d4b163b2cee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:15.739926 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412f0393-d87f-42c0-9351-d4b163b2cee8 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:15.740412 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412f0393-d87f-42c0-9351-d4b163b2cee8 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:15.740903 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412f0393-d87f-42c0-9351-d4b163b2cee8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:15.836029 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412f0393-d87f-42c0-9351-d4b163b2cee8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:15.837270 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412f0393-d87f-42c0-9351-d4b163b2cee8 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:15.839604 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f6f6f3-1c99-42b9-9ea0-fe9b9dc24c29 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:15.913386 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1371d719-2874-4e7e-9c6f-7cb2d72ed39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:15.914030 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1371d719-2874-4e7e-9c6f-7cb2d72ed39d None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:15.914308 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1371d719-2874-4e7e-9c6f-7cb2d72ed39d None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:15.914860 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1371d719-2874-4e7e-9c6f-7cb2d72ed39d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:15.956395 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1371d719-2874-4e7e-9c6f-7cb2d72ed39d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:17:15.961719 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-1371d719-2874-4e7e-9c6f-7cb2d72ed39d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 05:17:15.961719 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:15.961719 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:15.961719 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:15.961719 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:15.961719 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:15.961719 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:15.961719 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:15.961719 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:15.961719 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:15.961719 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:15.961719 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:15.961719 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:17:15.961719 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:17:15.961719 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:17:15.961719 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:17:15.962905 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:17:15.962905 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:17:15.962905 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:17:15.962905 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:17:15.962905 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:15.962905 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:15.962905 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:15.962905 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:15.962905 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:15.962905 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:15.962905 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:15.962905 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:15.962905 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:15.962905 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:15.962905 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:15.962905 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:15.963981 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:15.963981 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:15.963981 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:15.963981 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:15.963981 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:17:15.963981 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:17:15.963981 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:17:15.963981 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:17:15.963981 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:17:15.963981 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:17:15.963981 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 05:17:15.963981 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:17:15.965981 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 379/750] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 05:17:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:15.973087 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1371d719-2874-4e7e-9c6f-7cb2d72ed39d None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:15.978085 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 372/751] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 05:17:15 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 05:17:15.983348 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412f0393-d87f-42c0-9351-d4b163b2cee8 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:15.985511 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:16.084338 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:16.162498 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412f0393-d87f-42c0-9351-d4b163b2cee8 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:16.194501 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1371d719-2874-4e7e-9c6f-7cb2d72ed39d None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:16.201414 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77da601-730a-43f4-b145-5d53ceb889fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:16.202067 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77da601-730a-43f4-b145-5d53ceb889fb None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:16.202347 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77da601-730a-43f4-b145-5d53ceb889fb None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:16.202623 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77da601-730a-43f4-b145-5d53ceb889fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:16.214869 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77da601-730a-43f4-b145-5d53ceb889fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:16.216299 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77da601-730a-43f4-b145-5d53ceb889fb None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:16.232467 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-d77da601-730a-43f4-b145-5d53ceb889fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:17:16.232467 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:16.232467 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:16.232467 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:16.232467 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:16.232467 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:16.232467 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:16.232467 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:16.232467 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:16.232467 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:16.232467 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:16.232467 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:16.232467 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 05:17:16.232467 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 05:17:16.232467 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 05:17:16.232467 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 05:17:16.233452 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:16.233452 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:16.233452 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:16.233452 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:16.233452 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:16.233452 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:16.233452 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:16.233452 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:16.233452 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:16.233452 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:16.233452 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:16.233452 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:16.233452 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:16.233452 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:16.233452 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:16.233452 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:16.233452 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 05:17:16.234396 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 05:17:16.234396 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:17:16.234396 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:16.234396 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 373/752] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:17:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 05:17:16.241147 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77da601-730a-43f4-b145-5d53ceb889fb None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:16.282413 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a550436-a395-46b0-a8f4-78c490342d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:16.283388 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a550436-a395-46b0-a8f4-78c490342d9d None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:16.283907 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a550436-a395-46b0-a8f4-78c490342d9d None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:16.284421 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a550436-a395-46b0-a8f4-78c490342d9d None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:16.285447 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a550436-a395-46b0-a8f4-78c490342d9d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:16.287402 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a550436-a395-46b0-a8f4-78c490342d9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:16.289262 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a550436-a395-46b0-a8f4-78c490342d9d None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:16.306174 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 380/753] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 05:17:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:17:16.315500 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a550436-a395-46b0-a8f4-78c490342d9d None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:16.348276 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:16.425430 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77da601-730a-43f4-b145-5d53ceb889fb None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:16.478853 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4671cedf-8715-49bb-a59b-97fc7da61ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:16.479386 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4671cedf-8715-49bb-a59b-97fc7da61ff6 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:16.479664 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4671cedf-8715-49bb-a59b-97fc7da61ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:16.479960 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4671cedf-8715-49bb-a59b-97fc7da61ff6 None admin] PATH_INFO: `/v3/domains` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:16.480603 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4671cedf-8715-49bb-a59b-97fc7da61ff6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:16.480903 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4671cedf-8715-49bb-a59b-97fc7da61ff6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:16.482268 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4671cedf-8715-49bb-a59b-97fc7da61ff6 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:16.499322 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a550436-a395-46b0-a8f4-78c490342d9d None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:16.512853 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 374/754] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 05:17:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:16.518190 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4671cedf-8715-49bb-a59b-97fc7da61ff6 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:16.533690 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:16.573477 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4baa094-01c1-45d0-9716-dccee3b45910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:16.574131 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4baa094-01c1-45d0-9716-dccee3b45910 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:16.574411 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4baa094-01c1-45d0-9716-dccee3b45910 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:16.574683 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4baa094-01c1-45d0-9716-dccee3b45910 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:16.601808 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4baa094-01c1-45d0-9716-dccee3b45910 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:16.603347 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4baa094-01c1-45d0-9716-dccee3b45910 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:16.633624 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-a4baa094-01c1-45d0-9716-dccee3b45910 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:17:16.633624 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:16.633624 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:16.633624 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:16.633624 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:16.633624 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:16.633624 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:16.633624 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:16.633624 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:16.633624 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:16.633624 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:16.633624 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:16.633624 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 05:17:16.633624 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 05:17:16.633624 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 05:17:16.633624 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 05:17:16.634626 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:16.634626 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:16.634626 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:16.634626 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:16.634626 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:16.634626 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:16.634626 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:16.634626 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:16.634626 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:16.634626 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:16.634626 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:16.634626 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:16.634626 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:16.634626 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:16.634626 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:16.634626 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:16.634626 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 05:17:16.635521 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 05:17:16.635521 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:17:16.635521 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:17:16.635521 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 381/755] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:17:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:16.650585 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4baa094-01c1-45d0-9716-dccee3b45910 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:16.684929 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4671cedf-8715-49bb-a59b-97fc7da61ff6 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:16.700427 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:16.723326 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff2425f-a607-474b-9ce1-a36a9d7c9b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:16.724001 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2425f-a607-474b-9ce1-a36a9d7c9b5f None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:16.724341 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2425f-a607-474b-9ce1-a36a9d7c9b5f None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:16.724618 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2425f-a607-474b-9ce1-a36a9d7c9b5f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:16.731890 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff2425f-a607-474b-9ce1-a36a9d7c9b5f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:16.734104 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff2425f-a607-474b-9ce1-a36a9d7c9b5f None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:16.747063 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-6ff2425f-a607-474b-9ce1-a36a9d7c9b5f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 05:17:16.747063 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:16.747063 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:16.747063 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:16.747063 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:16.747063 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:16.747063 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:16.747063 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:16.747063 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:16.747063 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:16.747063 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:16.747063 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:16.747063 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 05:17:16.747063 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 05:17:16.747063 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 05:17:16.747989 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 05:17:16.747989 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:16.747989 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:16.747989 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:16.747989 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:16.747989 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:16.747989 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:16.747989 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:16.747989 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:16.747989 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:16.747989 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:16.747989 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:16.747989 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:16.747989 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:16.747989 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:16.747989 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:16.747989 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:16.748957 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 05:17:16.748957 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 05:17:16.748957 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 05:17:16.748957 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 05:17:16.748957 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 05:17:16.748957 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 05:17:16.748957 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 05:17:16.748957 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:16.748957 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 375/756] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 05:17:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 05:17:16.755341 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff2425f-a607-474b-9ce1-a36a9d7c9b5f None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:16.867639 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff2425f-a607-474b-9ce1-a36a9d7c9b5f None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:16.893987 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4baa094-01c1-45d0-9716-dccee3b45910 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:16.906174 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7036048-250a-4384-a3cf-ef7d53acca50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:16.906795 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7036048-250a-4384-a3cf-ef7d53acca50 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:16.907074 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7036048-250a-4384-a3cf-ef7d53acca50 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:16.907349 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7036048-250a-4384-a3cf-ef7d53acca50 None admin] PATH_INFO: `/v3/projects` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:16.908105 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7036048-250a-4384-a3cf-ef7d53acca50 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:16.908424 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7036048-250a-4384-a3cf-ef7d53acca50 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:16.909850 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7036048-250a-4384-a3cf-ef7d53acca50 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:16.936645 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 376/757] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 05:17:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:17:16.944654 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7036048-250a-4384-a3cf-ef7d53acca50 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:16.954331 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bcd80a-2525-4074-9c55-cf0c828d28c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:16.954946 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bcd80a-2525-4074-9c55-cf0c828d28c3 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:16.955209 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bcd80a-2525-4074-9c55-cf0c828d28c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:16.955487 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bcd80a-2525-4074-9c55-cf0c828d28c3 None admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:16.956170 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bcd80a-2525-4074-9c55-cf0c828d28c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:16.956475 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bcd80a-2525-4074-9c55-cf0c828d28c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:16.957861 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bcd80a-2525-4074-9c55-cf0c828d28c3 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:16.972187 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 382/758] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 05:17:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:16.977230 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bcd80a-2525-4074-9c55-cf0c828d28c3 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:17.010182 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:17.030280 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:17.126759 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7036048-250a-4384-a3cf-ef7d53acca50 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:17.127112 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bcd80a-2525-4074-9c55-cf0c828d28c3 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:17.176379 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75ed15c-c83d-4c4f-ad77-cd8c57b13049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:17.177056 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ed15c-c83d-4c4f-ad77-cd8c57b13049 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:17.177430 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ed15c-c83d-4c4f-ad77-cd8c57b13049 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:17.177723 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ed15c-c83d-4c4f-ad77-cd8c57b13049 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:17.178495 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75ed15c-c83d-4c4f-ad77-cd8c57b13049 None admin] RBAC: Adding query filter params (role.id=82bd224e8afc480782a85b833a2aa03e, scope.project.id=61ffb079d9e1437084945554bcc0747b, user.id=62fffbcf330a4bc183d0885c175f5a90) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:17.178805 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75ed15c-c83d-4c4f-ad77-cd8c57b13049 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:17.180286 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75ed15c-c83d-4c4f-ad77-cd8c57b13049 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:17.183258 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2be451-1c25-4cd6-a81d-1afeebc9a657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:17.183931 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2be451-1c25-4cd6-a81d-1afeebc9a657 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:17.184213 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2be451-1c25-4cd6-a81d-1afeebc9a657 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:17.184485 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2be451-1c25-4cd6-a81d-1afeebc9a657 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:17.191851 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 377/759] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 05:17:16 2022] GET /identity/v3/role_assignments?user.id=62fffbcf330a4bc183d0885c175f5a90&scope.project.id=61ffb079d9e1437084945554bcc0747b&role.id=82bd224e8afc480782a85b833a2aa03e => generated 259 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:17.201319 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2be451-1c25-4cd6-a81d-1afeebc9a657 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:17.202854 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2be451-1c25-4cd6-a81d-1afeebc9a657 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:17.221997 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-dc2be451-1c25-4cd6-a81d-1afeebc9a657 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 11 05:17:17.221997 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:17.221997 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:17.221997 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:17.221997 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:17.221997 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:17.221997 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:17.221997 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:17.221997 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:17.221997 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:17.221997 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:17.221997 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:17.221997 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 05:17:17.221997 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 05:17:17.221997 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 05:17:17.221997 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 05:17:17.223030 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:17.223030 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:17.223030 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 05:17:17.223030 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 05:17:17.223030 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 05:17:17.223030 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 05:17:17.223030 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:17.223030 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:17.223030 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:17.223030 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:17.223030 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:17.223030 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:17.223030 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:17.223030 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:17.223030 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:17.223030 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:17.223030 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:17.223030 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:17.224535 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:17.224535 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:17.224535 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 05:17:17.224535 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 05:17:17.224535 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 05:17:17.224535 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 05:17:17.224535 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 05:17:17.224535 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 05:17:17.224535 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 11 05:17:17.224535 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:17:17.228111 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 383/760] 10.222.0.16 () {56 vars in 1093 bytes} [Sun Sep 11 05:17:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 05:17:17.232876 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75ed15c-c83d-4c4f-ad77-cd8c57b13049 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:17.378060 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:17.383347 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75ed15c-c83d-4c4f-ad77-cd8c57b13049 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:17.439391 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2b4e89-edad-4eac-83a9-55b45854ae39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:17.440054 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b4e89-edad-4eac-83a9-55b45854ae39 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:17.440331 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b4e89-edad-4eac-83a9-55b45854ae39 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:17.440600 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b4e89-edad-4eac-83a9-55b45854ae39 None admin] PATH_INFO: `/v3/users` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:17.441347 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2b4e89-edad-4eac-83a9-55b45854ae39 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:17.441649 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2b4e89-edad-4eac-83a9-55b45854ae39 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:17.443579 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2b4e89-edad-4eac-83a9-55b45854ae39 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:17.465714 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 378/761] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Sep 11 05:17:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:17.471103 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2be451-1c25-4cd6-a81d-1afeebc9a657 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:17.618635 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:17.629569 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2be451-1c25-4cd6-a81d-1afeebc9a657 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:17.639644 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb356c9-c47b-436d-8c09-411d7f041e00 None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:17.639956 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb356c9-c47b-436d-8c09-411d7f041e00 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:17.640232 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb356c9-c47b-436d-8c09-411d7f041e00 None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:17.641723 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 379/762] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:17:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 05:17:17.647782 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e18f7f2-6999-4e31-8819-e3e6a4a6eff7 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:17.648362 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e18f7f2-6999-4e31-8819-e3e6a4a6eff7 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:17.648840 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e18f7f2-6999-4e31-8819-e3e6a4a6eff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:17.667529 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-3e18f7f2-6999-4e31-8819-e3e6a4a6eff7 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:17:17.669083 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-3e18f7f2-6999-4e31-8819-e3e6a4a6eff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:17:17.687302 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0818968c-61a7-4a0b-b4d7-aaca1275e544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:17.687986 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0818968c-61a7-4a0b-b4d7-aaca1275e544 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:17.688268 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0818968c-61a7-4a0b-b4d7-aaca1275e544 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:17.688541 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0818968c-61a7-4a0b-b4d7-aaca1275e544 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:17.702998 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0818968c-61a7-4a0b-b4d7-aaca1275e544 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:17.704555 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0818968c-61a7-4a0b-b4d7-aaca1275e544 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:17.720341 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-0818968c-61a7-4a0b-b4d7-aaca1275e544 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:17:17.720341 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:17.720341 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:17.720341 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:17.720341 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:17.720341 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:17.720341 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:17.720341 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:17.720341 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:17.720341 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:17.720341 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:17.720341 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:17.720341 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 05:17:17.720341 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 05:17:17.720341 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 05:17:17.720341 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 05:17:17.721371 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:17.721371 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:17.721371 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:17.721371 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:17.721371 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:17.721371 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:17.721371 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:17.721371 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:17.721371 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:17.721371 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:17.721371 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:17.721371 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:17.721371 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:17.721371 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:17.721371 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:17.721371 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:17.721371 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 05:17:17.722952 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 05:17:17.722952 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:17:17.722952 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:17:17.722952 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 384/763] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:17:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:17.722952 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd7bb7-f466-439a-896f-24dca150997e None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:17.723235 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd7bb7-f466-439a-896f-24dca150997e None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:17.723881 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd7bb7-f466-439a-896f-24dca150997e None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:17.725205 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 385/764] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:17:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:17:17.730208 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dd7bb7-f466-439a-896f-24dca150997e None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:17.755873 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 380/765] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:17:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 05:17:17.757234 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55364e6-e5cb-411b-b80d-d68d712aafe0 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:17.757520 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55364e6-e5cb-411b-b80d-d68d712aafe0 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:17.757795 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55364e6-e5cb-411b-b80d-d68d712aafe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:17.790299 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-f55364e6-e5cb-411b-b80d-d68d712aafe0 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:17:17.791866 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-f55364e6-e5cb-411b-b80d-d68d712aafe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:17:17.893539 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 381/766] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:17:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 05:17:18.017325 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dd7bb7-f466-439a-896f-24dca150997e None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:18.047082 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55364e6-e5cb-411b-b80d-d68d712aafe0 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:18.073290 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd48af66-f3e2-42a7-9672-3389d3b6dd9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:18.073907 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48af66-f3e2-42a7-9672-3389d3b6dd9f None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:18.074190 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48af66-f3e2-42a7-9672-3389d3b6dd9f None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:18.074467 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48af66-f3e2-42a7-9672-3389d3b6dd9f None admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:18.075115 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd48af66-f3e2-42a7-9672-3389d3b6dd9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:18.075417 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd48af66-f3e2-42a7-9672-3389d3b6dd9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:18.075819 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:18.076836 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd48af66-f3e2-42a7-9672-3389d3b6dd9f None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:18.101002 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 386/767] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 05:17:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:18.110336 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd48af66-f3e2-42a7-9672-3389d3b6dd9f None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:18.111332 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:18.194502 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55364e6-e5cb-411b-b80d-d68d712aafe0 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:18.232498 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e111292-6ab2-4fc3-b025-d66fdec86f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:18.233145 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e111292-6ab2-4fc3-b025-d66fdec86f04 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:18.233693 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e111292-6ab2-4fc3-b025-d66fdec86f04 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:18.233693 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e111292-6ab2-4fc3-b025-d66fdec86f04 None admin] PATH_INFO: `/v3/services/network` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:18.234256 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e111292-6ab2-4fc3-b025-d66fdec86f04 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:18.235793 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e111292-6ab2-4fc3-b025-d66fdec86f04 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:18.242399 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd48af66-f3e2-42a7-9672-3389d3b6dd9f None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:18.245665 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-0e111292-6ab2-4fc3-b025-d66fdec86f04 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 11 05:17:18.245665 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:18.245665 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 05:17:18.245665 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 05:17:18.245665 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 05:17:18.245665 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 05:17:18.245665 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 05:17:18.245665 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 05:17:18.245665 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 11 05:17:18.245665 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:18.245665 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 05:17:18.245665 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:18.245665 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:18.245665 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:18.245665 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:18.245665 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:18.245665 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:18.246631 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:18.246631 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:18.246631 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:18.246631 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:18.246631 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:18.246631 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:18.246631 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 05:17:18.246631 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 05:17:18.246631 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 05:17:18.246631 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 05:17:18.246631 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:18.246631 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:18.246631 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:18.246631 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:18.246631 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:18.246631 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:18.248343 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:18.248343 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:18.248343 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:18.248343 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:18.248343 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:18.248343 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:18.248343 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:18.248343 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:18.248343 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:18.248343 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:18.248343 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 05:17:18.248343 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 05:17:18.248343 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 11 05:17:18.248343 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:18.248343 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 382/768] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 05:17:18 2022] GET /identity/v3/services/network => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 05:17:18.249145 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c9f79b-3b56-4d6b-a97b-3a57bf7dbe8b None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:18.249145 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c9f79b-3b56-4d6b-a97b-3a57bf7dbe8b None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:18.249145 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c9f79b-3b56-4d6b-a97b-3a57bf7dbe8b None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:18.250022 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 383/769] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:17:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:17:18.250791 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c9f79b-3b56-4d6b-a97b-3a57bf7dbe8b None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:18.285125 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb380f5-8553-4276-9f14-abd09036aec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:18.285951 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb380f5-8553-4276-9f14-abd09036aec8 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:18.286233 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb380f5-8553-4276-9f14-abd09036aec8 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:18.286504 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb380f5-8553-4276-9f14-abd09036aec8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:18.293249 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb380f5-8553-4276-9f14-abd09036aec8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:18.294697 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb380f5-8553-4276-9f14-abd09036aec8 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:18.307347 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-8fb380f5-8553-4276-9f14-abd09036aec8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 05:17:18.307347 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:18.307347 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:18.307347 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:18.307347 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:18.307347 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:18.307347 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:18.307347 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:18.307347 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:18.307347 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:18.307347 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:18.307347 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:18.307347 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 05:17:18.307347 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 05:17:18.307347 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 05:17:18.308426 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 05:17:18.308426 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:18.308426 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:18.308426 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:18.308426 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:18.308426 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:18.308426 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:18.308426 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:18.308426 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:18.308426 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:18.308426 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:18.308426 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:18.308426 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:18.308426 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:18.308426 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:18.308426 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:18.308426 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:18.309361 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 05:17:18.309361 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 05:17:18.309361 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 05:17:18.309361 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 05:17:18.309361 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 05:17:18.309361 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 05:17:18.309361 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 05:17:18.309361 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:17:18.309361 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 387/770] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 05:17:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:18.313767 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb380f5-8553-4276-9f14-abd09036aec8 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:18.342265 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:18.365842 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c9f79b-3b56-4d6b-a97b-3a57bf7dbe8b None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:18.378573 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:18.403630 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62f401a-1999-406a-98ea-039a1daef6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:18.404364 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f401a-1999-406a-98ea-039a1daef6ee None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:18.404730 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f401a-1999-406a-98ea-039a1daef6ee None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:18.404906 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f401a-1999-406a-98ea-039a1daef6ee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:18.415728 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62f401a-1999-406a-98ea-039a1daef6ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:17:18.420410 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-d62f401a-1999-406a-98ea-039a1daef6ee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 05:17:18.420410 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:18.420410 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:18.420410 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:18.420410 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:18.420410 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:18.420410 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:18.420410 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:18.420410 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:18.420410 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:18.420410 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:18.420410 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:18.420410 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:17:18.420410 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:17:18.420410 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:17:18.420410 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:17:18.421343 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:17:18.421343 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:17:18.421343 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:17:18.421343 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:17:18.421343 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:18.421343 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:18.421343 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:18.421343 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:18.421343 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:18.421343 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:18.421343 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:18.421343 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:18.421343 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:18.421343 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:18.421343 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:18.421343 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:18.422214 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:18.422214 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:18.422214 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:18.422214 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:18.422214 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:17:18.422214 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:17:18.422214 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:17:18.422214 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:17:18.422214 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:17:18.422214 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:17:18.422214 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 05:17:18.422214 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:18.422871 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb380f5-8553-4276-9f14-abd09036aec8 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:18.422948 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 384/771] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 05:17:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:18.423350 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e074741-3a43-485f-aea7-7b00b19787ed None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:18.423350 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e074741-3a43-485f-aea7-7b00b19787ed None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:18.423734 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e074741-3a43-485f-aea7-7b00b19787ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:18.441805 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-2e074741-3a43-485f-aea7-7b00b19787ed None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:17:18.443070 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-2e074741-3a43-485f-aea7-7b00b19787ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:17:18.459337 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d1db52-eaf6-4ecb-bee7-a08aecf2e8b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:18.459911 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d1db52-eaf6-4ecb-bee7-a08aecf2e8b1 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:18.460191 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d1db52-eaf6-4ecb-bee7-a08aecf2e8b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:18.460464 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d1db52-eaf6-4ecb-bee7-a08aecf2e8b1 None admin] PATH_INFO: `/v3/services` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:18.461090 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d1db52-eaf6-4ecb-bee7-a08aecf2e8b1 None admin] RBAC: Adding query filter params (name=network) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:18.461397 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d1db52-eaf6-4ecb-bee7-a08aecf2e8b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:18.462757 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d1db52-eaf6-4ecb-bee7-a08aecf2e8b1 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:18.471617 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 388/772] 10.222.0.16 () {56 vars in 1112 bytes} [Sun Sep 11 05:17:18 2022] GET /identity/v3/services?name=network => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:18.471617 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d1db52-eaf6-4ecb-bee7-a08aecf2e8b1 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:18.524175 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 385/773] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:17:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 05:17:18.525248 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e074741-3a43-485f-aea7-7b00b19787ed None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:18.573370 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d1db52-eaf6-4ecb-bee7-a08aecf2e8b1 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:18.599964 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:18.616364 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e609cdb-dccb-4c0d-af3c-a1ed7a8a1d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:18.617349 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:18.619288 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e609cdb-dccb-4c0d-af3c-a1ed7a8a1d16 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:18.619804 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e609cdb-dccb-4c0d-af3c-a1ed7a8a1d16 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:18.620311 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e609cdb-dccb-4c0d-af3c-a1ed7a8a1d16 None admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:18.621408 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e609cdb-dccb-4c0d-af3c-a1ed7a8a1d16 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:18.622020 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e609cdb-dccb-4c0d-af3c-a1ed7a8a1d16 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:18.624954 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e609cdb-dccb-4c0d-af3c-a1ed7a8a1d16 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:18.643612 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 389/774] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 05:17:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:18.645471 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e609cdb-dccb-4c0d-af3c-a1ed7a8a1d16 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:18.656327 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e074741-3a43-485f-aea7-7b00b19787ed None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:18.693386 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5925e162-cc4d-4877-b398-2183e35374ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:18.693999 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925e162-cc4d-4877-b398-2183e35374ad None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:18.694281 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925e162-cc4d-4877-b398-2183e35374ad None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:18.694555 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925e162-cc4d-4877-b398-2183e35374ad None admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:18.695711 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5925e162-cc4d-4877-b398-2183e35374ad None admin] RBAC: Adding query filter params (name=admin) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:18.695711 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5925e162-cc4d-4877-b398-2183e35374ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:18.696924 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5925e162-cc4d-4877-b398-2183e35374ad None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:18.705601 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 386/775] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 05:17:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:18.706404 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5925e162-cc4d-4877-b398-2183e35374ad None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:18.777320 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e609cdb-dccb-4c0d-af3c-a1ed7a8a1d16 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:18.822455 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0288a567-2149-4c01-98be-4429e41a2a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:18.823318 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0288a567-2149-4c01-98be-4429e41a2a51 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:18.823601 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0288a567-2149-4c01-98be-4429e41a2a51 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:18.824331 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0288a567-2149-4c01-98be-4429e41a2a51 None admin] PATH_INFO: `/v3/services` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:18.825240 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0288a567-2149-4c01-98be-4429e41a2a51 None admin] RBAC: Adding query filter params (type=network) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:18.825550 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0288a567-2149-4c01-98be-4429e41a2a51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:18.826691 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5925e162-cc4d-4877-b398-2183e35374ad None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:18.826937 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0288a567-2149-4c01-98be-4429e41a2a51 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:18.833247 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 390/776] 10.222.0.16 () {56 vars in 1112 bytes} [Sun Sep 11 05:17:18 2022] GET /identity/v3/services?type=network => generated 350 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:18.836599 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0288a567-2149-4c01-98be-4429e41a2a51 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:18.862507 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:18.868678 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3b1a84-71f8-4c5a-9b91-730ea590f9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:18.869529 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3b1a84-71f8-4c5a-9b91-730ea590f9b1 None admin] REQUEST_METHOD: `PUT` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:18.869666 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3b1a84-71f8-4c5a-9b91-730ea590f9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:18.869863 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3b1a84-71f8-4c5a-9b91-730ea590f9b1 None admin] PATH_INFO: `/v3/projects/61ffb079d9e1437084945554bcc0747b/users/6cd6136036bd467c946cae90d5c29263/roles/5b702713e40145b49e0b42abd0a5fba9` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:18.871794 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3b1a84-71f8-4c5a-9b91-730ea590f9b1 None admin] RBAC: Authorizing `identity:create_grant(project_id=61ffb079d9e1437084945554bcc0747b, user_id=6cd6136036bd467c946cae90d5c29263, role_id=5b702713e40145b49e0b42abd0a5fba9)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:18.873222 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3b1a84-71f8-4c5a-9b91-730ea590f9b1 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:18.888028 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 387/777] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 11 05:17:18 2022] PUT /identity/v3/projects/61ffb079d9e1437084945554bcc0747b/users/6cd6136036bd467c946cae90d5c29263/roles/5b702713e40145b49e0b42abd0a5fba9 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:17:18.889072 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3b1a84-71f8-4c5a-9b91-730ea590f9b1 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:18.905423 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:18.960866 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0288a567-2149-4c01-98be-4429e41a2a51 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:19.013429 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d741a69-a157-4074-b9b5-72888883f7bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:19.014420 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d741a69-a157-4074-b9b5-72888883f7bb None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:19.014762 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d741a69-a157-4074-b9b5-72888883f7bb None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:19.015470 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d741a69-a157-4074-b9b5-72888883f7bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:19.022231 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3b1a84-71f8-4c5a-9b91-730ea590f9b1 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:19.030272 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d741a69-a157-4074-b9b5-72888883f7bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:19.032319 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d741a69-a157-4074-b9b5-72888883f7bb None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:19.051802 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-3d741a69-a157-4074-b9b5-72888883f7bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:17:19.051802 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:19.051802 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:19.051802 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:19.051802 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:19.051802 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:19.051802 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:19.051802 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:19.051802 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:19.051802 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:19.051802 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:19.051802 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:19.051802 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 05:17:19.051802 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 05:17:19.051802 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 05:17:19.051802 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 05:17:19.053373 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:19.053373 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:19.053373 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:19.053373 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:19.053373 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:19.053373 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:19.053373 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:19.053373 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:19.053373 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:19.053373 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:19.053373 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:19.053373 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:19.053373 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:19.053373 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:19.053373 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:19.053373 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:19.053373 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 05:17:19.054357 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 05:17:19.054357 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:17:19.054357 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:17:19.054357 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 391/778] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:17:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:19.055027 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d741a69-a157-4074-b9b5-72888883f7bb None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:19.067209 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5acd242-92da-4f8c-9d61-b76f091f1b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:19.067994 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5acd242-92da-4f8c-9d61-b76f091f1b54 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:19.068278 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5acd242-92da-4f8c-9d61-b76f091f1b54 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:19.068553 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5acd242-92da-4f8c-9d61-b76f091f1b54 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:19.069168 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5acd242-92da-4f8c-9d61-b76f091f1b54 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:19.070547 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5acd242-92da-4f8c-9d61-b76f091f1b54 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:19.080152 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-a5acd242-92da-4f8c-9d61-b76f091f1b54 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 11 05:17:19.080152 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:19.080152 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 05:17:19.080152 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 05:17:19.080152 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 05:17:19.080152 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 05:17:19.080152 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 05:17:19.080152 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 05:17:19.080152 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 11 05:17:19.080152 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:19.080152 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 05:17:19.080152 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:19.080152 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:19.080152 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:19.080152 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:19.080152 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:19.080152 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:19.081251 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:19.081251 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:19.081251 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:19.081251 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:19.081251 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:19.081251 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:19.081251 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 05:17:19.081251 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 05:17:19.081251 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 05:17:19.081251 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 05:17:19.081251 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:19.081251 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:19.081251 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:19.081251 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:19.081251 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:19.081251 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:19.082116 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:19.082116 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:19.082116 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:19.082116 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:19.082116 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:19.082116 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:19.082116 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:19.082116 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:19.082116 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:19.082116 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:19.082116 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 05:17:19.082116 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 05:17:19.082116 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 11 05:17:19.082116 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:19.086283 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 388/779] 10.222.0.16 () {56 vars in 1129 bytes} [Sun Sep 11 05:17:18 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:19.087212 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5acd242-92da-4f8c-9d61-b76f091f1b54 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:19.154990 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:19.180429 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d741a69-a157-4074-b9b5-72888883f7bb None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:19.183188 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:19.219151 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5acd242-92da-4f8c-9d61-b76f091f1b54 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:19.220959 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56e8416-36b2-4760-abdd-d99103d4d267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:19.222045 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e8416-36b2-4760-abdd-d99103d4d267 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:19.222764 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e8416-36b2-4760-abdd-d99103d4d267 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:19.223456 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e8416-36b2-4760-abdd-d99103d4d267 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:19.224542 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56e8416-36b2-4760-abdd-d99103d4d267 None admin] RBAC: Adding query filter params (interface=public, service_id=9d202782e5d04a7b9fd7f2b8608e07ce, region_id=RegionOne) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:19.225065 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56e8416-36b2-4760-abdd-d99103d4d267 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:19.226676 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56e8416-36b2-4760-abdd-d99103d4d267 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:19.235395 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 392/780] 10.222.0.16 () {56 vars in 1251 bytes} [Sun Sep 11 05:17:19 2022] GET /identity/v3/endpoints?service_id=9d202782e5d04a7b9fd7f2b8608e07ce&interface=public®ion_id=RegionOne => generated 194 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:19.236848 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56e8416-36b2-4760-abdd-d99103d4d267 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:19.260043 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba752265-6077-43a4-935d-63206a014756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:19.260709 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba752265-6077-43a4-935d-63206a014756 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:19.260933 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba752265-6077-43a4-935d-63206a014756 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:19.261208 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba752265-6077-43a4-935d-63206a014756 None admin] PATH_INFO: `/v3/domains` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:19.262013 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba752265-6077-43a4-935d-63206a014756 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:19.262326 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba752265-6077-43a4-935d-63206a014756 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:19.264061 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba752265-6077-43a4-935d-63206a014756 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:19.280268 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 389/781] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 05:17:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:19.281185 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba752265-6077-43a4-935d-63206a014756 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:19.371557 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56e8416-36b2-4760-abdd-d99103d4d267 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:19.406180 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba752265-6077-43a4-935d-63206a014756 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:19.410170 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54c2f48-c665-40a2-ba55-108e0e75b7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:19.410795 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c2f48-c665-40a2-ba55-108e0e75b7c6 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:19.411074 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c2f48-c665-40a2-ba55-108e0e75b7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:19.411349 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c2f48-c665-40a2-ba55-108e0e75b7c6 None admin] PATH_INFO: `/v3/services` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:19.412048 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54c2f48-c665-40a2-ba55-108e0e75b7c6 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:19.412352 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54c2f48-c665-40a2-ba55-108e0e75b7c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:19.413733 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54c2f48-c665-40a2-ba55-108e0e75b7c6 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:19.423708 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 393/782] 10.222.0.16 () {56 vars in 1124 bytes} [Sun Sep 11 05:17:19 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:19.424904 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54c2f48-c665-40a2-ba55-108e0e75b7c6 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:19.426819 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:19.449797 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcf94d4-59b9-4ea6-afa8-a8be6f67194c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:19.450796 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf94d4-59b9-4ea6-afa8-a8be6f67194c None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:19.451405 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf94d4-59b9-4ea6-afa8-a8be6f67194c None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:19.451934 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf94d4-59b9-4ea6-afa8-a8be6f67194c None admin] PATH_INFO: `/v3/services` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:19.452756 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcf94d4-59b9-4ea6-afa8-a8be6f67194c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:19.454498 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcf94d4-59b9-4ea6-afa8-a8be6f67194c None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:19.460599 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:19.462649 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 390/783] 10.222.0.16 () {56 vars in 1087 bytes} [Sun Sep 11 05:17:19 2022] GET /identity/v3/services => generated 772 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:19.463900 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcf94d4-59b9-4ea6-afa8-a8be6f67194c None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:19.569257 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54c2f48-c665-40a2-ba55-108e0e75b7c6 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:19.641644 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c039587-1046-4375-8881-9cd6234e22e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:19.642298 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c039587-1046-4375-8881-9cd6234e22e9 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:19.642574 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c039587-1046-4375-8881-9cd6234e22e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:19.642843 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c039587-1046-4375-8881-9cd6234e22e9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:19.648941 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcf94d4-59b9-4ea6-afa8-a8be6f67194c None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:19.660048 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c039587-1046-4375-8881-9cd6234e22e9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:19.662119 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c039587-1046-4375-8881-9cd6234e22e9 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:19.681122 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-4c039587-1046-4375-8881-9cd6234e22e9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 11 05:17:19.681122 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:19.681122 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:19.681122 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:19.681122 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:19.681122 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:19.681122 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:19.681122 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:19.681122 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:19.681122 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:19.681122 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:19.681122 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:19.681122 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 05:17:19.681122 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 05:17:19.681122 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 05:17:19.681122 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 05:17:19.682155 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:19.682155 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:19.682155 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 05:17:19.682155 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 05:17:19.682155 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 05:17:19.682155 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 05:17:19.682155 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:19.682155 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:19.682155 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:19.682155 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:19.682155 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:19.682155 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:19.682155 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:19.682155 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:19.682155 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:19.682155 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:19.682155 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:19.682155 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:19.683112 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:19.683112 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:19.683112 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 05:17:19.683112 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 05:17:19.683112 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 05:17:19.683112 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 05:17:19.683112 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 05:17:19.683112 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 05:17:19.683112 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 11 05:17:19.683112 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:17:19.683735 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 394/784] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 05:17:19 2022] GET /identity/v3/users/swift => generated 83 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:19.690176 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c039587-1046-4375-8881-9cd6234e22e9 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:19.719861 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a4f111-32f0-4781-9802-0c9fc89a492d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:19.720842 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4f111-32f0-4781-9802-0c9fc89a492d None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:19.721194 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4f111-32f0-4781-9802-0c9fc89a492d None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:19.721539 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4f111-32f0-4781-9802-0c9fc89a492d None admin] PATH_INFO: `/v3/services` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:19.722248 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a4f111-32f0-4781-9802-0c9fc89a492d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:19.722625 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a4f111-32f0-4781-9802-0c9fc89a492d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:19.724212 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a4f111-32f0-4781-9802-0c9fc89a492d None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:19.733147 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 391/785] 10.222.0.16 () {56 vars in 1124 bytes} [Sun Sep 11 05:17:19 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:19.733147 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52c6c7b-b757-4227-aa7c-d1709d64b443 None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:19.733147 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52c6c7b-b757-4227-aa7c-d1709d64b443 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:19.733147 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52c6c7b-b757-4227-aa7c-d1709d64b443 None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:19.734382 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 392/786] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:17:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:17:19.737393 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52c6c7b-b757-4227-aa7c-d1709d64b443 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:19.803292 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:19.808494 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:19.821036 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c039587-1046-4375-8881-9cd6234e22e9 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:19.871125 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c6d240-57c7-40ff-b5e9-6ad266f6d1f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:19.871579 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52c6c7b-b757-4227-aa7c-d1709d64b443 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:19.872194 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c6d240-57c7-40ff-b5e9-6ad266f6d1f6 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:19.872626 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c6d240-57c7-40ff-b5e9-6ad266f6d1f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:19.873316 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c6d240-57c7-40ff-b5e9-6ad266f6d1f6 None admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:19.875095 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c6d240-57c7-40ff-b5e9-6ad266f6d1f6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:19.875558 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c6d240-57c7-40ff-b5e9-6ad266f6d1f6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:19.877230 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c6d240-57c7-40ff-b5e9-6ad266f6d1f6 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:19.897186 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 395/787] 10.222.0.16 () {56 vars in 1135 bytes} [Sun Sep 11 05:17:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:19.901900 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51464841-51ca-475f-b0f0-c3e5877475af None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:19.901900 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51464841-51ca-475f-b0f0-c3e5877475af None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:19.901900 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51464841-51ca-475f-b0f0-c3e5877475af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:19.918663 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-51464841-51ca-475f-b0f0-c3e5877475af None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:17:19.919997 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-51464841-51ca-475f-b0f0-c3e5877475af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:17:19.924572 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f691f787-e601-4436-adb8-6b9f132a8634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:19.925187 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691f787-e601-4436-adb8-6b9f132a8634 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:19.925460 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691f787-e601-4436-adb8-6b9f132a8634 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:19.925726 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691f787-e601-4436-adb8-6b9f132a8634 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:19.926433 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f691f787-e601-4436-adb8-6b9f132a8634 None admin] RBAC: Adding query filter params (interface=public, service_id=712976e2d89c4063972b1e3ee3d67c16, region_id=RegionOne) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:19.926735 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f691f787-e601-4436-adb8-6b9f132a8634 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:19.928672 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f691f787-e601-4436-adb8-6b9f132a8634 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:19.938007 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 393/788] 10.222.0.16 () {56 vars in 1251 bytes} [Sun Sep 11 05:17:19 2022] GET /identity/v3/endpoints?service_id=712976e2d89c4063972b1e3ee3d67c16&interface=public®ion_id=RegionOne => generated 194 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:19.943446 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f691f787-e601-4436-adb8-6b9f132a8634 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:20.019028 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 396/789] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:17:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 05:17:20.020335 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51464841-51ca-475f-b0f0-c3e5877475af None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:20.081529 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f691f787-e601-4436-adb8-6b9f132a8634 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:20.092511 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:20.117701 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:20.132443 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda85869-3fc8-49c3-a737-6cdc800c6ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:20.134009 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda85869-3fc8-49c3-a737-6cdc800c6ca0 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:20.134284 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda85869-3fc8-49c3-a737-6cdc800c6ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:20.134554 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda85869-3fc8-49c3-a737-6cdc800c6ca0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:20.154831 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda85869-3fc8-49c3-a737-6cdc800c6ca0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:20.156321 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda85869-3fc8-49c3-a737-6cdc800c6ca0 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:20.165397 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51464841-51ca-475f-b0f0-c3e5877475af None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:20.182155 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-bda85869-3fc8-49c3-a737-6cdc800c6ca0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:17:20.182155 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:20.182155 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:20.182155 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:20.182155 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:20.182155 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:20.182155 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:20.182155 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:20.182155 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:20.182155 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:20.182155 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:20.182155 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:20.182155 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 05:17:20.182155 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 05:17:20.182155 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 05:17:20.182155 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 05:17:20.183135 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:20.183135 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:20.183135 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:20.183135 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:20.183135 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:20.183135 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:20.183135 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:20.183135 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:20.183135 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:20.183135 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:20.183135 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:20.183135 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:20.183135 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:20.183135 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:20.183135 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:20.183135 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:20.183135 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 05:17:20.184089 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 05:17:20.184089 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:17:20.184089 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:20.186292 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 394/790] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:17:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:20.191866 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda85869-3fc8-49c3-a737-6cdc800c6ca0 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:20.255101 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ec8dd-27c7-41f8-9d12-3f9fdb36e771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:20.256279 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ec8dd-27c7-41f8-9d12-3f9fdb36e771 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:20.256554 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ec8dd-27c7-41f8-9d12-3f9fdb36e771 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:20.256820 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ec8dd-27c7-41f8-9d12-3f9fdb36e771 None admin] PATH_INFO: `/v3/services` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:20.257445 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2ec8dd-27c7-41f8-9d12-3f9fdb36e771 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:20.258875 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2ec8dd-27c7-41f8-9d12-3f9fdb36e771 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:20.270638 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 397/791] 10.222.0.16 () {56 vars in 1087 bytes} [Sun Sep 11 05:17:20 2022] GET /identity/v3/services => generated 772 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:20.306525 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda85869-3fc8-49c3-a737-6cdc800c6ca0 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:20.347780 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1c1add-546f-40bf-81a3-1f95641f36a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:20.348828 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1c1add-546f-40bf-81a3-1f95641f36a2 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:20.349868 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1c1add-546f-40bf-81a3-1f95641f36a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:20.350351 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1c1add-546f-40bf-81a3-1f95641f36a2 None admin] PATH_INFO: `/v3/domains` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:20.351208 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1c1add-546f-40bf-81a3-1f95641f36a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:20.351736 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1c1add-546f-40bf-81a3-1f95641f36a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:20.353343 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1c1add-546f-40bf-81a3-1f95641f36a2 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:20.368508 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 395/792] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 05:17:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:17:20.374496 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ec8dd-27c7-41f8-9d12-3f9fdb36e771 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:20.392301 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1c1add-546f-40bf-81a3-1f95641f36a2 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:20.425518 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:20.534327 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ec8dd-27c7-41f8-9d12-3f9fdb36e771 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:20.545966 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1c1add-546f-40bf-81a3-1f95641f36a2 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:20.585580 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4de4f6-d34b-49b8-bec9-d53478bdce92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:20.586230 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4de4f6-d34b-49b8-bec9-d53478bdce92 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:20.586620 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4de4f6-d34b-49b8-bec9-d53478bdce92 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:20.586900 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4de4f6-d34b-49b8-bec9-d53478bdce92 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:20.592243 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e3d66c-ba65-4c0a-921f-c0c11a505704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:20.592980 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e3d66c-ba65-4c0a-921f-c0c11a505704 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:20.593365 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e3d66c-ba65-4c0a-921f-c0c11a505704 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:20.593745 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e3d66c-ba65-4c0a-921f-c0c11a505704 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:20.595016 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4de4f6-d34b-49b8-bec9-d53478bdce92 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:20.596714 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4de4f6-d34b-49b8-bec9-d53478bdce92 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:20.609291 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-cf4de4f6-d34b-49b8-bec9-d53478bdce92 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 05:17:20.609291 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:20.609291 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:20.609291 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:20.609291 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:20.609291 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:20.609291 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:20.609291 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:20.609291 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:20.609291 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:20.609291 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:20.609291 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:20.609291 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 05:17:20.609291 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 05:17:20.609291 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 05:17:20.610374 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 05:17:20.610374 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:20.610374 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:20.610374 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:20.610374 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:20.610374 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:20.610374 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:20.610374 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:20.610374 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:20.610374 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:20.610374 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:20.610374 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:20.610374 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:20.610374 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:20.610374 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:20.610374 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:20.610374 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:20.611483 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 05:17:20.611483 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 05:17:20.611483 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 05:17:20.611483 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 05:17:20.611483 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 05:17:20.611483 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 05:17:20.611483 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 05:17:20.611483 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:17:20.611483 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 398/793] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 05:17:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:20.617480 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e3d66c-ba65-4c0a-921f-c0c11a505704 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:17:20.620716 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4de4f6-d34b-49b8-bec9-d53478bdce92 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:20.622422 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-d6e3d66c-ba65-4c0a-921f-c0c11a505704 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 05:17:20.622422 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:20.622422 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:20.622422 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:20.622422 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:20.622422 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:20.622422 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:20.622422 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:20.622422 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:20.622422 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:20.622422 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:20.622422 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:20.622422 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:17:20.622422 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:17:20.622422 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:17:20.622422 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:17:20.623566 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:17:20.623566 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:17:20.623566 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:17:20.623566 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:17:20.623566 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:20.623566 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:20.623566 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:20.623566 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:20.623566 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:20.623566 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:20.623566 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:20.623566 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:20.623566 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:20.623566 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:20.623566 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:20.623566 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:20.624671 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:20.624671 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:20.624671 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:20.624671 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:20.624671 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:17:20.624671 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:17:20.624671 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:17:20.624671 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:17:20.624671 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:17:20.624671 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:17:20.624671 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 05:17:20.624671 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:20.627789 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 396/794] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 11 05:17:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:20.629632 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e3d66c-ba65-4c0a-921f-c0c11a505704 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:20.630502 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:20.768028 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:20.805420 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e3d66c-ba65-4c0a-921f-c0c11a505704 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:20.824333 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4de4f6-d34b-49b8-bec9-d53478bdce92 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:20.876071 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9f9e66-bd3e-43e5-a515-522d1e918a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:20.876628 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f9e66-bd3e-43e5-a515-522d1e918a5b None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:20.876910 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f9e66-bd3e-43e5-a515-522d1e918a5b None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:20.877182 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f9e66-bd3e-43e5-a515-522d1e918a5b None admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:20.877879 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9f9e66-bd3e-43e5-a515-522d1e918a5b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:20.878182 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9f9e66-bd3e-43e5-a515-522d1e918a5b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:20.879636 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28100092-f41b-4be1-9bfb-93fd40f8fb11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:20.879782 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9f9e66-bd3e-43e5-a515-522d1e918a5b None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:20.880785 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28100092-f41b-4be1-9bfb-93fd40f8fb11 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:20.881071 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28100092-f41b-4be1-9bfb-93fd40f8fb11 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:20.881341 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28100092-f41b-4be1-9bfb-93fd40f8fb11 None admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:20.882206 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28100092-f41b-4be1-9bfb-93fd40f8fb11 None admin] RBAC: Adding query filter params (name=service) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:20.882507 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28100092-f41b-4be1-9bfb-93fd40f8fb11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:20.884351 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28100092-f41b-4be1-9bfb-93fd40f8fb11 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:20.899524 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 399/795] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 05:17:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:20.903433 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 397/796] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 11 05:17:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:20.905286 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9f9e66-bd3e-43e5-a515-522d1e918a5b None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:20.912206 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28100092-f41b-4be1-9bfb-93fd40f8fb11 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:21.016052 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:21.126185 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9f9e66-bd3e-43e5-a515-522d1e918a5b None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:21.185759 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28100092-f41b-4be1-9bfb-93fd40f8fb11 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:21.205803 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22f642a-2c05-4dc9-bd97-02531d23f629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:21.206479 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f642a-2c05-4dc9-bd97-02531d23f629 None admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:21.206757 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f642a-2c05-4dc9-bd97-02531d23f629 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:21.207030 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f642a-2c05-4dc9-bd97-02531d23f629 None admin] PATH_INFO: `/v3/projects/61ffb079d9e1437084945554bcc0747b/users/2bbe4555380345e485572d2da8b78be1/roles/5b702713e40145b49e0b42abd0a5fba9` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:21.214761 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22f642a-2c05-4dc9-bd97-02531d23f629 None admin] RBAC: Authorizing `identity:create_grant(project_id=61ffb079d9e1437084945554bcc0747b, user_id=2bbe4555380345e485572d2da8b78be1, role_id=5b702713e40145b49e0b42abd0a5fba9)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:21.216852 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22f642a-2c05-4dc9-bd97-02531d23f629 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:21.241458 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 400/797] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 11 05:17:20 2022] PUT /identity/v3/projects/61ffb079d9e1437084945554bcc0747b/users/2bbe4555380345e485572d2da8b78be1/roles/5b702713e40145b49e0b42abd0a5fba9 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:17:21.246641 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149d9cff-be3c-43e5-bf52-58687f414fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:21.247382 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d9cff-be3c-43e5-bf52-58687f414fe3 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:21.247770 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d9cff-be3c-43e5-bf52-58687f414fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:21.248053 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d9cff-be3c-43e5-bf52-58687f414fe3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:21.268449 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149d9cff-be3c-43e5-bf52-58687f414fe3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:21.270013 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149d9cff-be3c-43e5-bf52-58687f414fe3 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:21.272672 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:21.289628 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-149d9cff-be3c-43e5-bf52-58687f414fe3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:17:21.289628 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:21.289628 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:21.289628 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:21.289628 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:21.289628 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:21.289628 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:21.289628 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:21.289628 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:21.289628 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:21.289628 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:21.289628 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:21.289628 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 05:17:21.289628 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 05:17:21.289628 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 05:17:21.289628 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 05:17:21.290653 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:21.290653 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:21.290653 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:21.290653 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:21.290653 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:21.290653 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:21.290653 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:21.290653 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:21.290653 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:21.290653 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:21.290653 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:21.290653 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:21.290653 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:21.290653 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:21.290653 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:21.290653 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:21.290653 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 05:17:21.291567 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 05:17:21.291567 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:17:21.291567 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:21.291567 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 398/798] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:17:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 380 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:21.297056 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22f642a-2c05-4dc9-bd97-02531d23f629 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:21.436738 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22f642a-2c05-4dc9-bd97-02531d23f629 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:21.444216 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b5d011-8f5a-4593-8ddf-0cc8a2f32160 None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:21.444831 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b5d011-8f5a-4593-8ddf-0cc8a2f32160 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:21.444831 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b5d011-8f5a-4593-8ddf-0cc8a2f32160 None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:21.446395 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 399/799] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:17:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:17:21.461596 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:21.465286 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e5ab0-b2d4-462c-879c-97c777b911c1 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:21.465569 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e5ab0-b2d4-462c-879c-97c777b911c1 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:21.465846 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e5ab0-b2d4-462c-879c-97c777b911c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:21.473728 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6311adcc-6aaf-4122-93f9-e57af50a7c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:21.474447 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6311adcc-6aaf-4122-93f9-e57af50a7c3e None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:21.474728 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6311adcc-6aaf-4122-93f9-e57af50a7c3e None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:21.474996 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6311adcc-6aaf-4122-93f9-e57af50a7c3e None admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:21.475643 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6311adcc-6aaf-4122-93f9-e57af50a7c3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:21.475968 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6311adcc-6aaf-4122-93f9-e57af50a7c3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:21.477350 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6311adcc-6aaf-4122-93f9-e57af50a7c3e None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:21.487415 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-6e0e5ab0-b2d4-462c-879c-97c777b911c1 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:17:21.489016 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-6e0e5ab0-b2d4-462c-879c-97c777b911c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:17:21.491611 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 401/800] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 05:17:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:17:21.496414 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6311adcc-6aaf-4122-93f9-e57af50a7c3e None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:21.566876 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 400/801] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:17:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 05:17:21.601332 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6311adcc-6aaf-4122-93f9-e57af50a7c3e None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:21.636123 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730f010b-216f-46b5-9035-9efe009632da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:21.636753 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730f010b-216f-46b5-9035-9efe009632da None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:21.637029 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730f010b-216f-46b5-9035-9efe009632da None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:21.637297 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730f010b-216f-46b5-9035-9efe009632da None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:21.644311 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730f010b-216f-46b5-9035-9efe009632da None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:21.645754 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730f010b-216f-46b5-9035-9efe009632da None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:21.657380 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-730f010b-216f-46b5-9035-9efe009632da None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 11 05:17:21.657380 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:21.657380 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:21.657380 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:21.657380 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:21.657380 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:21.657380 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:21.657380 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:21.657380 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:21.657380 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:21.657380 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:21.657380 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:21.657380 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 05:17:21.657380 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 05:17:21.657380 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 05:17:21.657380 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 05:17:21.659537 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:21.659537 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:21.659537 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 05:17:21.659537 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 05:17:21.659537 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 05:17:21.659537 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 05:17:21.659537 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:21.659537 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:21.659537 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:21.659537 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:21.659537 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:21.659537 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:21.659537 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:21.659537 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:21.659537 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:21.659537 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:21.659537 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:21.659537 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:21.662338 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:21.662338 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:21.662338 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 05:17:21.662338 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 05:17:21.662338 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 05:17:21.662338 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 05:17:21.662338 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 05:17:21.662338 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 05:17:21.662338 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 11 05:17:21.662338 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:17:21.663720 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 402/802] 10.222.0.16 () {56 vars in 1117 bytes} [Sun Sep 11 05:17:21 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 05:17:21.667723 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0e5ab0-b2d4-462c-879c-97c777b911c1 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:21.800855 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0e5ab0-b2d4-462c-879c-97c777b911c1 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:21.835274 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:21.852355 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e6ca66-be22-4895-b90d-a5eba682a9df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:21.852967 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e6ca66-be22-4895-b90d-a5eba682a9df None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:21.853240 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e6ca66-be22-4895-b90d-a5eba682a9df None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:21.853503 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e6ca66-be22-4895-b90d-a5eba682a9df None admin] PATH_INFO: `/v3/users` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:21.854230 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e6ca66-be22-4895-b90d-a5eba682a9df None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:21.854530 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e6ca66-be22-4895-b90d-a5eba682a9df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:21.855977 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e6ca66-be22-4895-b90d-a5eba682a9df None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:21.882723 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 401/803] 10.222.0.16 () {56 vars in 1149 bytes} [Sun Sep 11 05:17:21 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:17:21.888432 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730f010b-216f-46b5-9035-9efe009632da None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:21.947042 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:21.970565 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e6ca66-be22-4895-b90d-a5eba682a9df None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:22.026083 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730f010b-216f-46b5-9035-9efe009632da None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:22.091388 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e27289-a44b-4f23-a2ea-541a853c4a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:22.091966 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e27289-a44b-4f23-a2ea-541a853c4a71 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:22.092238 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e27289-a44b-4f23-a2ea-541a853c4a71 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:22.092508 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e27289-a44b-4f23-a2ea-541a853c4a71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:22.103538 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e27289-a44b-4f23-a2ea-541a853c4a71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:22.105016 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e27289-a44b-4f23-a2ea-541a853c4a71 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:22.120351 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-92e27289-a44b-4f23-a2ea-541a853c4a71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:17:22.120351 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:22.120351 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:22.120351 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:22.120351 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:22.120351 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:22.120351 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:22.120351 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:22.120351 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:22.120351 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:22.120351 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:22.120351 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:22.120351 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 05:17:22.120351 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 05:17:22.120351 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 05:17:22.120351 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 05:17:22.121357 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:22.121357 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:22.121357 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:22.121357 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:22.121357 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:22.121357 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:22.121357 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:22.121357 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:22.121357 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:22.121357 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:22.121357 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:22.121357 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:22.121357 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:22.121357 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:22.121357 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:22.121357 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:22.121357 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 05:17:22.122240 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 05:17:22.122240 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:17:22.122240 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:17:22.122240 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 403/804] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:17:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:22.126977 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e27289-a44b-4f23-a2ea-541a853c4a71 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:22.143411 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e6ca66-be22-4895-b90d-a5eba682a9df None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:22.198142 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cd5fed-59f4-41e6-8463-ab4720c7f9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:22.198811 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cd5fed-59f4-41e6-8463-ab4720c7f9d9 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:22.199082 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cd5fed-59f4-41e6-8463-ab4720c7f9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:22.199344 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cd5fed-59f4-41e6-8463-ab4720c7f9d9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:22.222934 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cd5fed-59f4-41e6-8463-ab4720c7f9d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:17:22.228558 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-92cd5fed-59f4-41e6-8463-ab4720c7f9d9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 05:17:22.228558 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:22.228558 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:22.228558 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:22.228558 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:22.228558 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:22.228558 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:22.228558 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:22.228558 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:22.228558 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:22.228558 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:22.228558 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:22.228558 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:17:22.228558 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:17:22.228558 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:17:22.228558 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:17:22.229505 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:17:22.229505 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:17:22.229505 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:17:22.229505 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:17:22.229505 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:22.229505 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:22.229505 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:22.229505 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:22.229505 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:22.229505 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:22.229505 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:22.229505 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:22.229505 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:22.229505 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:22.229505 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:22.229505 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:22.230346 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:22.230346 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:22.230346 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:22.230346 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:22.230346 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:17:22.230346 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:17:22.230346 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:17:22.230346 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:17:22.230346 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:17:22.230346 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:17:22.230346 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 05:17:22.230346 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:22.230346 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 402/805] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 05:17:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 05:17:22.240757 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cd5fed-59f4-41e6-8463-ab4720c7f9d9 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:22.324054 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:22.325245 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:22.337915 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e27289-a44b-4f23-a2ea-541a853c4a71 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:22.376473 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457e40c0-3de4-445c-87f0-f385884c72af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:22.376959 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e40c0-3de4-445c-87f0-f385884c72af None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:22.377243 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e40c0-3de4-445c-87f0-f385884c72af None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:22.377518 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e40c0-3de4-445c-87f0-f385884c72af None admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:22.378575 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457e40c0-3de4-445c-87f0-f385884c72af None admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:22.378718 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457e40c0-3de4-445c-87f0-f385884c72af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:22.380136 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457e40c0-3de4-445c-87f0-f385884c72af None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:22.387005 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cd5fed-59f4-41e6-8463-ab4720c7f9d9 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:22.395391 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 404/806] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 05:17:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:17:22.397146 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26bf7dc-336f-4752-9898-69a1f7e7743b None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:22.397292 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26bf7dc-336f-4752-9898-69a1f7e7743b None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:22.397511 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26bf7dc-336f-4752-9898-69a1f7e7743b None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:22.403100 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 405/807] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:17:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:17:22.404046 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26bf7dc-336f-4752-9898-69a1f7e7743b None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:22.429891 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f20e008-f384-4296-a7ee-72b94ed6e996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:22.430507 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f20e008-f384-4296-a7ee-72b94ed6e996 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:22.430783 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f20e008-f384-4296-a7ee-72b94ed6e996 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:22.431050 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f20e008-f384-4296-a7ee-72b94ed6e996 None admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:22.431801 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f20e008-f384-4296-a7ee-72b94ed6e996 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:22.432109 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f20e008-f384-4296-a7ee-72b94ed6e996 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:22.433481 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f20e008-f384-4296-a7ee-72b94ed6e996 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:22.443837 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 403/808] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 05:17:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:17:22.447874 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16363594-2a28-48c0-b0ab-4196ba3c4d0f None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:22.447874 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16363594-2a28-48c0-b0ab-4196ba3c4d0f None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:22.447874 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16363594-2a28-48c0-b0ab-4196ba3c4d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:22.466582 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-16363594-2a28-48c0-b0ab-4196ba3c4d0f None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:17:22.467813 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-16363594-2a28-48c0-b0ab-4196ba3c4d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:17:22.550771 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26bf7dc-336f-4752-9898-69a1f7e7743b None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:22.563762 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 404/809] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:17:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 05:17:22.565256 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16363594-2a28-48c0-b0ab-4196ba3c4d0f None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:22.621334 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3233be43-efd6-40fa-bc59-c02b498b2925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:22.623599 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3233be43-efd6-40fa-bc59-c02b498b2925 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:22.625255 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3233be43-efd6-40fa-bc59-c02b498b2925 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:22.625773 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3233be43-efd6-40fa-bc59-c02b498b2925 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:22.633900 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:22.644303 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3233be43-efd6-40fa-bc59-c02b498b2925 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:22.648223 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3233be43-efd6-40fa-bc59-c02b498b2925 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:22.669085 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-3233be43-efd6-40fa-bc59-c02b498b2925 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 05:17:22.669085 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:22.669085 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:22.669085 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:22.669085 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:22.669085 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:22.669085 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:22.669085 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:22.669085 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:22.669085 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:22.669085 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:22.669085 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:22.669085 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 05:17:22.669085 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 05:17:22.669085 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 05:17:22.670109 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 05:17:22.670109 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:22.670109 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:22.670109 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:22.670109 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:22.670109 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:22.670109 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:22.670109 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:22.670109 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:22.670109 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:22.670109 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:22.670109 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:22.670109 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:22.670109 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:22.670109 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:22.670109 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:22.670109 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:22.671018 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 05:17:22.671018 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 05:17:22.671018 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 05:17:22.671018 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 05:17:22.671018 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 05:17:22.671018 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 05:17:22.671018 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 05:17:22.671018 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:17:22.674084 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 406/810] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 05:17:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:22.681378 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3233be43-efd6-40fa-bc59-c02b498b2925 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:22.722708 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:22.744259 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16363594-2a28-48c0-b0ab-4196ba3c4d0f None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:22.783917 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48880561-7528-47d9-8b13-4d9754ac2274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:22.784565 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48880561-7528-47d9-8b13-4d9754ac2274 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:22.784848 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48880561-7528-47d9-8b13-4d9754ac2274 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:22.785121 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48880561-7528-47d9-8b13-4d9754ac2274 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:22.797724 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48880561-7528-47d9-8b13-4d9754ac2274 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:22.799193 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48880561-7528-47d9-8b13-4d9754ac2274 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:22.817538 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-48880561-7528-47d9-8b13-4d9754ac2274 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:17:22.817538 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:22.817538 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:22.817538 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:22.817538 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:22.817538 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:22.817538 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:22.817538 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:22.817538 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:22.817538 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:22.817538 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:22.817538 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:22.817538 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 05:17:22.817538 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 05:17:22.817538 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 05:17:22.817538 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 05:17:22.818609 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:22.818609 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:22.818609 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:22.818609 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:22.818609 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:22.818609 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:22.818609 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:22.818609 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:22.818609 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:22.818609 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:22.818609 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:22.818609 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:22.818609 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:22.818609 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:22.818609 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:22.818609 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:22.818609 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 05:17:22.819493 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 05:17:22.819493 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:17:22.819493 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:22.819493 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 405/811] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:17:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:22.825808 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48880561-7528-47d9-8b13-4d9754ac2274 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:22.890525 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3233be43-efd6-40fa-bc59-c02b498b2925 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:22.922659 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:22.932539 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9840d4-4cf8-47d5-b58b-0772a04237f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:22.933152 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9840d4-4cf8-47d5-b58b-0772a04237f8 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:22.933433 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9840d4-4cf8-47d5-b58b-0772a04237f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:22.933706 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9840d4-4cf8-47d5-b58b-0772a04237f8 None admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:22.934394 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9840d4-4cf8-47d5-b58b-0772a04237f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:22.934757 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9840d4-4cf8-47d5-b58b-0772a04237f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:22.936269 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9840d4-4cf8-47d5-b58b-0772a04237f8 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:22.939996 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48880561-7528-47d9-8b13-4d9754ac2274 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:22.953105 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 407/812] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 05:17:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:22.953105 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ede40a-0b98-49c5-aa05-d327ef150701 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:22.953105 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ede40a-0b98-49c5-aa05-d327ef150701 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:22.953105 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ede40a-0b98-49c5-aa05-d327ef150701 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:22.953105 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 408/813] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:17:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:17:22.953105 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ede40a-0b98-49c5-aa05-d327ef150701 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:22.980385 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769bb72d-5e7d-4855-8d82-99da4970ec9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:22.980984 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769bb72d-5e7d-4855-8d82-99da4970ec9a None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:22.981257 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769bb72d-5e7d-4855-8d82-99da4970ec9a None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:22.981522 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769bb72d-5e7d-4855-8d82-99da4970ec9a None admin] PATH_INFO: `/v3/domains` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:22.982150 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769bb72d-5e7d-4855-8d82-99da4970ec9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:22.982448 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769bb72d-5e7d-4855-8d82-99da4970ec9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:22.983845 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769bb72d-5e7d-4855-8d82-99da4970ec9a None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:23.000884 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 406/814] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 05:17:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:23.001700 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769bb72d-5e7d-4855-8d82-99da4970ec9a None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:23.034974 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:23.063497 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ede40a-0b98-49c5-aa05-d327ef150701 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:23.098748 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ecb7fd-3c23-4002-8933-1608e6449c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:23.099929 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ecb7fd-3c23-4002-8933-1608e6449c28 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:23.100220 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ecb7fd-3c23-4002-8933-1608e6449c28 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:23.100478 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ecb7fd-3c23-4002-8933-1608e6449c28 None admin] PATH_INFO: `/v3/services/network` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:23.101045 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ecb7fd-3c23-4002-8933-1608e6449c28 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:23.102410 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ecb7fd-3c23-4002-8933-1608e6449c28 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:23.106393 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769bb72d-5e7d-4855-8d82-99da4970ec9a None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:23.111077 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-82ecb7fd-3c23-4002-8933-1608e6449c28 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 11 05:17:23.111077 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:23.111077 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 05:17:23.111077 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 05:17:23.111077 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 05:17:23.111077 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 05:17:23.111077 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 05:17:23.111077 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 05:17:23.111077 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 11 05:17:23.111077 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:17:23.111077 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 05:17:23.111077 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:17:23.111077 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:23.111077 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:23.111077 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:23.111077 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:23.111077 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:23.112296 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:23.112296 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:23.112296 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:23.112296 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:23.112296 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:23.112296 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:23.112296 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 05:17:23.112296 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 05:17:23.112296 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 05:17:23.112296 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 05:17:23.112296 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:23.112296 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:23.112296 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:23.112296 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:23.112296 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:23.112296 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:23.113644 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:23.113644 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:23.113644 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:23.113644 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:23.113644 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:23.113644 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:23.113644 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:23.113644 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:23.113644 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:23.113644 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:23.113644 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 05:17:23.113644 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 05:17:23.113644 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 11 05:17:23.113644 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:17:23.113644 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 409/815] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 05:17:22 2022] GET /identity/v3/services/network => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:23.114448 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af00a175-1099-4dfe-8426-eeae2dc893fb None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:23.114448 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af00a175-1099-4dfe-8426-eeae2dc893fb None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:23.114448 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af00a175-1099-4dfe-8426-eeae2dc893fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:23.132835 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-af00a175-1099-4dfe-8426-eeae2dc893fb None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:17:23.134025 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-af00a175-1099-4dfe-8426-eeae2dc893fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:17:23.150592 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946fd4b4-841e-4e78-8ae8-b31bb41e0dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:23.151519 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946fd4b4-841e-4e78-8ae8-b31bb41e0dc6 None admin] REQUEST_METHOD: `PUT` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:23.151834 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946fd4b4-841e-4e78-8ae8-b31bb41e0dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:23.152387 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946fd4b4-841e-4e78-8ae8-b31bb41e0dc6 None admin] PATH_INFO: `/v3/projects/61ffb079d9e1437084945554bcc0747b/users/62fffbcf330a4bc183d0885c175f5a90/roles/82bd224e8afc480782a85b833a2aa03e` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:23.168511 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946fd4b4-841e-4e78-8ae8-b31bb41e0dc6 None admin] RBAC: Authorizing `identity:create_grant(project_id=61ffb079d9e1437084945554bcc0747b, user_id=62fffbcf330a4bc183d0885c175f5a90, role_id=82bd224e8afc480782a85b833a2aa03e)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:23.170233 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946fd4b4-841e-4e78-8ae8-b31bb41e0dc6 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:23.173754 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:23.191786 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 407/816] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 11 05:17:23 2022] PUT /identity/v3/projects/61ffb079d9e1437084945554bcc0747b/users/62fffbcf330a4bc183d0885c175f5a90/roles/82bd224e8afc480782a85b833a2aa03e => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:17:23.193704 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946fd4b4-841e-4e78-8ae8-b31bb41e0dc6 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:23.223857 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 410/817] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:17:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 05:17:23.227127 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af00a175-1099-4dfe-8426-eeae2dc893fb None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:23.371288 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:23.396351 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946fd4b4-841e-4e78-8ae8-b31bb41e0dc6 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:23.419096 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af00a175-1099-4dfe-8426-eeae2dc893fb None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:23.443939 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eb6fe3-6cb4-4ebe-aadc-6e24911523c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:23.444581 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb6fe3-6cb4-4ebe-aadc-6e24911523c6 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:23.444858 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb6fe3-6cb4-4ebe-aadc-6e24911523c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:23.445129 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb6fe3-6cb4-4ebe-aadc-6e24911523c6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:23.455210 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eb6fe3-6cb4-4ebe-aadc-6e24911523c6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:23.457603 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eb6fe3-6cb4-4ebe-aadc-6e24911523c6 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:23.464285 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a76fb80-be46-40a6-a86f-d8a34c972509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:23.465174 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a76fb80-be46-40a6-a86f-d8a34c972509 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:23.465645 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a76fb80-be46-40a6-a86f-d8a34c972509 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:23.466104 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a76fb80-be46-40a6-a86f-d8a34c972509 None admin] PATH_INFO: `/v3/services` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:23.466924 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a76fb80-be46-40a6-a86f-d8a34c972509 None admin] RBAC: Adding query filter params (name=network) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:23.467418 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a76fb80-be46-40a6-a86f-d8a34c972509 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:23.469031 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a76fb80-be46-40a6-a86f-d8a34c972509 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:23.471900 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-82eb6fe3-6cb4-4ebe-aadc-6e24911523c6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 11 05:17:23.471900 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:23.471900 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:23.471900 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:23.471900 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:23.471900 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:23.471900 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:23.471900 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:23.471900 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:23.471900 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:23.471900 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:23.471900 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:23.471900 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 05:17:23.471900 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 05:17:23.471900 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 05:17:23.471900 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 05:17:23.472857 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:23.472857 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:23.472857 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 05:17:23.472857 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 05:17:23.472857 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 05:17:23.472857 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 05:17:23.472857 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:23.472857 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:23.472857 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:23.472857 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:23.472857 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:23.472857 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:23.472857 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:23.472857 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:23.472857 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:23.472857 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:23.472857 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:23.472857 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:23.474525 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:23.474525 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:23.474525 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 05:17:23.474525 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 05:17:23.474525 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 05:17:23.474525 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 05:17:23.474525 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 05:17:23.474525 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 05:17:23.474525 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 11 05:17:23.474525 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:23.474525 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 408/818] 10.222.0.16 () {56 vars in 1093 bytes} [Sun Sep 11 05:17:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:23.478057 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 411/819] 10.222.0.16 () {56 vars in 1112 bytes} [Sun Sep 11 05:17:23 2022] GET /identity/v3/services?name=network => generated 124 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:23.478797 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eb6fe3-6cb4-4ebe-aadc-6e24911523c6 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:23.484359 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a76fb80-be46-40a6-a86f-d8a34c972509 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:23.547548 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:23.596516 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eb6fe3-6cb4-4ebe-aadc-6e24911523c6 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:23.630513 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a76fb80-be46-40a6-a86f-d8a34c972509 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:23.636234 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd83f6ce-c597-442e-ae26-d38a23b58701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:23.636867 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd83f6ce-c597-442e-ae26-d38a23b58701 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:23.637145 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd83f6ce-c597-442e-ae26-d38a23b58701 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:23.637415 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd83f6ce-c597-442e-ae26-d38a23b58701 None admin] PATH_INFO: `/v3/users` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:23.638150 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd83f6ce-c597-442e-ae26-d38a23b58701 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:23.638562 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd83f6ce-c597-442e-ae26-d38a23b58701 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:23.640045 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd83f6ce-c597-442e-ae26-d38a23b58701 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:23.659822 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 409/820] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Sep 11 05:17:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:17:23.665433 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:23.666535 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd83f6ce-c597-442e-ae26-d38a23b58701 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:23.669518 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecbec65-3dbe-494d-b5c9-f256c580e666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:23.670515 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecbec65-3dbe-494d-b5c9-f256c580e666 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:23.671207 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecbec65-3dbe-494d-b5c9-f256c580e666 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:23.671907 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecbec65-3dbe-494d-b5c9-f256c580e666 None admin] PATH_INFO: `/v3/services` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:23.673456 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecbec65-3dbe-494d-b5c9-f256c580e666 None admin] RBAC: Adding query filter params (type=network) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:23.673456 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecbec65-3dbe-494d-b5c9-f256c580e666 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:23.674595 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecbec65-3dbe-494d-b5c9-f256c580e666 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:23.685110 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 412/821] 10.222.0.16 () {56 vars in 1112 bytes} [Sun Sep 11 05:17:23 2022] GET /identity/v3/services?type=network => generated 350 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:23.685110 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecbec65-3dbe-494d-b5c9-f256c580e666 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:23.778876 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd83f6ce-c597-442e-ae26-d38a23b58701 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:23.791835 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecbec65-3dbe-494d-b5c9-f256c580e666 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:23.795476 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:23.818557 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4af77a6-2995-4692-86eb-431a9180b5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:23.819287 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af77a6-2995-4692-86eb-431a9180b5b5 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:23.819567 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af77a6-2995-4692-86eb-431a9180b5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:23.819882 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af77a6-2995-4692-86eb-431a9180b5b5 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:23.820460 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4af77a6-2995-4692-86eb-431a9180b5b5 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:23.821817 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4af77a6-2995-4692-86eb-431a9180b5b5 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:23.831504 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed64884-8755-4d4d-b03f-d1da4a172662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:23.831662 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-f4af77a6-2995-4692-86eb-431a9180b5b5 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 11 05:17:23.831662 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:23.831662 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 05:17:23.831662 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 05:17:23.831662 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 05:17:23.831662 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 05:17:23.831662 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 05:17:23.831662 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 05:17:23.831662 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 11 05:17:23.831662 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:23.831662 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 05:17:23.831662 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:23.831662 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:23.831662 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:23.831662 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:23.831662 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:23.831662 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:23.832677 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:23.832677 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:23.832677 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:23.832677 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:23.832677 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:23.832677 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:23.832677 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 05:17:23.832677 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 05:17:23.832677 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 05:17:23.832677 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 05:17:23.832677 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:23.832677 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:23.832677 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:23.832677 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:23.832677 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:23.832677 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:23.836830 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:23.836830 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:23.836830 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:23.836830 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:23.836830 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:23.836830 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:23.836830 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:23.836830 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:23.836830 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:23.836830 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:23.836830 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 05:17:23.836830 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 05:17:23.836830 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 11 05:17:23.836830 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:23.837741 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed64884-8755-4d4d-b03f-d1da4a172662 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:23.837741 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed64884-8755-4d4d-b03f-d1da4a172662 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:23.837741 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed64884-8755-4d4d-b03f-d1da4a172662 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:23.837974 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 410/822] 10.222.0.16 () {56 vars in 1129 bytes} [Sun Sep 11 05:17:23 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:23.837974 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4af77a6-2995-4692-86eb-431a9180b5b5 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:23.906505 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:23.915722 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed64884-8755-4d4d-b03f-d1da4a172662 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:23.918019 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed64884-8755-4d4d-b03f-d1da4a172662 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:23.942384 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4af77a6-2995-4692-86eb-431a9180b5b5 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:23.979304 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89719959-702a-4d79-9a9e-d533a66622ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:23.979953 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89719959-702a-4d79-9a9e-d533a66622ab None admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:23.980228 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89719959-702a-4d79-9a9e-d533a66622ab None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:23.980495 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89719959-702a-4d79-9a9e-d533a66622ab None admin] PATH_INFO: `/v3/endpoints` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:23.981151 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89719959-702a-4d79-9a9e-d533a66622ab None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:23.982506 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89719959-702a-4d79-9a9e-d533a66622ab None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:24.009641 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 411/823] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:17:23 2022] POST /identity/v3/endpoints => generated 337 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:17:24.011008 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a81e8-8fb6-452b-91ba-3ef7d70fa1e7 None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:24.011298 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a81e8-8fb6-452b-91ba-3ef7d70fa1e7 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:24.011571 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a81e8-8fb6-452b-91ba-3ef7d70fa1e7 None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:24.017282 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 412/824] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:17:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:17:24.017282 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9a81e8-8fb6-452b-91ba-3ef7d70fa1e7 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:24.053004 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 413/825] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 05:17:23 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 05:17:24.055659 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c14e4-4504-4cbd-a809-93b4334e6935 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:24.056199 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c14e4-4504-4cbd-a809-93b4334e6935 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:24.056955 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c14e4-4504-4cbd-a809-93b4334e6935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:24.062774 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:24.084494 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-7b7c14e4-4504-4cbd-a809-93b4334e6935 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:17:24.086610 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-7b7c14e4-4504-4cbd-a809-93b4334e6935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:17:24.179709 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 414/826] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:17:24 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 05:17:24.179709 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7c14e4-4504-4cbd-a809-93b4334e6935 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:24.193723 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9a81e8-8fb6-452b-91ba-3ef7d70fa1e7 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:24.211107 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:24.235929 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882ccb54-0972-4e75-83cc-d839af382e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:24.236598 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ccb54-0972-4e75-83cc-d839af382e3f None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:24.236879 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ccb54-0972-4e75-83cc-d839af382e3f None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:24.237154 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ccb54-0972-4e75-83cc-d839af382e3f None admin] PATH_INFO: `/v3/services` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:24.238649 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882ccb54-0972-4e75-83cc-d839af382e3f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:24.238959 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882ccb54-0972-4e75-83cc-d839af382e3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:24.241059 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882ccb54-0972-4e75-83cc-d839af382e3f None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:24.246872 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 413/827] 10.222.0.16 () {56 vars in 1124 bytes} [Sun Sep 11 05:17:24 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:24.252490 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882ccb54-0972-4e75-83cc-d839af382e3f None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:24.305374 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7c14e4-4504-4cbd-a809-93b4334e6935 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:24.348462 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9167dd6d-3b69-4daf-81db-9635c6104d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:24.349605 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167dd6d-3b69-4daf-81db-9635c6104d77 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:24.349892 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167dd6d-3b69-4daf-81db-9635c6104d77 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:24.350165 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167dd6d-3b69-4daf-81db-9635c6104d77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:24.365597 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9167dd6d-3b69-4daf-81db-9635c6104d77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:24.369023 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9167dd6d-3b69-4daf-81db-9635c6104d77 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:24.378007 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:24.385123 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882ccb54-0972-4e75-83cc-d839af382e3f None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:24.389062 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-9167dd6d-3b69-4daf-81db-9635c6104d77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:17:24.389062 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:24.389062 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:24.389062 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:24.389062 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:24.389062 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:24.389062 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:24.389062 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:24.389062 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:24.389062 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:24.389062 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:24.389062 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:24.389062 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 05:17:24.389062 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 05:17:24.389062 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 05:17:24.389062 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 05:17:24.389992 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:24.389992 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:24.389992 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:24.389992 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:24.389992 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:24.389992 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:24.389992 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:24.389992 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:24.389992 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:24.389992 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:24.389992 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:24.389992 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:24.389992 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:24.389992 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:24.389992 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:24.389992 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:24.389992 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 05:17:24.390884 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 05:17:24.390884 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:17:24.390884 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:17:24.390884 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 415/828] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:17:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:24.398667 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9167dd6d-3b69-4daf-81db-9635c6104d77 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:24.431996 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bd0c61-ebdc-49a6-93dd-e83200ea91bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:24.432936 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bd0c61-ebdc-49a6-93dd-e83200ea91bc None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:24.433357 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bd0c61-ebdc-49a6-93dd-e83200ea91bc None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:24.433766 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bd0c61-ebdc-49a6-93dd-e83200ea91bc None admin] PATH_INFO: `/v3/services` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:24.434558 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bd0c61-ebdc-49a6-93dd-e83200ea91bc None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:24.435247 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bd0c61-ebdc-49a6-93dd-e83200ea91bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:24.437514 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bd0c61-ebdc-49a6-93dd-e83200ea91bc None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:24.443558 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 414/829] 10.222.0.16 () {56 vars in 1124 bytes} [Sun Sep 11 05:17:24 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:24.449761 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bd0c61-ebdc-49a6-93dd-e83200ea91bc None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:24.496501 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:24.530456 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9167dd6d-3b69-4daf-81db-9635c6104d77 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:24.566326 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bd0c61-ebdc-49a6-93dd-e83200ea91bc None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:24.570414 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93198302-a440-4607-a74a-095b292a2183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:24.571025 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93198302-a440-4607-a74a-095b292a2183 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:24.571302 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93198302-a440-4607-a74a-095b292a2183 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:24.571576 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93198302-a440-4607-a74a-095b292a2183 None admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:24.572254 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93198302-a440-4607-a74a-095b292a2183 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:24.572559 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93198302-a440-4607-a74a-095b292a2183 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:24.573935 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93198302-a440-4607-a74a-095b292a2183 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:24.587322 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 416/830] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 05:17:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:17:24.589068 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93198302-a440-4607-a74a-095b292a2183 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:24.603710 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc0bf25-d6e4-48a7-8479-25758d6eb77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:24.604326 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc0bf25-d6e4-48a7-8479-25758d6eb77e None admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:24.604604 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc0bf25-d6e4-48a7-8479-25758d6eb77e None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:24.604873 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc0bf25-d6e4-48a7-8479-25758d6eb77e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:24.605535 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc0bf25-d6e4-48a7-8479-25758d6eb77e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:24.606893 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc0bf25-d6e4-48a7-8479-25758d6eb77e None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:24.629277 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 415/831] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:17:24 2022] POST /identity/v3/endpoints => generated 346 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 05:17:24.630825 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc0bf25-d6e4-48a7-8479-25758d6eb77e None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:24.660105 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:24.736730 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93198302-a440-4607-a74a-095b292a2183 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:24.777243 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc0bf25-d6e4-48a7-8479-25758d6eb77e None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:24.782462 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ee6aed-557e-43cc-a816-e9e806f72162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:24.783208 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee6aed-557e-43cc-a816-e9e806f72162 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:24.788111 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee6aed-557e-43cc-a816-e9e806f72162 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:24.788412 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee6aed-557e-43cc-a816-e9e806f72162 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:24.790845 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:24.804159 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ee6aed-557e-43cc-a816-e9e806f72162 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:17:24.811450 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-02ee6aed-557e-43cc-a816-e9e806f72162 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 05:17:24.811450 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:24.811450 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:24.811450 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:24.811450 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:24.811450 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:24.811450 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:24.811450 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:24.811450 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:24.811450 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:24.811450 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:24.811450 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:24.811450 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:17:24.811450 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:17:24.811450 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:17:24.811450 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:17:24.812512 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:17:24.812512 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:17:24.812512 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:17:24.812512 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:17:24.812512 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:24.812512 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:24.812512 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:24.812512 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:24.812512 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:24.812512 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:24.812512 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:24.812512 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:24.812512 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:24.812512 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:24.812512 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:24.812512 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:24.813352 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:24.813352 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:24.813352 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:24.813352 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:24.813352 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:17:24.813352 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:17:24.813352 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:17:24.813352 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:17:24.813352 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:17:24.813352 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:17:24.813352 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 05:17:24.813352 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:17:24.813352 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 417/832] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 05:17:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:24.819129 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ee6aed-557e-43cc-a816-e9e806f72162 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:24.833277 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed739e1e-d6e3-42fb-a3b2-956f13fab37e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:24.834542 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed739e1e-d6e3-42fb-a3b2-956f13fab37e None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:24.834817 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed739e1e-d6e3-42fb-a3b2-956f13fab37e None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:24.835406 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed739e1e-d6e3-42fb-a3b2-956f13fab37e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:24.844806 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed739e1e-d6e3-42fb-a3b2-956f13fab37e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:24.846247 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed739e1e-d6e3-42fb-a3b2-956f13fab37e None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:24.858886 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-ed739e1e-d6e3-42fb-a3b2-956f13fab37e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 05:17:24.858886 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:24.858886 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:24.858886 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:24.858886 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:24.858886 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:24.858886 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:24.858886 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:24.858886 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:24.858886 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:24.858886 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:24.858886 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:24.858886 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 05:17:24.858886 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 05:17:24.858886 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 05:17:24.859850 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 05:17:24.859850 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:24.859850 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:24.859850 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:24.859850 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:24.859850 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:24.859850 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:24.859850 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:24.859850 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:24.859850 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:24.859850 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:24.859850 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:24.859850 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:24.859850 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:24.859850 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:24.859850 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:24.859850 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:24.860754 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 05:17:24.860754 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 05:17:24.860754 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 05:17:24.860754 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 05:17:24.860754 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 05:17:24.860754 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 05:17:24.860754 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 05:17:24.860754 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:24.861195 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 416/833] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 05:17:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:24.867170 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed739e1e-d6e3-42fb-a3b2-956f13fab37e None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:24.947413 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:24.950537 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ee6aed-557e-43cc-a816-e9e806f72162 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:24.980658 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed739e1e-d6e3-42fb-a3b2-956f13fab37e None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:24.999341 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f6999f-2743-4655-99d2-0b7ecdb7123a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:25.000209 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f6999f-2743-4655-99d2-0b7ecdb7123a None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:25.000713 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f6999f-2743-4655-99d2-0b7ecdb7123a None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:25.001133 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f6999f-2743-4655-99d2-0b7ecdb7123a None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:25.002511 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f6999f-2743-4655-99d2-0b7ecdb7123a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:25.003273 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f6999f-2743-4655-99d2-0b7ecdb7123a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:25.005835 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f6999f-2743-4655-99d2-0b7ecdb7123a None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:25.017205 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 418/834] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 05:17:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:17:25.021140 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb44b57-e3c0-47b8-8088-4a65a959d7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:25.022067 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb44b57-e3c0-47b8-8088-4a65a959d7b1 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:25.022175 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb44b57-e3c0-47b8-8088-4a65a959d7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:25.022477 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb44b57-e3c0-47b8-8088-4a65a959d7b1 None admin] PATH_INFO: `/v3/projects` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:25.023051 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb44b57-e3c0-47b8-8088-4a65a959d7b1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:25.023358 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb44b57-e3c0-47b8-8088-4a65a959d7b1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:25.024672 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f6999f-2743-4655-99d2-0b7ecdb7123a None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:25.024892 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb44b57-e3c0-47b8-8088-4a65a959d7b1 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:25.037774 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 417/835] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 05:17:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:25.043830 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb44b57-e3c0-47b8-8088-4a65a959d7b1 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:25.089981 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:25.136635 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f6999f-2743-4655-99d2-0b7ecdb7123a None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:25.183108 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb44b57-e3c0-47b8-8088-4a65a959d7b1 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:25.187431 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d9f2e8-b915-4ed9-a342-4a062533d65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:25.188691 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d9f2e8-b915-4ed9-a342-4a062533d65c None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:25.189172 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d9f2e8-b915-4ed9-a342-4a062533d65c None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:25.189642 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d9f2e8-b915-4ed9-a342-4a062533d65c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:25.209445 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d9f2e8-b915-4ed9-a342-4a062533d65c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:25.210919 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d9f2e8-b915-4ed9-a342-4a062533d65c None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:25.219985 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:25.227874 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a06e58-98d4-40cd-90f3-6cd76b454646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:25.228763 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a06e58-98d4-40cd-90f3-6cd76b454646 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:25.228941 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-63d9f2e8-b915-4ed9-a342-4a062533d65c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:17:25.228941 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:25.228941 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:25.228941 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:25.228941 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:25.228941 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:25.228941 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:25.228941 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:25.228941 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:25.228941 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:25.228941 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:25.228941 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:25.228941 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 05:17:25.228941 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 05:17:25.228941 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 05:17:25.228941 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 05:17:25.229852 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:25.229852 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:25.229852 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:25.229852 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:25.229852 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:25.229852 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:25.229852 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:25.229852 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:25.229852 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:25.229852 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:25.229852 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:25.229852 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:25.229852 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:25.229852 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:25.229852 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:25.229852 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:25.229852 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 05:17:25.230730 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 05:17:25.230730 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:17:25.230730 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:17:25.230730 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 419/836] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:17:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:25.230964 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a06e58-98d4-40cd-90f3-6cd76b454646 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:25.230964 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a06e58-98d4-40cd-90f3-6cd76b454646 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:25.236214 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a06e58-98d4-40cd-90f3-6cd76b454646 None admin] RBAC: Adding query filter params (role.id=5b702713e40145b49e0b42abd0a5fba9, scope.project.id=61ffb079d9e1437084945554bcc0747b, user.id=6cd6136036bd467c946cae90d5c29263) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:25.236214 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a06e58-98d4-40cd-90f3-6cd76b454646 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:25.236214 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a06e58-98d4-40cd-90f3-6cd76b454646 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:25.236560 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d9f2e8-b915-4ed9-a342-4a062533d65c None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:25.242272 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 418/837] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 05:17:25 2022] GET /identity/v3/role_assignments?user.id=6cd6136036bd467c946cae90d5c29263&scope.project.id=61ffb079d9e1437084945554bcc0747b&role.id=5b702713e40145b49e0b42abd0a5fba9 => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:17:25.359631 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d9f2e8-b915-4ed9-a342-4a062533d65c None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:25.371152 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:25.398815 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e06169-4b86-44d9-acd3-7c6b22a64627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:25.399438 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e06169-4b86-44d9-acd3-7c6b22a64627 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:25.399740 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e06169-4b86-44d9-acd3-7c6b22a64627 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:25.400018 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e06169-4b86-44d9-acd3-7c6b22a64627 None admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:25.400675 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e06169-4b86-44d9-acd3-7c6b22a64627 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:25.400983 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e06169-4b86-44d9-acd3-7c6b22a64627 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:25.402409 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e06169-4b86-44d9-acd3-7c6b22a64627 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:25.416500 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 420/838] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 05:17:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:17:25.422232 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a06e58-98d4-40cd-90f3-6cd76b454646 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:25.535010 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a06e58-98d4-40cd-90f3-6cd76b454646 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:25.573009 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429ce3ca-6aec-41cd-91e0-03c2a25b6495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:25.573654 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ce3ca-6aec-41cd-91e0-03c2a25b6495 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:25.573911 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ce3ca-6aec-41cd-91e0-03c2a25b6495 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:25.574186 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ce3ca-6aec-41cd-91e0-03c2a25b6495 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:25.581698 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429ce3ca-6aec-41cd-91e0-03c2a25b6495 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:25.581846 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651d3846-3aa4-4544-9ddb-3ee928be785f None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:25.582054 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651d3846-3aa4-4544-9ddb-3ee928be785f None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:25.582249 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651d3846-3aa4-4544-9ddb-3ee928be785f None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:25.583185 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429ce3ca-6aec-41cd-91e0-03c2a25b6495 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:25.584516 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 421/839] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:17:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:17:25.589988 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea102ee0-8a00-4846-842c-2c9606dfb9a7 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:25.590535 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea102ee0-8a00-4846-842c-2c9606dfb9a7 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:25.590942 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea102ee0-8a00-4846-842c-2c9606dfb9a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:25.596020 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-429ce3ca-6aec-41cd-91e0-03c2a25b6495 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 11 05:17:25.596020 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:25.596020 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:25.596020 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:25.596020 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:25.596020 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:25.596020 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:25.596020 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:25.596020 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:25.596020 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:25.596020 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:25.596020 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:25.596020 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 05:17:25.596020 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 05:17:25.596020 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 05:17:25.596020 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 05:17:25.596999 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:25.596999 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:25.596999 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 05:17:25.596999 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 05:17:25.596999 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 05:17:25.596999 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 05:17:25.596999 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:25.596999 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:25.596999 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:25.596999 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:25.596999 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:25.596999 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:25.596999 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:25.596999 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:25.596999 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:25.596999 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:25.596999 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:25.596999 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:25.597965 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:25.597965 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:25.597965 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 05:17:25.597965 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 05:17:25.597965 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 05:17:25.597965 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 05:17:25.597965 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 05:17:25.597965 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 05:17:25.597965 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 11 05:17:25.597965 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:25.597965 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 419/840] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 05:17:25 2022] GET /identity/v3/users/swift => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:25.604845 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429ce3ca-6aec-41cd-91e0-03c2a25b6495 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:25.614242 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-ea102ee0-8a00-4846-842c-2c9606dfb9a7 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:17:25.615534 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-ea102ee0-8a00-4846-842c-2c9606dfb9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:17:25.678254 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:25.710044 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 422/841] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:17:25 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 05:17:25.733544 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429ce3ca-6aec-41cd-91e0-03c2a25b6495 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:25.769877 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26cf9e2-9837-4b92-a24f-08990cddd950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:25.771350 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26cf9e2-9837-4b92-a24f-08990cddd950 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:25.771873 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26cf9e2-9837-4b92-a24f-08990cddd950 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:25.772380 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26cf9e2-9837-4b92-a24f-08990cddd950 None admin] PATH_INFO: `/v3/users` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:25.773345 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26cf9e2-9837-4b92-a24f-08990cddd950 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:25.773918 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26cf9e2-9837-4b92-a24f-08990cddd950 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:25.775551 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26cf9e2-9837-4b92-a24f-08990cddd950 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:25.794242 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 420/842] 10.222.0.16 () {56 vars in 1135 bytes} [Sun Sep 11 05:17:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:17:25.799992 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea102ee0-8a00-4846-842c-2c9606dfb9a7 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:25.901212 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:25.905406 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea102ee0-8a00-4846-842c-2c9606dfb9a7 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:25.941756 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6511293e-3878-4edb-9151-848320903cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:25.942365 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6511293e-3878-4edb-9151-848320903cfb None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:25.942662 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6511293e-3878-4edb-9151-848320903cfb None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:25.942971 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6511293e-3878-4edb-9151-848320903cfb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:25.992883 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26cf9e2-9837-4b92-a24f-08990cddd950 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:26.014612 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6511293e-3878-4edb-9151-848320903cfb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:26.016183 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6511293e-3878-4edb-9151-848320903cfb None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:26.103892 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26cf9e2-9837-4b92-a24f-08990cddd950 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:26.119282 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:26.134659 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:26.141271 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 423/843] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 05:17:25 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 05:17:26.143798 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67acf598-c40e-4ff2-bbad-74c51cbe19c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:26.144446 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67acf598-c40e-4ff2-bbad-74c51cbe19c7 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:26.144726 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67acf598-c40e-4ff2-bbad-74c51cbe19c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:26.145000 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67acf598-c40e-4ff2-bbad-74c51cbe19c7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:26.149846 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6511293e-3878-4edb-9151-848320903cfb None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:26.162161 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67acf598-c40e-4ff2-bbad-74c51cbe19c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:17:26.168632 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-67acf598-c40e-4ff2-bbad-74c51cbe19c7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 05:17:26.168632 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:26.168632 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:26.168632 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:26.168632 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:26.168632 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:26.168632 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:26.168632 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:26.168632 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:26.168632 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:26.168632 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:26.168632 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:26.168632 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:17:26.168632 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:17:26.168632 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:17:26.168632 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:17:26.169581 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:17:26.169581 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:17:26.169581 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:17:26.169581 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:17:26.169581 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:26.169581 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:26.169581 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:26.169581 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:26.169581 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:26.169581 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:26.169581 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:26.169581 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:26.169581 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:26.169581 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:26.169581 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:26.169581 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:26.170443 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:26.170443 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:26.170443 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:26.170443 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:26.170443 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:17:26.170443 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:17:26.170443 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:17:26.170443 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:17:26.170443 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:17:26.170443 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:17:26.170443 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 05:17:26.170443 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:26.170443 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 421/844] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 11 05:17:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 05:17:26.175940 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67acf598-c40e-4ff2-bbad-74c51cbe19c7 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:26.257366 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6511293e-3878-4edb-9151-848320903cfb None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:26.296939 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b58c315-852d-4db4-b41c-7e1d086853fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:26.297967 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b58c315-852d-4db4-b41c-7e1d086853fc None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:26.298465 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b58c315-852d-4db4-b41c-7e1d086853fc None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:26.298941 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b58c315-852d-4db4-b41c-7e1d086853fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:26.308038 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67acf598-c40e-4ff2-bbad-74c51cbe19c7 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:26.309925 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b58c315-852d-4db4-b41c-7e1d086853fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:26.311673 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b58c315-852d-4db4-b41c-7e1d086853fc None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:26.331645 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-4b58c315-852d-4db4-b41c-7e1d086853fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:17:26.331645 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:26.331645 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:26.331645 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:26.331645 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:26.331645 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:26.331645 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:26.331645 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:26.331645 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:26.331645 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:26.331645 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:26.331645 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:26.331645 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 05:17:26.331645 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 05:17:26.331645 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 05:17:26.331645 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 05:17:26.332674 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:26.332674 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:26.332674 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:26.332674 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:26.332674 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:26.332674 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:26.332674 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:26.332674 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:26.332674 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:26.332674 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:26.332674 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:26.332674 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:26.332674 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:26.332674 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:26.332674 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:26.332674 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:26.332674 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 05:17:26.334164 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 05:17:26.334164 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:17:26.334164 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:17:26.335828 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 424/845] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:17:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:26.338832 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b58c315-852d-4db4-b41c-7e1d086853fc None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:26.352729 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fca1bc0-c856-402e-881f-8e15ad7c0a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:26.353403 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca1bc0-c856-402e-881f-8e15ad7c0a28 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:26.353690 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca1bc0-c856-402e-881f-8e15ad7c0a28 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:26.353965 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca1bc0-c856-402e-881f-8e15ad7c0a28 None admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:26.354646 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fca1bc0-c856-402e-881f-8e15ad7c0a28 None admin] RBAC: Adding query filter params (name=service) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:26.355140 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fca1bc0-c856-402e-881f-8e15ad7c0a28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:26.356353 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fca1bc0-c856-402e-881f-8e15ad7c0a28 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:26.370108 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 422/846] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 11 05:17:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:26.371186 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fca1bc0-c856-402e-881f-8e15ad7c0a28 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:26.405496 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:26.408308 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:26.471422 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b58c315-852d-4db4-b41c-7e1d086853fc None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:26.505775 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fca1bc0-c856-402e-881f-8e15ad7c0a28 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:26.507901 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60216abc-0feb-431c-8a21-8357ce8dbd77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:26.508521 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60216abc-0feb-431c-8a21-8357ce8dbd77 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:26.508802 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60216abc-0feb-431c-8a21-8357ce8dbd77 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:26.509076 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60216abc-0feb-431c-8a21-8357ce8dbd77 None admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:26.510299 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60216abc-0feb-431c-8a21-8357ce8dbd77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:26.510299 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60216abc-0feb-431c-8a21-8357ce8dbd77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:26.511401 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60216abc-0feb-431c-8a21-8357ce8dbd77 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:26.528984 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 425/847] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 05:17:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:17:26.530686 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60216abc-0feb-431c-8a21-8357ce8dbd77 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:26.558348 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e34b20b-ce92-49a7-8531-b79a78b9e97b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:26.559563 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e34b20b-ce92-49a7-8531-b79a78b9e97b None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:26.560517 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e34b20b-ce92-49a7-8531-b79a78b9e97b None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:26.561243 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e34b20b-ce92-49a7-8531-b79a78b9e97b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:26.575712 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e34b20b-ce92-49a7-8531-b79a78b9e97b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:26.578474 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e34b20b-ce92-49a7-8531-b79a78b9e97b None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:26.599067 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-8e34b20b-ce92-49a7-8531-b79a78b9e97b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:17:26.599067 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:26.599067 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:26.599067 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:26.599067 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:26.599067 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:26.599067 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:26.599067 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:26.599067 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:26.599067 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:26.599067 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:26.599067 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:26.599067 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 05:17:26.599067 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 05:17:26.599067 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 05:17:26.599067 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 05:17:26.600293 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:26.600293 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:26.600293 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:26.600293 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:26.600293 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:26.600293 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:26.600293 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:26.600293 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:26.600293 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:26.600293 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:26.600293 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:26.600293 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:26.600293 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:26.600293 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:26.600293 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:26.600293 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:26.600293 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 05:17:26.601411 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 05:17:26.601411 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:17:26.601411 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:26.603997 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 423/848] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:17:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 05:17:26.612704 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e34b20b-ce92-49a7-8531-b79a78b9e97b None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:26.642486 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60216abc-0feb-431c-8a21-8357ce8dbd77 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:26.654597 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:26.683744 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf16a86-f20f-4d33-a331-dede6a7d5fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:26.684558 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf16a86-f20f-4d33-a331-dede6a7d5fb6 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:26.684938 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf16a86-f20f-4d33-a331-dede6a7d5fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:26.685312 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf16a86-f20f-4d33-a331-dede6a7d5fb6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:26.693007 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf16a86-f20f-4d33-a331-dede6a7d5fb6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:26.694547 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf16a86-f20f-4d33-a331-dede6a7d5fb6 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:26.706988 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-0bf16a86-f20f-4d33-a331-dede6a7d5fb6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 05:17:26.706988 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:26.706988 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:26.706988 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:26.706988 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:26.706988 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:26.706988 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:26.706988 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:26.706988 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:26.706988 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:26.706988 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:26.706988 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:26.706988 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 05:17:26.706988 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 05:17:26.706988 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 05:17:26.708020 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 05:17:26.708020 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:26.708020 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:26.708020 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:26.708020 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:26.708020 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:26.708020 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:26.708020 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:26.708020 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:26.708020 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:26.708020 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:26.708020 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:26.708020 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:26.708020 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:26.708020 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:26.708020 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:26.708020 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:26.709465 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 05:17:26.709465 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 05:17:26.709465 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 05:17:26.709465 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 05:17:26.709465 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 05:17:26.709465 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 05:17:26.709465 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 05:17:26.709465 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:17:26.709465 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 426/849] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 05:17:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:26.714249 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf16a86-f20f-4d33-a331-dede6a7d5fb6 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:26.717248 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:26.741468 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e34b20b-ce92-49a7-8531-b79a78b9e97b None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:26.790492 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baf2d6c-5fb8-432c-aa12-ee8b4efc6578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:26.791509 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf2d6c-5fb8-432c-aa12-ee8b4efc6578 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:26.791923 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf2d6c-5fb8-432c-aa12-ee8b4efc6578 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:26.792300 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf2d6c-5fb8-432c-aa12-ee8b4efc6578 None admin] PATH_INFO: `/v3/domains` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:26.793324 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baf2d6c-5fb8-432c-aa12-ee8b4efc6578 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:26.793730 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baf2d6c-5fb8-432c-aa12-ee8b4efc6578 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:26.795945 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baf2d6c-5fb8-432c-aa12-ee8b4efc6578 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:26.815778 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 424/850] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 05:17:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:26.822043 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baf2d6c-5fb8-432c-aa12-ee8b4efc6578 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:26.856753 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf16a86-f20f-4d33-a331-dede6a7d5fb6 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:26.900451 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d804e62-94c8-4f89-b656-a7debbc696ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:26.901853 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d804e62-94c8-4f89-b656-a7debbc696ed None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:26.901853 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d804e62-94c8-4f89-b656-a7debbc696ed None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:26.901853 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d804e62-94c8-4f89-b656-a7debbc696ed None admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:26.902565 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d804e62-94c8-4f89-b656-a7debbc696ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:26.902950 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d804e62-94c8-4f89-b656-a7debbc696ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:26.904476 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d804e62-94c8-4f89-b656-a7debbc696ed None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:26.918115 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 427/851] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 05:17:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:17:26.923600 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d804e62-94c8-4f89-b656-a7debbc696ed None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:26.942379 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baf2d6c-5fb8-432c-aa12-ee8b4efc6578 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:26.955319 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:26.982370 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6fe42d-7fae-4e81-ad40-de515a6f788a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:26.982999 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6fe42d-7fae-4e81-ad40-de515a6f788a None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:26.983279 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6fe42d-7fae-4e81-ad40-de515a6f788a None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:26.983551 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6fe42d-7fae-4e81-ad40-de515a6f788a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:26.992718 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6fe42d-7fae-4e81-ad40-de515a6f788a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:26.994100 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6fe42d-7fae-4e81-ad40-de515a6f788a None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:27.007024 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-ae6fe42d-7fae-4e81-ad40-de515a6f788a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 11 05:17:27.007024 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:27.007024 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:27.007024 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:27.007024 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:27.007024 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:27.007024 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:27.007024 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:27.007024 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:27.007024 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:27.007024 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:27.007024 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:27.007024 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 05:17:27.007024 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 05:17:27.007024 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 05:17:27.007024 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 05:17:27.008108 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:27.008108 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:27.008108 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 05:17:27.008108 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 05:17:27.008108 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 05:17:27.008108 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 05:17:27.008108 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:27.008108 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:27.008108 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:27.008108 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:27.008108 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:27.008108 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:27.008108 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:27.008108 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:27.008108 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:27.008108 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:27.008108 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:27.008108 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:27.009034 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:27.009034 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:27.009034 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 05:17:27.009034 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 05:17:27.009034 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 05:17:27.009034 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 05:17:27.009034 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 05:17:27.009034 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 05:17:27.009034 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 11 05:17:27.009034 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:27.009034 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 425/852] 10.222.0.16 () {56 vars in 1117 bytes} [Sun Sep 11 05:17:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 05:17:27.010017 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f38b337-4c48-4390-91af-7e314925e99d None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:27.010017 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f38b337-4c48-4390-91af-7e314925e99d None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:27.010292 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f38b337-4c48-4390-91af-7e314925e99d None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:27.011630 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 426/853] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:17:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:17:27.016507 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f38b337-4c48-4390-91af-7e314925e99d None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:27.025856 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:27.040698 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d804e62-94c8-4f89-b656-a7debbc696ed None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:27.076423 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d8013b-19b9-475b-8aa5-60297820985b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:27.077030 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d8013b-19b9-475b-8aa5-60297820985b None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:27.077309 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d8013b-19b9-475b-8aa5-60297820985b None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:27.077586 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d8013b-19b9-475b-8aa5-60297820985b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:27.078305 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d8013b-19b9-475b-8aa5-60297820985b None admin] RBAC: Adding query filter params (role.id=5b702713e40145b49e0b42abd0a5fba9, scope.project.id=61ffb079d9e1437084945554bcc0747b, user.id=2bbe4555380345e485572d2da8b78be1) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:27.078616 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d8013b-19b9-475b-8aa5-60297820985b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:27.080089 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d8013b-19b9-475b-8aa5-60297820985b None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:27.085932 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 428/854] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 05:17:26 2022] GET /identity/v3/role_assignments?user.id=2bbe4555380345e485572d2da8b78be1&scope.project.id=61ffb079d9e1437084945554bcc0747b&role.id=5b702713e40145b49e0b42abd0a5fba9 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:27.087080 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50675de5-a111-4e70-a4ae-1b85341b8649 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:27.087365 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50675de5-a111-4e70-a4ae-1b85341b8649 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:27.087641 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50675de5-a111-4e70-a4ae-1b85341b8649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:27.109965 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-50675de5-a111-4e70-a4ae-1b85341b8649 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:17:27.112002 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-50675de5-a111-4e70-a4ae-1b85341b8649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:17:27.145588 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f38b337-4c48-4390-91af-7e314925e99d None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:27.190192 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de6ec14-fbd9-4068-95c6-5d4d81a3cee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:27.190825 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de6ec14-fbd9-4068-95c6-5d4d81a3cee9 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:27.191102 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de6ec14-fbd9-4068-95c6-5d4d81a3cee9 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:27.191372 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de6ec14-fbd9-4068-95c6-5d4d81a3cee9 None admin] PATH_INFO: `/v3/users` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:27.192152 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de6ec14-fbd9-4068-95c6-5d4d81a3cee9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:27.192460 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de6ec14-fbd9-4068-95c6-5d4d81a3cee9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:27.194821 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de6ec14-fbd9-4068-95c6-5d4d81a3cee9 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:27.217168 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 429/855] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:17:27 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 05:17:27.220994 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 427/856] 10.222.0.16 () {56 vars in 1149 bytes} [Sun Sep 11 05:17:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:27.226629 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50675de5-a111-4e70-a4ae-1b85341b8649 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:27.255795 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:27.335967 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50675de5-a111-4e70-a4ae-1b85341b8649 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:27.371144 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b22e3a-ec0b-43d9-8068-c484aba62fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:27.371782 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b22e3a-ec0b-43d9-8068-c484aba62fbd None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:27.372059 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b22e3a-ec0b-43d9-8068-c484aba62fbd None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:27.372330 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b22e3a-ec0b-43d9-8068-c484aba62fbd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:27.442101 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b22e3a-ec0b-43d9-8068-c484aba62fbd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:27.444162 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b22e3a-ec0b-43d9-8068-c484aba62fbd None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:27.470738 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:27.502657 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de6ec14-fbd9-4068-95c6-5d4d81a3cee9 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:27.569972 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 430/857] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 05:17:27 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 05:17:27.570841 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b22e3a-ec0b-43d9-8068-c484aba62fbd None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:27.590465 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:27.633348 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de6ec14-fbd9-4068-95c6-5d4d81a3cee9 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:27.675138 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e6de26-85ec-4292-98d9-e008824c0f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:27.675814 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e6de26-85ec-4292-98d9-e008824c0f5e None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:27.676090 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e6de26-85ec-4292-98d9-e008824c0f5e None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:27.676357 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e6de26-85ec-4292-98d9-e008824c0f5e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:27.676470 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b22e3a-ec0b-43d9-8068-c484aba62fbd None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:27.676941 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e6de26-85ec-4292-98d9-e008824c0f5e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:27.678339 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e6de26-85ec-4292-98d9-e008824c0f5e None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:27.687101 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-f1e6de26-85ec-4292-98d9-e008824c0f5e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 11 05:17:27.687101 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:27.687101 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 05:17:27.687101 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 05:17:27.687101 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 05:17:27.687101 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 05:17:27.687101 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 05:17:27.687101 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 05:17:27.687101 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 11 05:17:27.687101 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:27.687101 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 05:17:27.687101 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:27.687101 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:27.687101 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:27.687101 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:27.687101 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:27.687101 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:27.688117 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:27.688117 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:27.688117 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:27.688117 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:27.688117 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:27.688117 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:27.688117 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 05:17:27.688117 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 05:17:27.688117 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 05:17:27.688117 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 05:17:27.688117 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:27.688117 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:27.688117 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:27.688117 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:27.688117 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:27.688117 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:27.693865 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:27.693865 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:27.693865 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:27.693865 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:27.693865 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:27.693865 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:27.693865 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:27.693865 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:27.693865 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:27.693865 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:27.693865 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 05:17:27.693865 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 05:17:27.693865 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 11 05:17:27.693865 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:27.693865 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 428/858] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 11 05:17:27 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 05:17:27.694672 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502eee5a-7341-46bf-88b9-b9b128e93be9 None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:27.694672 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502eee5a-7341-46bf-88b9-b9b128e93be9 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:27.694672 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502eee5a-7341-46bf-88b9-b9b128e93be9 None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:27.694672 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 429/859] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:17:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:17:27.696179 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502eee5a-7341-46bf-88b9-b9b128e93be9 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:27.710032 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:27.722602 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815ea69d-1ee8-4985-b6ee-29db66e6c5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:27.723242 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ea69d-1ee8-4985-b6ee-29db66e6c5ec None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:27.723519 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ea69d-1ee8-4985-b6ee-29db66e6c5ec None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:27.723848 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ea69d-1ee8-4985-b6ee-29db66e6c5ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:27.735462 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815ea69d-1ee8-4985-b6ee-29db66e6c5ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:27.736364 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815ea69d-1ee8-4985-b6ee-29db66e6c5ec None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:27.753003 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-815ea69d-1ee8-4985-b6ee-29db66e6c5ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:17:27.753003 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:27.753003 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:27.753003 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:27.753003 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:27.753003 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:27.753003 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:27.753003 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:27.753003 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:27.753003 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:27.753003 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:27.753003 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:27.753003 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 05:17:27.753003 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 05:17:27.753003 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 05:17:27.753003 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 05:17:27.753989 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:27.753989 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:27.753989 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:27.753989 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:27.753989 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:27.753989 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:27.753989 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:27.753989 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:27.753989 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:27.753989 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:27.753989 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:27.753989 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:27.753989 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:27.753989 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:27.753989 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:27.753989 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:27.753989 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 05:17:27.754885 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 05:17:27.754885 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:17:27.754885 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:17:27.754885 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 431/860] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:17:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 05:17:27.756834 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37e4ff-f5a6-45db-9f5e-b731b304867e None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:27.756834 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37e4ff-f5a6-45db-9f5e-b731b304867e None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:27.756834 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37e4ff-f5a6-45db-9f5e-b731b304867e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:27.775805 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-cd37e4ff-f5a6-45db-9f5e-b731b304867e None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:17:27.777044 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-cd37e4ff-f5a6-45db-9f5e-b731b304867e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:17:27.813594 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502eee5a-7341-46bf-88b9-b9b128e93be9 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:27.841295 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:27.851908 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0c57f1-0c7a-4e46-b7a0-5d8204b1a11d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:27.852499 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c57f1-0c7a-4e46-b7a0-5d8204b1a11d None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:27.852778 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c57f1-0c7a-4e46-b7a0-5d8204b1a11d None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:27.853047 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c57f1-0c7a-4e46-b7a0-5d8204b1a11d None admin] PATH_INFO: `/v3/services` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:27.853670 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0c57f1-0c7a-4e46-b7a0-5d8204b1a11d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:27.853966 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0c57f1-0c7a-4e46-b7a0-5d8204b1a11d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:27.855326 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0c57f1-0c7a-4e46-b7a0-5d8204b1a11d None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:27.856326 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 432/861] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:17:27 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 05:17:27.857122 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd37e4ff-f5a6-45db-9f5e-b731b304867e None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:27.873539 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 430/862] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 11 05:17:27 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:27.878764 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0c57f1-0c7a-4e46-b7a0-5d8204b1a11d None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:27.989391 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd37e4ff-f5a6-45db-9f5e-b731b304867e None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:27.997988 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:28.002104 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0c57f1-0c7a-4e46-b7a0-5d8204b1a11d None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:28.033401 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2786faf0-74fc-479a-a804-adfd95458a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:28.034897 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2786faf0-74fc-479a-a804-adfd95458a81 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:28.035497 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2786faf0-74fc-479a-a804-adfd95458a81 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:28.036108 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2786faf0-74fc-479a-a804-adfd95458a81 None admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:28.037196 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2786faf0-74fc-479a-a804-adfd95458a81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:28.037832 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2786faf0-74fc-479a-a804-adfd95458a81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:28.038996 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeb9da5-2036-4c88-b5ef-96a8399ec478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:28.039710 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeb9da5-2036-4c88-b5ef-96a8399ec478 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:28.039948 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2786faf0-74fc-479a-a804-adfd95458a81 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:28.040094 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeb9da5-2036-4c88-b5ef-96a8399ec478 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:28.040715 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeb9da5-2036-4c88-b5ef-96a8399ec478 None admin] PATH_INFO: `/v3/services` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:28.041404 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeb9da5-2036-4c88-b5ef-96a8399ec478 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:28.041778 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeb9da5-2036-4c88-b5ef-96a8399ec478 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:28.043478 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeb9da5-2036-4c88-b5ef-96a8399ec478 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:28.054395 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 431/863] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 11 05:17:27 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:17:28.055352 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 433/864] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 05:17:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:28.060916 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeb9da5-2036-4c88-b5ef-96a8399ec478 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:28.123971 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2786faf0-74fc-479a-a804-adfd95458a81 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:28.165801 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:28.179291 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeb9da5-2036-4c88-b5ef-96a8399ec478 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:28.215453 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421eb706-1baf-48ce-aee4-2d18594a916c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:28.216157 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421eb706-1baf-48ce-aee4-2d18594a916c None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:28.216434 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421eb706-1baf-48ce-aee4-2d18594a916c None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:28.216702 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421eb706-1baf-48ce-aee4-2d18594a916c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:28.224283 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421eb706-1baf-48ce-aee4-2d18594a916c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:28.225756 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421eb706-1baf-48ce-aee4-2d18594a916c None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:28.238735 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-421eb706-1baf-48ce-aee4-2d18594a916c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 05:17:28.238735 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:28.238735 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:28.238735 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:28.238735 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:28.238735 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:28.238735 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:28.238735 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:28.238735 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:28.238735 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:28.238735 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:28.238735 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:28.238735 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 05:17:28.238735 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 05:17:28.238735 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 05:17:28.240420 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 05:17:28.240420 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:28.240420 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:28.240420 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:28.240420 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:28.240420 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:28.240420 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:28.240420 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:28.240420 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:28.240420 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:28.240420 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:28.240420 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:28.240420 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:28.240420 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:28.240420 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:28.240420 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:28.240420 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:28.242309 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 05:17:28.242309 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 05:17:28.242309 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 05:17:28.242309 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 05:17:28.242309 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 05:17:28.242309 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 05:17:28.242309 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 05:17:28.242309 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:28.242309 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 432/865] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 05:17:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:28.246471 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421eb706-1baf-48ce-aee4-2d18594a916c None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:28.255562 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2786faf0-74fc-479a-a804-adfd95458a81 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:28.299404 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7efa46-4224-461b-9526-48feb0ea55c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:28.300393 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7efa46-4224-461b-9526-48feb0ea55c4 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:28.300814 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7efa46-4224-461b-9526-48feb0ea55c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:28.301226 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7efa46-4224-461b-9526-48feb0ea55c4 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:28.302168 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7efa46-4224-461b-9526-48feb0ea55c4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:28.304373 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7efa46-4224-461b-9526-48feb0ea55c4 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:28.319023 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-dd7efa46-4224-461b-9526-48feb0ea55c4 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 11 05:17:28.319023 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:28.319023 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 05:17:28.319023 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 05:17:28.319023 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 05:17:28.319023 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 05:17:28.319023 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 05:17:28.319023 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 05:17:28.319023 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 11 05:17:28.319023 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:17:28.319023 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 05:17:28.319023 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:17:28.319023 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:28.319023 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:28.319023 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:28.319023 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:28.320107 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:28.320107 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:28.320107 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:28.320107 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:28.320107 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:28.320107 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:28.320107 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:28.320107 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 05:17:28.320107 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 05:17:28.320107 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 05:17:28.320107 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 05:17:28.320107 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:28.320107 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:28.320107 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:28.320107 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:28.320107 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:28.320107 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:28.321028 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:28.321028 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:28.321028 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:28.321028 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:28.321028 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:28.321028 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:28.321028 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:28.321028 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:28.321028 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:28.321028 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:28.321028 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 05:17:28.321028 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 05:17:28.321028 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 11 05:17:28.321028 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:17:28.321786 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 434/866] 10.222.0.16 () {56 vars in 1132 bytes} [Sun Sep 11 05:17:28 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 05:17:28.326776 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7efa46-4224-461b-9526-48feb0ea55c4 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:28.364554 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:28.377742 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421eb706-1baf-48ce-aee4-2d18594a916c None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:28.397139 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:28.417609 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd430a4-23bc-437b-926c-6102e1bab36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:28.418337 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd430a4-23bc-437b-926c-6102e1bab36a None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:28.418679 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd430a4-23bc-437b-926c-6102e1bab36a None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:28.419028 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd430a4-23bc-437b-926c-6102e1bab36a None admin] PATH_INFO: `/v3/projects` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:28.419832 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd430a4-23bc-437b-926c-6102e1bab36a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:28.420211 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd430a4-23bc-437b-926c-6102e1bab36a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:28.421946 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd430a4-23bc-437b-926c-6102e1bab36a None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:28.441180 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 433/867] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 05:17:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:28.441631 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd430a4-23bc-437b-926c-6102e1bab36a None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:28.445964 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7efa46-4224-461b-9526-48feb0ea55c4 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:28.483186 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bdf75f-5136-4c59-89c8-0203dda0cea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:28.483928 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bdf75f-5136-4c59-89c8-0203dda0cea7 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:28.484312 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bdf75f-5136-4c59-89c8-0203dda0cea7 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:28.484656 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bdf75f-5136-4c59-89c8-0203dda0cea7 None admin] PATH_INFO: `/v3/services` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:28.485357 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bdf75f-5136-4c59-89c8-0203dda0cea7 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:28.485730 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bdf75f-5136-4c59-89c8-0203dda0cea7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:28.487177 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bdf75f-5136-4c59-89c8-0203dda0cea7 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:28.492594 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 435/868] 10.222.0.16 () {56 vars in 1126 bytes} [Sun Sep 11 05:17:28 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:28.498149 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bdf75f-5136-4c59-89c8-0203dda0cea7 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:28.555198 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd430a4-23bc-437b-926c-6102e1bab36a None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:28.592685 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f186689a-6b47-46ae-96f0-8dc2e330913c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:28.594236 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f186689a-6b47-46ae-96f0-8dc2e330913c None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:28.594727 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f186689a-6b47-46ae-96f0-8dc2e330913c None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:28.595212 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f186689a-6b47-46ae-96f0-8dc2e330913c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:28.596375 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f186689a-6b47-46ae-96f0-8dc2e330913c None admin] RBAC: Adding query filter params (role.id=82bd224e8afc480782a85b833a2aa03e, scope.project.id=61ffb079d9e1437084945554bcc0747b, user.id=62fffbcf330a4bc183d0885c175f5a90) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:28.596791 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f186689a-6b47-46ae-96f0-8dc2e330913c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:28.598312 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f186689a-6b47-46ae-96f0-8dc2e330913c None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:28.599469 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:28.607984 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bdf75f-5136-4c59-89c8-0203dda0cea7 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:28.611911 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 434/869] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 05:17:28 2022] GET /identity/v3/role_assignments?user.id=62fffbcf330a4bc183d0885c175f5a90&scope.project.id=61ffb079d9e1437084945554bcc0747b&role.id=82bd224e8afc480782a85b833a2aa03e => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:17:28.657376 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a56247-135f-49c9-9737-f8169344db3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:28.658355 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a56247-135f-49c9-9737-f8169344db3f None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:28.658786 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a56247-135f-49c9-9737-f8169344db3f None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:28.659203 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a56247-135f-49c9-9737-f8169344db3f None admin] PATH_INFO: `/v3/services` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:28.660039 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a56247-135f-49c9-9737-f8169344db3f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:28.660487 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a56247-135f-49c9-9737-f8169344db3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:28.662086 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a56247-135f-49c9-9737-f8169344db3f None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:28.668059 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 436/870] 10.222.0.16 () {56 vars in 1126 bytes} [Sun Sep 11 05:17:28 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:17:29.367317 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420211e9-4a35-4e50-8cfb-7472254b4bd3 None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:29.367760 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420211e9-4a35-4e50-8cfb-7472254b4bd3 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:29.367888 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420211e9-4a35-4e50-8cfb-7472254b4bd3 None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:29.369467 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 435/871] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:17:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:17:29.374921 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1188630d-d0f2-4da0-9f01-411881fa5d63 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:29.375395 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1188630d-d0f2-4da0-9f01-411881fa5d63 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:29.375481 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1188630d-d0f2-4da0-9f01-411881fa5d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:29.394734 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-1188630d-d0f2-4da0-9f01-411881fa5d63 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:17:29.396018 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-1188630d-d0f2-4da0-9f01-411881fa5d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:17:29.466352 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 437/872] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:17:29 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 05:17:29.734507 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420211e9-4a35-4e50-8cfb-7472254b4bd3 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:29.779220 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:29.838907 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420211e9-4a35-4e50-8cfb-7472254b4bd3 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:29.873821 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bd3d90-c8f9-4bce-97d6-ada1c4a47afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:29.874451 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd3d90-c8f9-4bce-97d6-ada1c4a47afc None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:29.874728 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd3d90-c8f9-4bce-97d6-ada1c4a47afc None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:29.874995 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd3d90-c8f9-4bce-97d6-ada1c4a47afc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:29.875577 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bd3d90-c8f9-4bce-97d6-ada1c4a47afc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:29.876970 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bd3d90-c8f9-4bce-97d6-ada1c4a47afc None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:29.886254 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-31bd3d90-c8f9-4bce-97d6-ada1c4a47afc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 05:17:29.886254 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:29.886254 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 05:17:29.886254 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 05:17:29.886254 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 05:17:29.886254 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 05:17:29.886254 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 05:17:29.886254 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 05:17:29.886254 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 05:17:29.886254 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:29.886254 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 05:17:29.886254 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:29.886254 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:29.886254 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:29.886254 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:29.886254 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:29.886254 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:29.887240 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:29.887240 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:29.887240 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:29.887240 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:29.887240 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:29.887240 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:29.887240 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 05:17:29.887240 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 05:17:29.887240 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 05:17:29.887240 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 05:17:29.887240 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:29.887240 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:29.887240 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:29.887240 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:29.887240 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:29.887240 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:29.888105 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:29.888105 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:29.888105 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:29.888105 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:29.888105 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:29.888105 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:29.888105 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:29.888105 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:29.888105 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:29.888105 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:29.888105 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 05:17:29.888105 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 05:17:29.888105 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 05:17:29.888105 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:29.888105 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 436/873] 10.222.0.16 () {56 vars in 1126 bytes} [Sun Sep 11 05:17:29 2022] GET /identity/v3/services/object-store => generated 93 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:29.893692 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1188630d-d0f2-4da0-9f01-411881fa5d63 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:29.987721 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:30.000781 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1188630d-d0f2-4da0-9f01-411881fa5d63 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:30.037085 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b96592-c9bc-4ba9-a7f5-6158928072b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:30.037707 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b96592-c9bc-4ba9-a7f5-6158928072b2 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:30.037981 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b96592-c9bc-4ba9-a7f5-6158928072b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:30.038252 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b96592-c9bc-4ba9-a7f5-6158928072b2 None admin] PATH_INFO: `/v3/services` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:30.038884 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b96592-c9bc-4ba9-a7f5-6158928072b2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:30.039189 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b96592-c9bc-4ba9-a7f5-6158928072b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:30.040604 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b96592-c9bc-4ba9-a7f5-6158928072b2 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:30.045858 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 438/874] 10.222.0.16 () {56 vars in 1122 bytes} [Sun Sep 11 05:17:29 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:30.051418 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bd3d90-c8f9-4bce-97d6-ada1c4a47afc None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:30.154076 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bd3d90-c8f9-4bce-97d6-ada1c4a47afc None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:30.156479 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:30.189097 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448046ea-ddf7-48a9-9f53-981c40eac147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:30.189706 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448046ea-ddf7-48a9-9f53-981c40eac147 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:30.189989 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448046ea-ddf7-48a9-9f53-981c40eac147 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:30.190266 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448046ea-ddf7-48a9-9f53-981c40eac147 None admin] PATH_INFO: `/v3/services` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:30.190899 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448046ea-ddf7-48a9-9f53-981c40eac147 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:30.191202 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448046ea-ddf7-48a9-9f53-981c40eac147 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:30.192649 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448046ea-ddf7-48a9-9f53-981c40eac147 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:30.197982 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 437/875] 10.222.0.16 () {56 vars in 1122 bytes} [Sun Sep 11 05:17:30 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:30.412916 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706da147-3d31-4882-9b5a-5a998e38f156 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:30.413452 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706da147-3d31-4882-9b5a-5a998e38f156 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:30.413452 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706da147-3d31-4882-9b5a-5a998e38f156 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:30.415018 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 439/876] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:17:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:17:30.420616 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93760ba-44de-483c-92ef-1a6b9ed49b59 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:30.420911 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93760ba-44de-483c-92ef-1a6b9ed49b59 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:30.421191 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93760ba-44de-483c-92ef-1a6b9ed49b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:30.439838 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-c93760ba-44de-483c-92ef-1a6b9ed49b59 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:17:30.441355 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-c93760ba-44de-483c-92ef-1a6b9ed49b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:17:30.509442 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 438/877] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:17:30 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 05:17:30.782010 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706da147-3d31-4882-9b5a-5a998e38f156 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:30.902560 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706da147-3d31-4882-9b5a-5a998e38f156 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:30.907486 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80b0b1-312d-4de6-b725-fa142e6e286d None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:30.907990 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80b0b1-312d-4de6-b725-fa142e6e286d None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:30.908067 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80b0b1-312d-4de6-b725-fa142e6e286d None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:30.909609 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 439/878] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:17:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:17:30.915479 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a4eda-d2a5-4e51-bab3-f33f280a6197 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:30.915827 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a4eda-d2a5-4e51-bab3-f33f280a6197 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:30.916106 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a4eda-d2a5-4e51-bab3-f33f280a6197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:30.935630 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-5a4a4eda-d2a5-4e51-bab3-f33f280a6197 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:17:30.936954 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-5a4a4eda-d2a5-4e51-bab3-f33f280a6197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:17:30.942461 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99c0e72-9e90-40fa-84ef-5fa2fddf91ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:30.943390 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c0e72-9e90-40fa-84ef-5fa2fddf91ae None admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:30.943916 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c0e72-9e90-40fa-84ef-5fa2fddf91ae None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:30.944403 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c0e72-9e90-40fa-84ef-5fa2fddf91ae None admin] PATH_INFO: `/v3/services` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:30.945244 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99c0e72-9e90-40fa-84ef-5fa2fddf91ae None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:30.946883 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99c0e72-9e90-40fa-84ef-5fa2fddf91ae None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:30.967153 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 440/879] 10.222.0.16 () {60 vars in 1141 bytes} [Sun Sep 11 05:17:30 2022] POST /identity/v3/services => generated 251 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:17:31.006335 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14221b4-ab88-4344-9d46-f07282617467 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:31.006682 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14221b4-ab88-4344-9d46-f07282617467 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:31.006898 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14221b4-ab88-4344-9d46-f07282617467 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:31.012636 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 441/880] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:17:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 05:17:31.014417 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44860274-d9db-4f6d-b9b3-335b34d062a9 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:31.014779 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44860274-d9db-4f6d-b9b3-335b34d062a9 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:31.015066 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44860274-d9db-4f6d-b9b3-335b34d062a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:31.032437 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 440/881] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:17:30 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 05:17:31.038881 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-44860274-d9db-4f6d-b9b3-335b34d062a9 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:17:31.040220 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-44860274-d9db-4f6d-b9b3-335b34d062a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:17:31.049213 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:31.123831 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 442/882] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:17:31 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 05:17:31.320674 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4a4eda-d2a5-4e51-bab3-f33f280a6197 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:31.348697 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:31.420287 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44860274-d9db-4f6d-b9b3-335b34d062a9 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:31.437752 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4a4eda-d2a5-4e51-bab3-f33f280a6197 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:31.475487 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed568e7-8cba-46c3-a669-9f2287449a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:31.476539 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed568e7-8cba-46c3-a669-9f2287449a69 None admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:31.477038 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed568e7-8cba-46c3-a669-9f2287449a69 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:31.477514 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed568e7-8cba-46c3-a669-9f2287449a69 None admin] PATH_INFO: `/v3/services` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:31.478404 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed568e7-8cba-46c3-a669-9f2287449a69 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:31.480018 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed568e7-8cba-46c3-a669-9f2287449a69 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:31.499146 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 441/883] 10.222.0.16 () {60 vars in 1141 bytes} [Sun Sep 11 05:17:31 2022] POST /identity/v3/services => generated 269 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:17:31.529836 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44860274-d9db-4f6d-b9b3-335b34d062a9 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:31.577843 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f768fae0-1a41-4ac4-a892-49bebe819ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:31.578503 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f768fae0-1a41-4ac4-a892-49bebe819ec2 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:31.578784 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f768fae0-1a41-4ac4-a892-49bebe819ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:31.579055 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f768fae0-1a41-4ac4-a892-49bebe819ec2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:31.589272 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:31.594156 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f768fae0-1a41-4ac4-a892-49bebe819ec2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:17:31.600502 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-f768fae0-1a41-4ac4-a892-49bebe819ec2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 11 05:17:31.600502 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:31.600502 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:31.600502 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:31.600502 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:31.600502 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:31.600502 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:31.600502 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:31.600502 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:31.600502 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:31.600502 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:31.600502 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:31.600502 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:17:31.600502 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:17:31.600502 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:17:31.600502 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:17:31.601514 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:17:31.601514 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:17:31.601514 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:17:31.601514 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:17:31.601514 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:31.601514 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:31.601514 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:31.601514 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:31.601514 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:31.601514 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:31.601514 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:31.601514 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:31.601514 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:31.601514 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:31.601514 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:31.601514 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:31.602573 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:31.602573 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:31.602573 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:31.602573 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:31.602573 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:17:31.602573 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:17:31.602573 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:17:31.602573 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:17:31.602573 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:17:31.602573 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:17:31.602573 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 11 05:17:31.602573 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:17:31.602573 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 443/884] 10.222.0.16 () {56 vars in 1120 bytes} [Sun Sep 11 05:17:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:31.612862 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed568e7-8cba-46c3-a669-9f2287449a69 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:31.705504 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:31.724805 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed568e7-8cba-46c3-a669-9f2287449a69 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:31.761275 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699cec9d-6fe7-4dca-9e60-6f32aeb45633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:31.761922 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699cec9d-6fe7-4dca-9e60-6f32aeb45633 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:31.762186 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699cec9d-6fe7-4dca-9e60-6f32aeb45633 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:31.762470 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699cec9d-6fe7-4dca-9e60-6f32aeb45633 None admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:31.763144 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699cec9d-6fe7-4dca-9e60-6f32aeb45633 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:31.763454 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699cec9d-6fe7-4dca-9e60-6f32aeb45633 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:31.765040 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699cec9d-6fe7-4dca-9e60-6f32aeb45633 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:31.774262 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 442/885] 10.222.0.16 () {56 vars in 1115 bytes} [Sun Sep 11 05:17:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:31.780260 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f768fae0-1a41-4ac4-a892-49bebe819ec2 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:31.892559 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f768fae0-1a41-4ac4-a892-49bebe819ec2 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:31.929206 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03200d1-cd63-4f15-98b4-7a9c0a37ab78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:31.930234 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03200d1-cd63-4f15-98b4-7a9c0a37ab78 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:31.930772 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03200d1-cd63-4f15-98b4-7a9c0a37ab78 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:31.931243 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03200d1-cd63-4f15-98b4-7a9c0a37ab78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:31.943860 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03200d1-cd63-4f15-98b4-7a9c0a37ab78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:31.945738 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03200d1-cd63-4f15-98b4-7a9c0a37ab78 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:31.962304 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-d03200d1-cd63-4f15-98b4-7a9c0a37ab78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:17:31.962304 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:31.962304 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:31.962304 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:31.962304 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:31.962304 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:31.962304 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:31.962304 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:31.962304 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:31.962304 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:31.962304 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:31.962304 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:31.962304 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 05:17:31.962304 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 05:17:31.962304 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 05:17:31.962304 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 05:17:31.963337 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:31.963337 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:31.963337 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:31.963337 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:31.963337 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:31.963337 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:31.963337 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:31.963337 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:31.963337 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:31.963337 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:31.963337 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:31.963337 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:31.963337 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:31.963337 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:31.963337 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:31.963337 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:31.963337 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 05:17:31.964352 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 05:17:31.964352 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:17:31.964352 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:17:31.966405 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 444/886] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:17:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:31.971819 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699cec9d-6fe7-4dca-9e60-6f32aeb45633 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:32.075925 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699cec9d-6fe7-4dca-9e60-6f32aeb45633 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:32.110509 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73817e62-bed4-4109-8c23-5c3492669574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:32.111126 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73817e62-bed4-4109-8c23-5c3492669574 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:32.111405 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73817e62-bed4-4109-8c23-5c3492669574 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:32.111695 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73817e62-bed4-4109-8c23-5c3492669574 None admin] PATH_INFO: `/v3/domains` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:32.112352 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73817e62-bed4-4109-8c23-5c3492669574 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:32.112656 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73817e62-bed4-4109-8c23-5c3492669574 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:32.114130 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73817e62-bed4-4109-8c23-5c3492669574 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:32.126612 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 443/887] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 05:17:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:32.132840 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03200d1-cd63-4f15-98b4-7a9c0a37ab78 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:32.189032 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:32.241989 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03200d1-cd63-4f15-98b4-7a9c0a37ab78 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:32.283002 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52201ee-467c-4fde-bfbf-bf28199fc70c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:32.283715 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52201ee-467c-4fde-bfbf-bf28199fc70c None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:32.284006 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52201ee-467c-4fde-bfbf-bf28199fc70c None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:32.284282 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52201ee-467c-4fde-bfbf-bf28199fc70c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:32.293034 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52201ee-467c-4fde-bfbf-bf28199fc70c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:32.294510 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52201ee-467c-4fde-bfbf-bf28199fc70c None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:32.306280 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-c52201ee-467c-4fde-bfbf-bf28199fc70c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 11 05:17:32.306280 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:32.306280 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:32.306280 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:32.306280 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:32.306280 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:32.306280 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:32.306280 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:32.306280 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:32.306280 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:32.306280 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:32.306280 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:32.306280 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 05:17:32.306280 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 05:17:32.306280 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 05:17:32.306280 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 05:17:32.307290 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:32.307290 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:32.307290 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 05:17:32.307290 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 05:17:32.307290 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 05:17:32.307290 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 05:17:32.307290 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:32.307290 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:32.307290 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:32.307290 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:32.307290 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:32.307290 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:32.307290 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:32.307290 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:32.307290 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:32.307290 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:32.307290 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:32.307290 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:32.308283 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:32.308283 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:32.308283 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 05:17:32.308283 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 05:17:32.308283 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 05:17:32.308283 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 05:17:32.308283 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 05:17:32.308283 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 05:17:32.308283 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 11 05:17:32.308283 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:17:32.308283 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 445/888] 10.222.0.16 () {56 vars in 1117 bytes} [Sun Sep 11 05:17:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:32.315253 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73817e62-bed4-4109-8c23-5c3492669574 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:32.325328 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:32.370266 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f95f318-6593-4882-93b5-500b77e6a8a7 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:32.370635 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f95f318-6593-4882-93b5-500b77e6a8a7 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:32.370841 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f95f318-6593-4882-93b5-500b77e6a8a7 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:32.372576 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 446/889] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:17:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:17:32.377339 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ff587-b9cf-4b7e-b518-d57c877ab37f None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:32.377622 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ff587-b9cf-4b7e-b518-d57c877ab37f None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:32.377895 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ff587-b9cf-4b7e-b518-d57c877ab37f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:32.396971 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-0d1ff587-b9cf-4b7e-b518-d57c877ab37f None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:17:32.398221 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-0d1ff587-b9cf-4b7e-b518-d57c877ab37f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:17:32.426083 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73817e62-bed4-4109-8c23-5c3492669574 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:32.461761 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43af31c2-1494-4d59-a933-a1eefbbd965d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:32.462614 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af31c2-1494-4d59-a933-a1eefbbd965d None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:32.463050 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af31c2-1494-4d59-a933-a1eefbbd965d None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:32.463478 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af31c2-1494-4d59-a933-a1eefbbd965d None admin] PATH_INFO: `/v3/users` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:32.464384 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43af31c2-1494-4d59-a933-a1eefbbd965d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:32.464846 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43af31c2-1494-4d59-a933-a1eefbbd965d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:32.466427 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43af31c2-1494-4d59-a933-a1eefbbd965d None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:32.472022 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 447/890] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:17:32 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 05:17:32.485476 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 444/891] 10.222.0.16 () {56 vars in 1149 bytes} [Sun Sep 11 05:17:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:32.492397 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1ff587-b9cf-4b7e-b518-d57c877ab37f None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:32.536045 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:32.594970 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1ff587-b9cf-4b7e-b518-d57c877ab37f None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:32.629268 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704b332b-f96d-4849-acdd-f51ad713ad9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:32.629874 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b332b-f96d-4849-acdd-f51ad713ad9e None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:32.630217 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b332b-f96d-4849-acdd-f51ad713ad9e None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:32.630497 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b332b-f96d-4849-acdd-f51ad713ad9e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:32.698603 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704b332b-f96d-4849-acdd-f51ad713ad9e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:32.700100 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704b332b-f96d-4849-acdd-f51ad713ad9e None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:32.741496 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:32.753963 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43af31c2-1494-4d59-a933-a1eefbbd965d None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:32.806663 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 448/892] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 05:17:32 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 05:17:32.813216 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704b332b-f96d-4849-acdd-f51ad713ad9e None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:32.848140 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:32.902422 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43af31c2-1494-4d59-a933-a1eefbbd965d None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:32.921193 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704b332b-f96d-4849-acdd-f51ad713ad9e None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:32.940908 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98b6d3d-c010-4909-a207-47b10e8eb468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:32.941872 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98b6d3d-c010-4909-a207-47b10e8eb468 None admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:32.942448 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98b6d3d-c010-4909-a207-47b10e8eb468 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:32.943440 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98b6d3d-c010-4909-a207-47b10e8eb468 None admin] PATH_INFO: `/v3/services` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:32.944449 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98b6d3d-c010-4909-a207-47b10e8eb468 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:32.946013 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98b6d3d-c010-4909-a207-47b10e8eb468 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:32.962950 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0924d19a-3396-4a43-9844-9edaa32acffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:32.963708 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0924d19a-3396-4a43-9844-9edaa32acffb None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:32.963909 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0924d19a-3396-4a43-9844-9edaa32acffb None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:32.964139 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 445/893] 10.222.0.16 () {60 vars in 1141 bytes} [Sun Sep 11 05:17:32 2022] POST /identity/v3/services => generated 241 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 05:17:32.964240 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0924d19a-3396-4a43-9844-9edaa32acffb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:32.975248 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:32.976630 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0924d19a-3396-4a43-9844-9edaa32acffb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:32.978636 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0924d19a-3396-4a43-9844-9edaa32acffb None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:32.997140 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-0924d19a-3396-4a43-9844-9edaa32acffb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:17:32.997140 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:32.997140 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:32.997140 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:32.997140 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:32.997140 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:32.997140 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:32.997140 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:32.997140 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:32.997140 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:32.997140 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:32.997140 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:32.997140 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 05:17:32.997140 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 05:17:32.997140 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 05:17:32.997140 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 05:17:32.998343 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:32.998343 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:32.998343 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:32.998343 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:32.998343 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:32.998343 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:32.998343 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:32.998343 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:32.998343 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:32.998343 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:32.998343 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:32.998343 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:32.998343 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:32.998343 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:32.998343 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:32.998343 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:32.998343 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 05:17:32.999486 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 05:17:32.999486 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:17:32.999486 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:17:33.000880 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 449/894] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:17:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:33.007332 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98b6d3d-c010-4909-a207-47b10e8eb468 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:33.129494 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98b6d3d-c010-4909-a207-47b10e8eb468 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:33.151543 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:33.168238 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d4f3fb-6e57-45d1-8bd0-48db4c7c62ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:33.168453 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4f3fb-6e57-45d1-8bd0-48db4c7c62ea None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:33.168676 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4f3fb-6e57-45d1-8bd0-48db4c7c62ea None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:33.168948 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4f3fb-6e57-45d1-8bd0-48db4c7c62ea None admin] PATH_INFO: `/v3/domains` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:33.169587 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d4f3fb-6e57-45d1-8bd0-48db4c7c62ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:33.169889 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d4f3fb-6e57-45d1-8bd0-48db4c7c62ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:33.171286 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d4f3fb-6e57-45d1-8bd0-48db4c7c62ea None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:33.187089 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 446/895] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 05:17:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:33.192674 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0924d19a-3396-4a43-9844-9edaa32acffb None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:33.300871 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0924d19a-3396-4a43-9844-9edaa32acffb None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:33.305015 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65240b8c-d980-49b7-a1c8-108e20bc6169 None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:33.305301 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65240b8c-d980-49b7-a1c8-108e20bc6169 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:33.305577 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65240b8c-d980-49b7-a1c8-108e20bc6169 None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:33.308281 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 447/896] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:17:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:17:33.312337 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023788c-7b6a-4d6f-ae2f-6abf46310a5f None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:33.312625 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023788c-7b6a-4d6f-ae2f-6abf46310a5f None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:33.312903 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023788c-7b6a-4d6f-ae2f-6abf46310a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:33.334890 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-7023788c-7b6a-4d6f-ae2f-6abf46310a5f None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:17:33.336331 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-7023788c-7b6a-4d6f-ae2f-6abf46310a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:17:33.345536 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a1fbe6-a078-4b7d-92cf-6ec9dfab2ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:33.346626 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a1fbe6-a078-4b7d-92cf-6ec9dfab2ce6 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:33.346949 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a1fbe6-a078-4b7d-92cf-6ec9dfab2ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:33.347224 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a1fbe6-a078-4b7d-92cf-6ec9dfab2ce6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:33.357439 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a1fbe6-a078-4b7d-92cf-6ec9dfab2ce6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:33.359484 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a1fbe6-a078-4b7d-92cf-6ec9dfab2ce6 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:33.375274 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-12a1fbe6-a078-4b7d-92cf-6ec9dfab2ce6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 05:17:33.375274 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:33.375274 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:33.375274 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:33.375274 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:33.375274 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:33.375274 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:33.375274 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:33.375274 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:33.375274 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:33.375274 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:33.375274 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:33.375274 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 05:17:33.375274 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 05:17:33.375274 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 05:17:33.376282 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 05:17:33.376282 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:33.376282 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:33.376282 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:33.376282 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:33.376282 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:33.376282 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:33.376282 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:33.376282 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:33.376282 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:33.376282 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:33.376282 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:33.376282 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:33.376282 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:33.376282 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:33.376282 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:33.376282 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:33.377195 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 05:17:33.377195 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 05:17:33.377195 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 05:17:33.377195 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 05:17:33.377195 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 05:17:33.377195 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 05:17:33.377195 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 05:17:33.377195 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:17:33.377195 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 450/897] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 05:17:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 05:17:33.383819 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a1fbe6-a078-4b7d-92cf-6ec9dfab2ce6 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:33.423826 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 448/898] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:17:33 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 05:17:33.439202 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:33.487545 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a1fbe6-a078-4b7d-92cf-6ec9dfab2ce6 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:33.523280 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e317845-69af-45ca-81a6-c742dc9d1b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:33.523925 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e317845-69af-45ca-81a6-c742dc9d1b41 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:33.524199 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e317845-69af-45ca-81a6-c742dc9d1b41 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:33.524469 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e317845-69af-45ca-81a6-c742dc9d1b41 None admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:33.525172 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e317845-69af-45ca-81a6-c742dc9d1b41 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:33.525458 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e317845-69af-45ca-81a6-c742dc9d1b41 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:33.528280 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e317845-69af-45ca-81a6-c742dc9d1b41 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:33.540950 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 451/899] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 05:17:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:33.547242 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7023788c-7b6a-4d6f-ae2f-6abf46310a5f None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:33.659779 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7023788c-7b6a-4d6f-ae2f-6abf46310a5f None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:33.671893 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:33.702061 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d16486-31fb-4ae2-969f-9b53d5be0ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:33.702678 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d16486-31fb-4ae2-969f-9b53d5be0ec0 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:33.702954 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d16486-31fb-4ae2-969f-9b53d5be0ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:33.703223 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d16486-31fb-4ae2-969f-9b53d5be0ec0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:33.703970 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d16486-31fb-4ae2-969f-9b53d5be0ec0 None admin] RBAC: Adding query filter params (role.id=fb8e0aff63fc43b9bb64198f0d940aeb, scope.project.id=61ffb079d9e1437084945554bcc0747b, user.id=62fffbcf330a4bc183d0885c175f5a90) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:33.704277 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d16486-31fb-4ae2-969f-9b53d5be0ec0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:33.705713 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d16486-31fb-4ae2-969f-9b53d5be0ec0 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:33.708950 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e317845-69af-45ca-81a6-c742dc9d1b41 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:33.712400 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 449/900] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 05:17:33 2022] GET /identity/v3/role_assignments?user.id=62fffbcf330a4bc183d0885c175f5a90&scope.project.id=61ffb079d9e1437084945554bcc0747b&role.id=fb8e0aff63fc43b9bb64198f0d940aeb => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:33.842202 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e317845-69af-45ca-81a6-c742dc9d1b41 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:33.846448 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae69a3-4445-42aa-a3e0-4959b7455460 None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:33.846745 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae69a3-4445-42aa-a3e0-4959b7455460 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:33.847005 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae69a3-4445-42aa-a3e0-4959b7455460 None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:33.849305 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 450/901] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:17:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 05:17:33.855029 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4988cc-5b40-4742-9eff-06d0afac7a63 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:33.855308 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4988cc-5b40-4742-9eff-06d0afac7a63 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:33.855587 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4988cc-5b40-4742-9eff-06d0afac7a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:33.862760 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:33.876514 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-bb4988cc-5b40-4742-9eff-06d0afac7a63 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:17:33.878384 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-bb4988cc-5b40-4742-9eff-06d0afac7a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:17:33.892493 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49894c-cf07-4021-875f-db91005a7f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:33.893195 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49894c-cf07-4021-875f-db91005a7f2e None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:33.893478 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49894c-cf07-4021-875f-db91005a7f2e None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:33.893751 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49894c-cf07-4021-875f-db91005a7f2e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:33.894355 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d49894c-cf07-4021-875f-db91005a7f2e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:33.895816 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d49894c-cf07-4021-875f-db91005a7f2e None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:33.906084 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-3d49894c-cf07-4021-875f-db91005a7f2e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 11 05:17:33.906084 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:33.906084 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 05:17:33.906084 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 05:17:33.906084 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 05:17:33.906084 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 05:17:33.906084 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 05:17:33.906084 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 05:17:33.906084 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 11 05:17:33.906084 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:17:33.906084 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 05:17:33.906084 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:17:33.906084 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:33.906084 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:33.906084 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:33.906084 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:33.906084 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:33.907099 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:33.907099 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:33.907099 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:33.907099 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:33.907099 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:33.907099 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:33.907099 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 05:17:33.907099 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 05:17:33.907099 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 05:17:33.907099 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 05:17:33.907099 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:33.907099 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:33.907099 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:33.907099 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:33.907099 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:33.907099 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:33.907973 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:33.907973 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:33.907973 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:33.907973 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:33.907973 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:33.907973 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:33.907973 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:33.907973 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:33.907973 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:33.907973 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:33.907973 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 05:17:33.907973 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 05:17:33.907973 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 11 05:17:33.907973 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:17:33.907973 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 452/902] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 11 05:17:33 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 05:17:33.914609 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49894c-cf07-4021-875f-db91005a7f2e None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:33.963422 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 451/903] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:17:33 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 05:17:34.037516 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49894c-cf07-4021-875f-db91005a7f2e None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:34.076103 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9d0d63-55c5-4bb3-9ffe-a25d40c2585e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:34.076711 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d0d63-55c5-4bb3-9ffe-a25d40c2585e None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:34.077046 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d0d63-55c5-4bb3-9ffe-a25d40c2585e None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:34.077318 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d0d63-55c5-4bb3-9ffe-a25d40c2585e None admin] PATH_INFO: `/v3/services` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:34.077994 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9d0d63-55c5-4bb3-9ffe-a25d40c2585e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:34.078300 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9d0d63-55c5-4bb3-9ffe-a25d40c2585e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:34.079752 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9d0d63-55c5-4bb3-9ffe-a25d40c2585e None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:34.085467 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 453/904] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 11 05:17:33 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:17:34.090975 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4988cc-5b40-4742-9eff-06d0afac7a63 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:34.192412 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4988cc-5b40-4742-9eff-06d0afac7a63 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:34.194709 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:34.229099 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336bd587-e130-4775-b054-20ae15ac8d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:34.229779 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336bd587-e130-4775-b054-20ae15ac8d27 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:34.230061 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336bd587-e130-4775-b054-20ae15ac8d27 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:34.230333 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336bd587-e130-4775-b054-20ae15ac8d27 None admin] PATH_INFO: `/v3/services` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:34.231018 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336bd587-e130-4775-b054-20ae15ac8d27 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:34.231326 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336bd587-e130-4775-b054-20ae15ac8d27 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:34.232737 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336bd587-e130-4775-b054-20ae15ac8d27 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:34.238250 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9d0d63-55c5-4bb3-9ffe-a25d40c2585e None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:34.245174 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 452/905] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 11 05:17:34 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:34.248534 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336bd587-e130-4775-b054-20ae15ac8d27 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:34.298669 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:34.365632 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336bd587-e130-4775-b054-20ae15ac8d27 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:34.371378 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9d0d63-55c5-4bb3-9ffe-a25d40c2585e None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:34.402239 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ded048-763f-41c6-bf96-ad800b774221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:34.402952 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ded048-763f-41c6-bf96-ad800b774221 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:34.403232 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ded048-763f-41c6-bf96-ad800b774221 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:34.403505 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ded048-763f-41c6-bf96-ad800b774221 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:34.404480 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ded048-763f-41c6-bf96-ad800b774221 None admin] RBAC: Adding query filter params (interface=public, service_id=675fc39c6a994b168f5a042c5cbf2569, region_id=RegionOne) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:34.404687 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ded048-763f-41c6-bf96-ad800b774221 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:34.406011 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ded048-763f-41c6-bf96-ad800b774221 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:34.409985 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc24dd-6141-44f3-a172-6cee2347d1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:34.410869 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc24dd-6141-44f3-a172-6cee2347d1ed None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:34.411908 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc24dd-6141-44f3-a172-6cee2347d1ed None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:34.412400 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc24dd-6141-44f3-a172-6cee2347d1ed None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:34.412584 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 453/906] 10.222.0.16 () {56 vars in 1251 bytes} [Sun Sep 11 05:17:34 2022] GET /identity/v3/endpoints?service_id=675fc39c6a994b168f5a042c5cbf2569&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:17:34.413324 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcc24dd-6141-44f3-a172-6cee2347d1ed None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:34.414704 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcc24dd-6141-44f3-a172-6cee2347d1ed None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:34.419896 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ded048-763f-41c6-bf96-ad800b774221 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:34.424315 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-6bcc24dd-6141-44f3-a172-6cee2347d1ed None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 11 05:17:34.424315 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:34.424315 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 05:17:34.424315 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 05:17:34.424315 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 05:17:34.424315 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 05:17:34.424315 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 05:17:34.424315 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 05:17:34.424315 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 11 05:17:34.424315 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:17:34.424315 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 05:17:34.424315 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:17:34.424315 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:34.424315 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:34.424315 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:34.424315 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:34.425443 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:34.425443 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:34.425443 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:34.425443 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:34.425443 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:34.425443 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:34.425443 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:34.425443 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 05:17:34.425443 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 05:17:34.425443 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 05:17:34.425443 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 05:17:34.425443 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:34.425443 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:34.425443 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:34.425443 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:34.425443 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:34.425443 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:34.426611 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:34.426611 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:34.426611 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:34.426611 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:34.426611 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:34.426611 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:34.426611 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:34.426611 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:34.426611 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:34.426611 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:34.426611 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 05:17:34.426611 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 05:17:34.426611 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 11 05:17:34.426611 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:17:34.430488 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 454/907] 10.222.0.16 () {56 vars in 1132 bytes} [Sun Sep 11 05:17:34 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 05:17:34.431306 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc24dd-6141-44f3-a172-6cee2347d1ed None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:34.457706 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:34.533839 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ded048-763f-41c6-bf96-ad800b774221 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:34.537930 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc24dd-6141-44f3-a172-6cee2347d1ed None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:34.540316 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:34.577903 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833421f8-3a7e-407e-8c38-78b7166691d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:34.578509 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833421f8-3a7e-407e-8c38-78b7166691d0 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:34.578783 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833421f8-3a7e-407e-8c38-78b7166691d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:34.579049 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833421f8-3a7e-407e-8c38-78b7166691d0 None admin] PATH_INFO: `/v3/services` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:34.579667 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833421f8-3a7e-407e-8c38-78b7166691d0 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:34.579989 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833421f8-3a7e-407e-8c38-78b7166691d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:34.581356 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833421f8-3a7e-407e-8c38-78b7166691d0 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:34.585687 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c78dbd-7d08-4461-9d43-104b82b48328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:34.586299 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c78dbd-7d08-4461-9d43-104b82b48328 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:34.586836 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c78dbd-7d08-4461-9d43-104b82b48328 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:34.587109 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c78dbd-7d08-4461-9d43-104b82b48328 None admin] PATH_INFO: `/v3/services` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:34.587729 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c78dbd-7d08-4461-9d43-104b82b48328 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:34.593428 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c78dbd-7d08-4461-9d43-104b82b48328 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:34.593562 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 455/908] 10.222.0.16 () {56 vars in 1126 bytes} [Sun Sep 11 05:17:34 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:17:34.594419 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833421f8-3a7e-407e-8c38-78b7166691d0 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:34.600312 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 454/909] 10.222.0.16 () {56 vars in 1087 bytes} [Sun Sep 11 05:17:34 2022] GET /identity/v3/services => generated 1497 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:17:34.713148 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833421f8-3a7e-407e-8c38-78b7166691d0 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:34.757256 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0faf97-df40-4a59-bdde-123569a3460a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:34.757890 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0faf97-df40-4a59-bdde-123569a3460a None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:34.758163 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0faf97-df40-4a59-bdde-123569a3460a None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:34.758432 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0faf97-df40-4a59-bdde-123569a3460a None admin] PATH_INFO: `/v3/services` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:34.759078 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0faf97-df40-4a59-bdde-123569a3460a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:34.759382 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0faf97-df40-4a59-bdde-123569a3460a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:34.760814 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0faf97-df40-4a59-bdde-123569a3460a None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:34.766957 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 456/910] 10.222.0.16 () {56 vars in 1126 bytes} [Sun Sep 11 05:17:34 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:17:34.773458 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c78dbd-7d08-4461-9d43-104b82b48328 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:34.879859 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:34.887217 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c78dbd-7d08-4461-9d43-104b82b48328 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:34.922236 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc5176f-d074-4f63-b106-0ba47afd93b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:34.923099 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5176f-d074-4f63-b106-0ba47afd93b7 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:34.923560 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5176f-d074-4f63-b106-0ba47afd93b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:34.923994 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5176f-d074-4f63-b106-0ba47afd93b7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:34.924918 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc5176f-d074-4f63-b106-0ba47afd93b7 None admin] RBAC: Adding query filter params (interface=public, service_id=a0adfe04d67a4b4abc5396e02fea27a4, region_id=RegionOne) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:34.925381 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc5176f-d074-4f63-b106-0ba47afd93b7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:34.927429 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc5176f-d074-4f63-b106-0ba47afd93b7 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:34.933204 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 455/911] 10.222.0.16 () {56 vars in 1251 bytes} [Sun Sep 11 05:17:34 2022] GET /identity/v3/endpoints?service_id=a0adfe04d67a4b4abc5396e02fea27a4&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:34.939187 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0faf97-df40-4a59-bdde-123569a3460a None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:34.975729 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:35.048917 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0faf97-df40-4a59-bdde-123569a3460a None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:35.086010 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f417837e-2ab3-4ec9-80d3-193fc3b6365b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:35.086929 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f417837e-2ab3-4ec9-80d3-193fc3b6365b None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:35.087415 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f417837e-2ab3-4ec9-80d3-193fc3b6365b None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:35.087903 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f417837e-2ab3-4ec9-80d3-193fc3b6365b None admin] PATH_INFO: `/v3/services` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:35.088704 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f417837e-2ab3-4ec9-80d3-193fc3b6365b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:35.090396 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f417837e-2ab3-4ec9-80d3-193fc3b6365b None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:35.101419 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 457/912] 10.222.0.16 () {56 vars in 1087 bytes} [Sun Sep 11 05:17:34 2022] GET /identity/v3/services => generated 1497 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:17:35.333563 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c563a-a660-47ea-8bf3-b9c80bb8938f None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:35.334058 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c563a-a660-47ea-8bf3-b9c80bb8938f None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:35.334058 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c563a-a660-47ea-8bf3-b9c80bb8938f None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:35.335629 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 456/913] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:17:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 05:17:35.341001 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3dd987-08c0-4164-87c4-1594f3ceae23 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:35.341295 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3dd987-08c0-4164-87c4-1594f3ceae23 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:35.341574 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3dd987-08c0-4164-87c4-1594f3ceae23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:35.361136 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-1d3dd987-08c0-4164-87c4-1594f3ceae23 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:17:35.362318 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-1d3dd987-08c0-4164-87c4-1594f3ceae23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:17:35.433395 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 458/914] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:17:35 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 05:17:35.715764 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0c563a-a660-47ea-8bf3-b9c80bb8938f None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:35.826390 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0c563a-a660-47ea-8bf3-b9c80bb8938f None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:35.861644 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a3a02d-e1c4-440b-85ed-065356ef8a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:35.862287 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a3a02d-e1c4-440b-85ed-065356ef8a41 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:35.862566 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a3a02d-e1c4-440b-85ed-065356ef8a41 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:35.862851 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a3a02d-e1c4-440b-85ed-065356ef8a41 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:35.863439 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a3a02d-e1c4-440b-85ed-065356ef8a41 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:35.864977 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a3a02d-e1c4-440b-85ed-065356ef8a41 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:35.874454 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-90a3a02d-e1c4-440b-85ed-065356ef8a41 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 05:17:35.874454 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:35.874454 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 05:17:35.874454 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 05:17:35.874454 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 05:17:35.874454 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 05:17:35.874454 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 05:17:35.874454 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 05:17:35.874454 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 05:17:35.874454 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:35.874454 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 05:17:35.874454 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:35.874454 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:35.874454 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:35.874454 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:35.874454 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:35.874454 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:35.875446 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:35.875446 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:35.875446 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:35.875446 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:35.875446 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:35.875446 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:35.875446 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 05:17:35.875446 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 05:17:35.875446 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 05:17:35.875446 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 05:17:35.875446 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:35.875446 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:35.875446 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:35.875446 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:35.875446 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:35.875446 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:35.876318 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:35.876318 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:35.876318 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:35.876318 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:35.876318 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:35.876318 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:35.876318 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:35.876318 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:35.876318 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:35.876318 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:35.876318 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 05:17:35.876318 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 05:17:35.876318 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 05:17:35.876318 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:35.876318 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 457/915] 10.222.0.16 () {56 vars in 1126 bytes} [Sun Sep 11 05:17:35 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:35.882236 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3dd987-08c0-4164-87c4-1594f3ceae23 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:35.913885 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:35.990885 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3dd987-08c0-4164-87c4-1594f3ceae23 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:36.013838 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489f9e0-336a-4f8e-97f1-463501ffea19 None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:36.014153 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489f9e0-336a-4f8e-97f1-463501ffea19 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:36.014387 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489f9e0-336a-4f8e-97f1-463501ffea19 None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:36.015818 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 458/916] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:17:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:17:36.021895 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd23820-2df3-4cdd-8512-e4b8ecdee923 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:36.022176 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd23820-2df3-4cdd-8512-e4b8ecdee923 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:36.022444 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd23820-2df3-4cdd-8512-e4b8ecdee923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:36.034811 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a5aa1f-4f56-4aa0-887f-c4a6455b5c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:36.035435 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a5aa1f-4f56-4aa0-887f-c4a6455b5c50 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:36.035761 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a5aa1f-4f56-4aa0-887f-c4a6455b5c50 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:36.036013 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a5aa1f-4f56-4aa0-887f-c4a6455b5c50 None admin] PATH_INFO: `/v3/services` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:36.037255 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a5aa1f-4f56-4aa0-887f-c4a6455b5c50 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:36.037576 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a5aa1f-4f56-4aa0-887f-c4a6455b5c50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:36.039331 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a5aa1f-4f56-4aa0-887f-c4a6455b5c50 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:36.044567 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-ecd23820-2df3-4cdd-8512-e4b8ecdee923 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:17:36.044790 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 459/917] 10.222.0.16 () {56 vars in 1122 bytes} [Sun Sep 11 05:17:35 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:36.050200 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-ecd23820-2df3-4cdd-8512-e4b8ecdee923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:17:36.052544 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a5aa1f-4f56-4aa0-887f-c4a6455b5c50 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:36.070971 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:36.135832 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 459/918] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:17:36 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 05:17:36.171220 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:36.181409 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a5aa1f-4f56-4aa0-887f-c4a6455b5c50 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:36.219046 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631f8bcf-95a6-4eba-a1fa-bf5c16f0fa3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:36.219655 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631f8bcf-95a6-4eba-a1fa-bf5c16f0fa3c None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:36.219953 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631f8bcf-95a6-4eba-a1fa-bf5c16f0fa3c None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:36.220225 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631f8bcf-95a6-4eba-a1fa-bf5c16f0fa3c None admin] PATH_INFO: `/v3/services` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:36.220850 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631f8bcf-95a6-4eba-a1fa-bf5c16f0fa3c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:36.221151 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631f8bcf-95a6-4eba-a1fa-bf5c16f0fa3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:36.222640 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631f8bcf-95a6-4eba-a1fa-bf5c16f0fa3c None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:36.227884 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 460/919] 10.222.0.16 () {56 vars in 1122 bytes} [Sun Sep 11 05:17:36 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:36.233685 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd23820-2df3-4cdd-8512-e4b8ecdee923 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:36.340744 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd23820-2df3-4cdd-8512-e4b8ecdee923 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:36.378680 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa67f607-cf08-48a0-8e77-603bd1e62288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:36.379594 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa67f607-cf08-48a0-8e77-603bd1e62288 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:36.380114 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa67f607-cf08-48a0-8e77-603bd1e62288 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:36.380589 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa67f607-cf08-48a0-8e77-603bd1e62288 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:36.381513 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa67f607-cf08-48a0-8e77-603bd1e62288 None admin] RBAC: Adding query filter params (interface=public, service_id=ff845fbf7b474602a5cebc4acb51a188, region_id=RegionOne) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:36.382003 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa67f607-cf08-48a0-8e77-603bd1e62288 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:36.383556 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa67f607-cf08-48a0-8e77-603bd1e62288 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:36.389527 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 460/920] 10.222.0.16 () {56 vars in 1251 bytes} [Sun Sep 11 05:17:36 2022] GET /identity/v3/endpoints?service_id=ff845fbf7b474602a5cebc4acb51a188&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:36.395427 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631f8bcf-95a6-4eba-a1fa-bf5c16f0fa3c None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:36.416650 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa67f607-cf08-48a0-8e77-603bd1e62288 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:36.440471 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:36.530027 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631f8bcf-95a6-4eba-a1fa-bf5c16f0fa3c None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:36.540600 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa67f607-cf08-48a0-8e77-603bd1e62288 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:36.573372 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a1c02d-19cb-432c-b0e8-8bbf1b24919c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:36.574541 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1c02d-19cb-432c-b0e8-8bbf1b24919c None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:36.575042 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1c02d-19cb-432c-b0e8-8bbf1b24919c None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:36.575621 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1c02d-19cb-432c-b0e8-8bbf1b24919c None admin] PATH_INFO: `/v3/services` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:36.576733 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a1c02d-19cb-432c-b0e8-8bbf1b24919c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:36.578809 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a1c02d-19cb-432c-b0e8-8bbf1b24919c None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:36.581443 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0af7c8-60db-481b-9a91-d304e988114a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:36.582145 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0af7c8-60db-481b-9a91-d304e988114a None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:36.582494 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0af7c8-60db-481b-9a91-d304e988114a None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:36.582835 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0af7c8-60db-481b-9a91-d304e988114a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:36.596236 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 461/921] 10.222.0.16 () {56 vars in 1087 bytes} [Sun Sep 11 05:17:36 2022] GET /identity/v3/services => generated 1497 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:17:36.603923 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0af7c8-60db-481b-9a91-d304e988114a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:17:36.609030 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-0d0af7c8-60db-481b-9a91-d304e988114a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 11 05:17:36.609030 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:36.609030 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:36.609030 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:36.609030 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:36.609030 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:36.609030 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:36.609030 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:36.609030 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:36.609030 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:36.609030 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:36.609030 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:36.609030 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:17:36.609030 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:17:36.609030 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:17:36.609030 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:17:36.610075 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:17:36.610075 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:17:36.610075 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:17:36.610075 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:17:36.610075 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:36.610075 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:36.610075 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:36.610075 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:36.610075 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:36.610075 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:36.610075 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:36.610075 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:36.610075 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:36.610075 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:36.610075 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:36.610075 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:36.610925 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:36.610925 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:36.610925 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:36.610925 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:36.610925 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:17:36.610925 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:17:36.610925 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:17:36.610925 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:17:36.610925 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:17:36.610925 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:17:36.610925 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 11 05:17:36.610925 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:36.610925 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 461/922] 10.222.0.16 () {56 vars in 1120 bytes} [Sun Sep 11 05:17:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 05:17:36.616889 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a1c02d-19cb-432c-b0e8-8bbf1b24919c None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:36.656092 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:36.731637 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a1c02d-19cb-432c-b0e8-8bbf1b24919c None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:36.772654 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6826e0af-3371-42c4-acfc-5f09e2c21247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:36.775150 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6826e0af-3371-42c4-acfc-5f09e2c21247 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:36.775150 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6826e0af-3371-42c4-acfc-5f09e2c21247 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:36.775150 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6826e0af-3371-42c4-acfc-5f09e2c21247 None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:36.775871 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6826e0af-3371-42c4-acfc-5f09e2c21247 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:36.776366 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6826e0af-3371-42c4-acfc-5f09e2c21247 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:36.779040 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6826e0af-3371-42c4-acfc-5f09e2c21247 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:36.797381 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 462/923] 10.222.0.16 () {56 vars in 1115 bytes} [Sun Sep 11 05:17:36 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:36.798954 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0af7c8-60db-481b-9a91-d304e988114a None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:36.889668 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:36.899085 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db793b-2f7d-4eb5-b38d-ac76f5c07ebe None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:36.899596 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db793b-2f7d-4eb5-b38d-ac76f5c07ebe None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:36.899701 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db793b-2f7d-4eb5-b38d-ac76f5c07ebe None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:36.901117 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 463/924] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:17:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:17:36.906907 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cceb850-2cf0-47f8-9763-2ec37f0ae0e4 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:36.907447 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cceb850-2cf0-47f8-9763-2ec37f0ae0e4 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:36.907953 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cceb850-2cf0-47f8-9763-2ec37f0ae0e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:36.922656 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0af7c8-60db-481b-9a91-d304e988114a None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:36.928664 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-3cceb850-2cf0-47f8-9763-2ec37f0ae0e4 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:17:36.930110 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-3cceb850-2cf0-47f8-9763-2ec37f0ae0e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:17:36.960825 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6793505c-2426-40ae-9b8a-9e3772aa9a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:36.961469 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793505c-2426-40ae-9b8a-9e3772aa9a04 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:36.961748 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793505c-2426-40ae-9b8a-9e3772aa9a04 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:36.962019 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793505c-2426-40ae-9b8a-9e3772aa9a04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:36.979230 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6793505c-2426-40ae-9b8a-9e3772aa9a04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:36.980708 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6793505c-2426-40ae-9b8a-9e3772aa9a04 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:37.001103 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-6793505c-2426-40ae-9b8a-9e3772aa9a04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:17:37.001103 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:37.001103 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:37.001103 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:37.001103 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:37.001103 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:37.001103 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:37.001103 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:37.001103 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:37.001103 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:37.001103 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:37.001103 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:37.001103 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 05:17:37.001103 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 05:17:37.001103 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 05:17:37.001103 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 05:17:37.002142 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:37.002142 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:37.002142 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:37.002142 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:37.002142 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:37.002142 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:37.002142 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:37.002142 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:37.002142 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:37.002142 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:37.002142 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:37.002142 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:37.002142 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:37.002142 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:37.002142 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:37.002142 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:37.002142 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 05:17:37.003059 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 05:17:37.003059 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:17:37.003059 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:37.003059 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 462/925] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:17:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:37.008646 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6793505c-2426-40ae-9b8a-9e3772aa9a04 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:37.017547 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 464/926] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:17:36 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 05:17:37.126552 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6793505c-2426-40ae-9b8a-9e3772aa9a04 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:37.157781 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:37.166017 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be692f65-197e-4047-a350-d0a3c7406ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:37.166631 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be692f65-197e-4047-a350-d0a3c7406ae2 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:37.166909 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be692f65-197e-4047-a350-d0a3c7406ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:37.167181 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be692f65-197e-4047-a350-d0a3c7406ae2 None admin] PATH_INFO: `/v3/domains` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:37.167861 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be692f65-197e-4047-a350-d0a3c7406ae2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:37.168167 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be692f65-197e-4047-a350-d0a3c7406ae2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:37.169541 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be692f65-197e-4047-a350-d0a3c7406ae2 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:37.183251 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 463/927] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 05:17:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:37.188846 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cceb850-2cf0-47f8-9763-2ec37f0ae0e4 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:37.201972 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:37.297000 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be692f65-197e-4047-a350-d0a3c7406ae2 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:37.304115 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cceb850-2cf0-47f8-9763-2ec37f0ae0e4 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:37.341560 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c378e48-2e55-4fa9-8601-9595110c2835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:37.342199 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c378e48-2e55-4fa9-8601-9595110c2835 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:37.342574 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c378e48-2e55-4fa9-8601-9595110c2835 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:37.342847 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c378e48-2e55-4fa9-8601-9595110c2835 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:37.351005 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c378e48-2e55-4fa9-8601-9595110c2835 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:37.352608 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c378e48-2e55-4fa9-8601-9595110c2835 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:37.365489 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-0c378e48-2e55-4fa9-8601-9595110c2835 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 11 05:17:37.365489 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:37.365489 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:37.365489 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:37.365489 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:37.365489 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:37.365489 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:37.365489 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:37.365489 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:37.365489 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:37.365489 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:37.365489 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:37.365489 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 05:17:37.365489 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 05:17:37.365489 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 05:17:37.365489 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 05:17:37.366505 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:37.366505 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:37.366505 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 05:17:37.366505 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 05:17:37.366505 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 05:17:37.366505 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 05:17:37.366505 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:37.366505 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:37.366505 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:37.366505 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:37.366505 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:37.366505 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:37.366505 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:37.366505 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:37.366505 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:37.366505 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:37.366505 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:37.366505 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:37.367749 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:37.367749 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:37.367749 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 05:17:37.367749 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 05:17:37.367749 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 05:17:37.367749 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 05:17:37.367749 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 05:17:37.367749 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 05:17:37.367749 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 11 05:17:37.367749 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:17:37.367749 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 465/928] 10.222.0.16 () {56 vars in 1117 bytes} [Sun Sep 11 05:17:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:37.374522 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c378e48-2e55-4fa9-8601-9595110c2835 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:37.433674 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be692f65-197e-4047-a350-d0a3c7406ae2 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:37.459842 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:37.471735 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfbc149-eeec-4dc0-bad4-d4e749798f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:37.472380 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfbc149-eeec-4dc0-bad4-d4e749798f23 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:37.472683 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfbc149-eeec-4dc0-bad4-d4e749798f23 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:37.472925 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfbc149-eeec-4dc0-bad4-d4e749798f23 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:37.473718 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfbc149-eeec-4dc0-bad4-d4e749798f23 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:37.474948 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfbc149-eeec-4dc0-bad4-d4e749798f23 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:37.483812 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-ecfbc149-eeec-4dc0-bad4-d4e749798f23 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 11 05:17:37.483812 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:37.483812 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 05:17:37.483812 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 05:17:37.483812 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 05:17:37.483812 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 05:17:37.483812 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 05:17:37.483812 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 05:17:37.483812 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 11 05:17:37.483812 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:37.483812 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 05:17:37.483812 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:37.483812 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:37.483812 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:37.483812 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:37.483812 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:37.483812 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:37.484780 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:37.484780 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:37.484780 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:37.484780 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:37.484780 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:37.484780 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:37.484780 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 05:17:37.484780 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 05:17:37.484780 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 05:17:37.484780 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 05:17:37.484780 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:37.484780 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:37.484780 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:37.484780 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:37.484780 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:37.484780 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:37.485643 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:37.485643 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:37.485643 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:37.485643 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:37.485643 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:37.485643 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:37.485643 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:37.485643 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:37.485643 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:37.485643 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:37.485643 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 05:17:37.485643 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 05:17:37.485643 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 11 05:17:37.485643 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:37.485643 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 464/929] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 11 05:17:37 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 05:17:37.487206 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4b96ae-0cc2-4664-acc9-08b5d02c18a3 None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:37.487206 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4b96ae-0cc2-4664-acc9-08b5d02c18a3 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:37.487206 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4b96ae-0cc2-4664-acc9-08b5d02c18a3 None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:37.491738 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 465/930] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:17:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:17:37.491738 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4b96ae-0cc2-4664-acc9-08b5d02c18a3 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:37.501002 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c378e48-2e55-4fa9-8601-9595110c2835 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:37.537222 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b4235a-d621-49dc-a8fb-6b0bb8580edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:37.537864 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b4235a-d621-49dc-a8fb-6b0bb8580edf None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:37.538143 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b4235a-d621-49dc-a8fb-6b0bb8580edf None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:37.538414 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b4235a-d621-49dc-a8fb-6b0bb8580edf None admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:37.539250 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b4235a-d621-49dc-a8fb-6b0bb8580edf None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:37.539560 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b4235a-d621-49dc-a8fb-6b0bb8580edf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:37.541036 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b4235a-d621-49dc-a8fb-6b0bb8580edf None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:37.563371 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 466/931] 10.222.0.16 () {56 vars in 1149 bytes} [Sun Sep 11 05:17:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:37.563371 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16155aa-0c14-4c2c-9afe-0a4fa27c5a8f None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:37.563371 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16155aa-0c14-4c2c-9afe-0a4fa27c5a8f None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:37.563371 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16155aa-0c14-4c2c-9afe-0a4fa27c5a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:37.566110 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:37.580035 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-a16155aa-0c14-4c2c-9afe-0a4fa27c5a8f None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:17:37.581252 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-a16155aa-0c14-4c2c-9afe-0a4fa27c5a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:17:37.623732 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4b96ae-0cc2-4664-acc9-08b5d02c18a3 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:37.667705 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 467/932] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:17:37 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 05:17:37.667705 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16155aa-0c14-4c2c-9afe-0a4fa27c5a8f None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:37.670044 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157bc8f3-744f-4b05-bf47-4ab98ce39a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:37.670662 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157bc8f3-744f-4b05-bf47-4ab98ce39a72 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:37.670942 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157bc8f3-744f-4b05-bf47-4ab98ce39a72 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:37.671216 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157bc8f3-744f-4b05-bf47-4ab98ce39a72 None admin] PATH_INFO: `/v3/services` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:37.671882 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157bc8f3-744f-4b05-bf47-4ab98ce39a72 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:37.672188 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157bc8f3-744f-4b05-bf47-4ab98ce39a72 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:37.673567 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157bc8f3-744f-4b05-bf47-4ab98ce39a72 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:37.680351 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 466/933] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 11 05:17:37 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:37.686687 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157bc8f3-744f-4b05-bf47-4ab98ce39a72 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:37.733618 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:37.783230 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16155aa-0c14-4c2c-9afe-0a4fa27c5a8f None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:37.807621 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157bc8f3-744f-4b05-bf47-4ab98ce39a72 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:37.825073 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32374933-0f60-4126-92eb-c7e07d8f1527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:37.825955 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32374933-0f60-4126-92eb-c7e07d8f1527 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:37.826375 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32374933-0f60-4126-92eb-c7e07d8f1527 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:37.826790 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32374933-0f60-4126-92eb-c7e07d8f1527 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:37.828381 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:37.841657 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32374933-0f60-4126-92eb-c7e07d8f1527 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:37.843522 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32374933-0f60-4126-92eb-c7e07d8f1527 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:37.848293 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b241c6bb-3e00-4b51-a03c-d7fc68c5ef8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:37.849535 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b241c6bb-3e00-4b51-a03c-d7fc68c5ef8e None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:37.849818 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b241c6bb-3e00-4b51-a03c-d7fc68c5ef8e None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:37.850095 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b241c6bb-3e00-4b51-a03c-d7fc68c5ef8e None admin] PATH_INFO: `/v3/services` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:37.850728 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b241c6bb-3e00-4b51-a03c-d7fc68c5ef8e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:37.851031 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b241c6bb-3e00-4b51-a03c-d7fc68c5ef8e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:37.852412 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b241c6bb-3e00-4b51-a03c-d7fc68c5ef8e None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:37.862893 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 467/934] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 11 05:17:37 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:17:37.863079 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-32374933-0f60-4126-92eb-c7e07d8f1527 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:17:37.863079 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:37.863079 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:37.863079 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:37.863079 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:37.863079 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:37.863079 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:37.863079 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:37.863079 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:37.863079 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:37.863079 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:37.863079 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:37.863079 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 05:17:37.863079 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 05:17:37.863079 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 05:17:37.863079 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 05:17:37.863995 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:37.863995 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:37.863995 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:37.863995 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:37.863995 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:37.863995 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:37.863995 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:37.863995 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:37.863995 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:37.863995 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:37.863995 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:37.863995 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:37.863995 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:37.863995 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:37.863995 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:37.863995 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:37.863995 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 05:17:37.864949 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 05:17:37.864949 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:17:37.864949 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:17:37.864949 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 468/935] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:17:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:37.868033 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b241c6bb-3e00-4b51-a03c-d7fc68c5ef8e None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:37.872608 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32374933-0f60-4126-92eb-c7e07d8f1527 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:37.986977 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b241c6bb-3e00-4b51-a03c-d7fc68c5ef8e None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:37.988626 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32374933-0f60-4126-92eb-c7e07d8f1527 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:37.999921 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:38.026094 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401809a8-b0a0-4383-a52f-c1c044ccfbbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:38.026317 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90de04b8-eb2a-426f-8679-6c1226327112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:38.026709 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401809a8-b0a0-4383-a52f-c1c044ccfbbf None admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:38.026920 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de04b8-eb2a-426f-8679-6c1226327112 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:38.027018 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401809a8-b0a0-4383-a52f-c1c044ccfbbf None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:38.027191 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de04b8-eb2a-426f-8679-6c1226327112 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:38.027286 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401809a8-b0a0-4383-a52f-c1c044ccfbbf None admin] PATH_INFO: `/v3/endpoints` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:38.027465 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de04b8-eb2a-426f-8679-6c1226327112 None admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:38.028091 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401809a8-b0a0-4383-a52f-c1c044ccfbbf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:38.028189 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90de04b8-eb2a-426f-8679-6c1226327112 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:38.028425 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90de04b8-eb2a-426f-8679-6c1226327112 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:38.029500 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401809a8-b0a0-4383-a52f-c1c044ccfbbf None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:38.029789 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90de04b8-eb2a-426f-8679-6c1226327112 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:38.046550 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 469/936] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 05:17:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:38.046550 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90de04b8-eb2a-426f-8679-6c1226327112 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:38.059728 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 468/937] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:17:37 2022] POST /identity/v3/endpoints => generated 346 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:17:38.059728 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401809a8-b0a0-4383-a52f-c1c044ccfbbf None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:38.114471 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:38.176690 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90de04b8-eb2a-426f-8679-6c1226327112 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:38.207628 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401809a8-b0a0-4383-a52f-c1c044ccfbbf None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:38.215133 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee462a29-2633-4f31-a668-eb739a85c4d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:38.215976 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee462a29-2633-4f31-a668-eb739a85c4d4 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:38.216357 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee462a29-2633-4f31-a668-eb739a85c4d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:38.216738 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee462a29-2633-4f31-a668-eb739a85c4d4 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:38.217459 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee462a29-2633-4f31-a668-eb739a85c4d4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:38.218986 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee462a29-2633-4f31-a668-eb739a85c4d4 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:38.228808 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-ee462a29-2633-4f31-a668-eb739a85c4d4 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 11 05:17:38.228808 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:38.228808 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 05:17:38.228808 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 05:17:38.228808 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 05:17:38.228808 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 05:17:38.228808 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 05:17:38.228808 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 05:17:38.228808 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 11 05:17:38.228808 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:17:38.228808 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 05:17:38.228808 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:17:38.228808 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:38.228808 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:38.228808 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:38.228808 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:38.230018 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:38.230018 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:38.230018 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:38.230018 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:38.230018 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:38.230018 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:38.230018 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:38.230018 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 05:17:38.230018 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 05:17:38.230018 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 05:17:38.230018 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 05:17:38.230018 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:38.230018 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:38.230018 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:38.230018 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:38.230018 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:38.230018 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:38.230949 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:38.230949 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:38.230949 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:38.230949 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:38.230949 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:38.230949 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:38.230949 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:38.230949 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:38.230949 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:38.230949 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:38.230949 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 05:17:38.230949 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 05:17:38.230949 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 11 05:17:38.230949 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:17:38.231712 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 470/938] 10.222.0.16 () {56 vars in 1132 bytes} [Sun Sep 11 05:17:38 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:38.238622 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee462a29-2633-4f31-a668-eb739a85c4d4 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:38.256271 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d831874-5acf-4fec-b140-97bd3d7deda2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:38.257059 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d831874-5acf-4fec-b140-97bd3d7deda2 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:38.257354 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d831874-5acf-4fec-b140-97bd3d7deda2 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:38.257748 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d831874-5acf-4fec-b140-97bd3d7deda2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:38.265207 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d831874-5acf-4fec-b140-97bd3d7deda2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:38.266658 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d831874-5acf-4fec-b140-97bd3d7deda2 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:38.279880 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-9d831874-5acf-4fec-b140-97bd3d7deda2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 05:17:38.279880 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:38.279880 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:38.279880 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:38.279880 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:38.279880 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:38.279880 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:38.279880 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:38.279880 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:38.279880 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:38.279880 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:38.279880 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:38.279880 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 05:17:38.279880 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 05:17:38.279880 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 05:17:38.280804 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 05:17:38.280804 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:38.280804 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:38.280804 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:38.280804 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:38.280804 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:38.280804 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:38.280804 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:38.280804 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:38.280804 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:38.280804 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:38.280804 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:38.280804 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:38.280804 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:38.280804 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:38.280804 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:38.280804 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:38.281836 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 05:17:38.281836 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 05:17:38.281836 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 05:17:38.281836 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 05:17:38.281836 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 05:17:38.281836 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 05:17:38.281836 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 05:17:38.281836 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:38.281836 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 469/939] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 05:17:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:38.288686 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:38.289203 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d831874-5acf-4fec-b140-97bd3d7deda2 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:38.365822 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee462a29-2633-4f31-a668-eb739a85c4d4 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:38.409992 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:38.413359 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b7982-271c-4f5d-9d13-871a7469e25b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:38.414378 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b7982-271c-4f5d-9d13-871a7469e25b None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:38.415610 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b7982-271c-4f5d-9d13-871a7469e25b None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:38.416529 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b7982-271c-4f5d-9d13-871a7469e25b None admin] PATH_INFO: `/v3/services` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:38.417377 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480b7982-271c-4f5d-9d13-871a7469e25b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:38.417856 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480b7982-271c-4f5d-9d13-871a7469e25b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:38.418121 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d831874-5acf-4fec-b140-97bd3d7deda2 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:38.419954 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480b7982-271c-4f5d-9d13-871a7469e25b None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:38.431874 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 471/940] 10.222.0.16 () {56 vars in 1126 bytes} [Sun Sep 11 05:17:38 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:38.433863 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b7982-271c-4f5d-9d13-871a7469e25b None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:38.465483 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdcda14-8973-4aed-a369-de630f4c039b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:38.466140 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdcda14-8973-4aed-a369-de630f4c039b None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:38.466370 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdcda14-8973-4aed-a369-de630f4c039b None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:38.466640 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdcda14-8973-4aed-a369-de630f4c039b None admin] PATH_INFO: `/v3/projects` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:38.467328 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdcda14-8973-4aed-a369-de630f4c039b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:38.467631 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdcda14-8973-4aed-a369-de630f4c039b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:38.469881 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdcda14-8973-4aed-a369-de630f4c039b None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:38.487765 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 470/941] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 05:17:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:38.493125 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdcda14-8973-4aed-a369-de630f4c039b None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:38.565951 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:38.571707 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b7982-271c-4f5d-9d13-871a7469e25b None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:38.616369 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc38b13-8a2b-43b3-a430-305c5792e4be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:38.617618 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc38b13-8a2b-43b3-a430-305c5792e4be None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:38.618095 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc38b13-8a2b-43b3-a430-305c5792e4be None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:38.618590 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc38b13-8a2b-43b3-a430-305c5792e4be None admin] PATH_INFO: `/v3/services` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:38.619996 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc38b13-8a2b-43b3-a430-305c5792e4be None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:38.620760 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc38b13-8a2b-43b3-a430-305c5792e4be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:38.623097 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc38b13-8a2b-43b3-a430-305c5792e4be None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:38.635719 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdcda14-8973-4aed-a369-de630f4c039b None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:38.636087 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 472/942] 10.222.0.16 () {56 vars in 1126 bytes} [Sun Sep 11 05:17:38 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:17:38.638221 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc38b13-8a2b-43b3-a430-305c5792e4be None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:38.676463 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3590f4-d8f2-4389-a7b9-548b898fafc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:38.677666 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3590f4-d8f2-4389-a7b9-548b898fafc5 None admin] REQUEST_METHOD: `PUT` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:38.677942 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3590f4-d8f2-4389-a7b9-548b898fafc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:38.678219 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3590f4-d8f2-4389-a7b9-548b898fafc5 None admin] PATH_INFO: `/v3/projects/61ffb079d9e1437084945554bcc0747b/users/62fffbcf330a4bc183d0885c175f5a90/roles/fb8e0aff63fc43b9bb64198f0d940aeb` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:38.680455 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3590f4-d8f2-4389-a7b9-548b898fafc5 None admin] RBAC: Authorizing `identity:create_grant(project_id=61ffb079d9e1437084945554bcc0747b, user_id=62fffbcf330a4bc183d0885c175f5a90, role_id=fb8e0aff63fc43b9bb64198f0d940aeb)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:38.682062 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3590f4-d8f2-4389-a7b9-548b898fafc5 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:38.699218 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 471/943] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 11 05:17:38 2022] PUT /identity/v3/projects/61ffb079d9e1437084945554bcc0747b/users/62fffbcf330a4bc183d0885c175f5a90/roles/fb8e0aff63fc43b9bb64198f0d940aeb => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 05:17:38.767824 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc38b13-8a2b-43b3-a430-305c5792e4be None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:38.816349 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed2cf73-8eed-4823-b44e-8d3d2274063e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:38.816983 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed2cf73-8eed-4823-b44e-8d3d2274063e None admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:38.817309 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed2cf73-8eed-4823-b44e-8d3d2274063e None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:38.818170 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed2cf73-8eed-4823-b44e-8d3d2274063e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:38.818874 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed2cf73-8eed-4823-b44e-8d3d2274063e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:38.820401 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed2cf73-8eed-4823-b44e-8d3d2274063e None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:38.851888 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 473/944] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:17:38 2022] POST /identity/v3/endpoints => generated 347 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:17:38.901917 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98369e50-1f9c-4961-b27e-7c14880cd7d4 None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:38.902258 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98369e50-1f9c-4961-b27e-7c14880cd7d4 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:38.902467 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98369e50-1f9c-4961-b27e-7c14880cd7d4 None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:38.904200 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 472/945] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:17:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:17:38.910159 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96cd67b-cef6-42f6-9894-6d835fffb22d None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:38.910489 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96cd67b-cef6-42f6-9894-6d835fffb22d None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:38.910770 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96cd67b-cef6-42f6-9894-6d835fffb22d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:38.934247 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-b96cd67b-cef6-42f6-9894-6d835fffb22d None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:17:38.935532 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-b96cd67b-cef6-42f6-9894-6d835fffb22d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:17:38.951691 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:39.020691 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 474/946] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:17:38 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 05:17:39.288460 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98369e50-1f9c-4961-b27e-7c14880cd7d4 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:39.304781 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:39.392980 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98369e50-1f9c-4961-b27e-7c14880cd7d4 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:39.429581 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bade848-5c15-4ba2-8cf4-70fdf0e3d8d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:39.430281 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bade848-5c15-4ba2-8cf4-70fdf0e3d8d4 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:39.430565 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bade848-5c15-4ba2-8cf4-70fdf0e3d8d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:39.430837 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bade848-5c15-4ba2-8cf4-70fdf0e3d8d4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:39.431422 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bade848-5c15-4ba2-8cf4-70fdf0e3d8d4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:39.432845 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bade848-5c15-4ba2-8cf4-70fdf0e3d8d4 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:39.446645 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-5bade848-5c15-4ba2-8cf4-70fdf0e3d8d4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 05:17:39.446645 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:39.446645 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 05:17:39.446645 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 05:17:39.446645 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 05:17:39.446645 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 05:17:39.446645 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 05:17:39.446645 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 05:17:39.446645 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 05:17:39.446645 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:39.446645 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 05:17:39.446645 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:39.446645 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:39.446645 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:39.446645 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:39.446645 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:39.446645 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:39.447748 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:39.447748 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:39.447748 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:39.447748 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:39.447748 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:39.447748 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:39.447748 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 05:17:39.447748 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 05:17:39.447748 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 05:17:39.447748 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 05:17:39.447748 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:39.447748 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:39.447748 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:39.447748 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:39.447748 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:39.447748 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:39.448613 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:39.448613 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:39.448613 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:39.448613 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:39.448613 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:39.448613 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:39.448613 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:39.448613 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:39.448613 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:39.448613 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:39.448613 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 05:17:39.448613 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 05:17:39.448613 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 05:17:39.448613 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:39.449368 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 473/947] 10.222.0.16 () {56 vars in 1126 bytes} [Sun Sep 11 05:17:39 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:39.455851 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96cd67b-cef6-42f6-9894-6d835fffb22d None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:39.559171 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96cd67b-cef6-42f6-9894-6d835fffb22d None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:39.594467 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de39fe6-8d58-4692-9eb4-321c9449c366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:39.595079 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de39fe6-8d58-4692-9eb4-321c9449c366 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:39.595396 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de39fe6-8d58-4692-9eb4-321c9449c366 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:39.595673 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de39fe6-8d58-4692-9eb4-321c9449c366 None admin] PATH_INFO: `/v3/services` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:39.596325 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de39fe6-8d58-4692-9eb4-321c9449c366 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:39.596626 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de39fe6-8d58-4692-9eb4-321c9449c366 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:39.598006 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de39fe6-8d58-4692-9eb4-321c9449c366 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:39.603893 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 475/948] 10.222.0.16 () {56 vars in 1122 bytes} [Sun Sep 11 05:17:39 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:39.613577 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bade848-5c15-4ba2-8cf4-70fdf0e3d8d4 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:39.698860 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:39.721407 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bade848-5c15-4ba2-8cf4-70fdf0e3d8d4 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:39.762531 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720203bb-9b9e-483a-aff8-05d90795a561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:39.763137 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720203bb-9b9e-483a-aff8-05d90795a561 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:39.763415 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720203bb-9b9e-483a-aff8-05d90795a561 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:39.763705 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720203bb-9b9e-483a-aff8-05d90795a561 None admin] PATH_INFO: `/v3/services` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:39.764359 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720203bb-9b9e-483a-aff8-05d90795a561 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:39.764655 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720203bb-9b9e-483a-aff8-05d90795a561 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:39.766087 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720203bb-9b9e-483a-aff8-05d90795a561 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:39.771615 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 474/949] 10.222.0.16 () {56 vars in 1122 bytes} [Sun Sep 11 05:17:39 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:17:39.777085 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de39fe6-8d58-4692-9eb4-321c9449c366 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:39.798957 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:39.900320 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de39fe6-8d58-4692-9eb4-321c9449c366 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:39.934394 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5538a47c-d66a-44f0-8ff7-21a88627faae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:39.935007 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5538a47c-d66a-44f0-8ff7-21a88627faae None admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:39.935286 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5538a47c-d66a-44f0-8ff7-21a88627faae None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:39.935561 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5538a47c-d66a-44f0-8ff7-21a88627faae None admin] PATH_INFO: `/v3/endpoints` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:39.936262 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5538a47c-d66a-44f0-8ff7-21a88627faae None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:39.937636 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5538a47c-d66a-44f0-8ff7-21a88627faae None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:39.959512 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 476/950] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:17:39 2022] POST /identity/v3/endpoints => generated 349 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:17:40.431608 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6375fd6c-9481-4ea7-864f-99b3b26d2e72 None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:40.432301 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6375fd6c-9481-4ea7-864f-99b3b26d2e72 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:40.432810 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6375fd6c-9481-4ea7-864f-99b3b26d2e72 None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:40.434636 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 475/951] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:17:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:17:40.440053 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25544eb-6b0b-4bd4-8f57-769894257c39 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:40.440900 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25544eb-6b0b-4bd4-8f57-769894257c39 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:40.441375 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25544eb-6b0b-4bd4-8f57-769894257c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:40.461328 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-c25544eb-6b0b-4bd4-8f57-769894257c39 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:17:40.462874 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-c25544eb-6b0b-4bd4-8f57-769894257c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:17:40.529077 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:40.545619 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 477/952] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:17:40 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 05:17:40.817043 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6375fd6c-9481-4ea7-864f-99b3b26d2e72 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:40.928651 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14d843-bd05-4fde-8e84-78f661b52167 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:40.929020 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14d843-bd05-4fde-8e84-78f661b52167 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:40.929343 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14d843-bd05-4fde-8e84-78f661b52167 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:40.930762 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6375fd6c-9481-4ea7-864f-99b3b26d2e72 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:40.931018 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 478/953] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:17:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:17:40.936130 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694524db-acf0-41d7-8570-ce5e8deee6db None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:40.936414 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694524db-acf0-41d7-8570-ce5e8deee6db None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:40.936695 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694524db-acf0-41d7-8570-ce5e8deee6db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:40.959119 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-694524db-acf0-41d7-8570-ce5e8deee6db None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:17:40.960885 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-694524db-acf0-41d7-8570-ce5e8deee6db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:17:40.967598 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddf34da-2480-4a0a-a9f8-31db16c9b333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:40.968252 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf34da-2480-4a0a-a9f8-31db16c9b333 None admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:40.968526 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf34da-2480-4a0a-a9f8-31db16c9b333 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:40.968797 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf34da-2480-4a0a-a9f8-31db16c9b333 None admin] PATH_INFO: `/v3/projects` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:40.969442 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddf34da-2480-4a0a-a9f8-31db16c9b333 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:40.971451 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddf34da-2480-4a0a-a9f8-31db16c9b333 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:40.975237 dv-cinder-856921-1-smb devstack@keystone.service[81383]: WARNING keystone.server.flask.common [None req-dddf34da-2480-4a0a-a9f8-31db16c9b333 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 11 05:17:40.993297 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:40.998843 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.sql.core [None req-dddf34da-2480-4a0a-a9f8-31db16c9b333 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 11 05:17:40.998843 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 11 05:17:40.998843 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [parameters: {'id': '809f28e5f8bf498db5768ce9cd39edd4', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 11 05:17:40.998843 dv-cinder-856921-1-smb devstack@keystone.service[81383]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81383) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 11 05:17:41.007862 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-dddf34da-2480-4a0a-a9f8-31db16c9b333 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 809f28e5f8bf498db5768ce9cd39edd4.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 809f28e5f8bf498db5768ce9cd39edd4. Sep 11 05:17:41.007862 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:41.007862 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 11 05:17:41.007862 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 11 05:17:41.007862 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 11 05:17:41.007862 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 11 05:17:41.007862 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 11 05:17:41.007862 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application result = self._query(query) Sep 11 05:17:41.007862 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 11 05:17:41.007862 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application conn.query(q) Sep 11 05:17:41.007862 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 11 05:17:41.007862 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 11 05:17:41.007862 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 11 05:17:41.008701 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application result.read() Sep 11 05:17:41.008701 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 11 05:17:41.008701 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 11 05:17:41.008701 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 11 05:17:41.008701 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 11 05:17:41.008701 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 11 05:17:41.008701 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 11 05:17:41.008701 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 11 05:17:41.008701 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 11 05:17:41.008701 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 11 05:17:41.008701 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:41.008701 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 11 05:17:41.008701 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:41.008701 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:41.008701 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 11 05:17:41.008701 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 11 05:17:41.008701 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 11 05:17:41.008701 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 11 05:17:41.009676 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 11 05:17:41.009676 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application next(self.gen) Sep 11 05:17:41.009676 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 11 05:17:41.009676 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application yield resource Sep 11 05:17:41.009676 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 11 05:17:41.009676 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application next(self.gen) Sep 11 05:17:41.009676 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 11 05:17:41.009676 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application self.session.rollback() Sep 11 05:17:41.009676 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 11 05:17:41.009676 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application self.force_reraise() Sep 11 05:17:41.009676 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 11 05:17:41.009676 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise self.value Sep 11 05:17:41.009676 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 11 05:17:41.009676 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 11 05:17:41.009676 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 11 05:17:41.009676 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application session.commit() Sep 11 05:17:41.009676 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 11 05:17:41.010618 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 11 05:17:41.010618 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 11 05:17:41.010618 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application self._prepare_impl() Sep 11 05:17:41.010618 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 11 05:17:41.010618 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application self.session.flush() Sep 11 05:17:41.010618 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 11 05:17:41.010618 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application self._flush(objects) Sep 11 05:17:41.010618 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 11 05:17:41.010618 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 11 05:17:41.010618 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 11 05:17:41.010618 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application compat.raise_( Sep 11 05:17:41.010618 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 11 05:17:41.010618 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception Sep 11 05:17:41.010618 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 11 05:17:41.010618 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application flush_context.execute() Sep 11 05:17:41.010618 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 11 05:17:41.010618 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rec.execute(self) Sep 11 05:17:41.011860 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 11 05:17:41.011860 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 11 05:17:41.011860 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 11 05:17:41.011860 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 11 05:17:41.011860 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 11 05:17:41.011860 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 11 05:17:41.011860 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 11 05:17:41.011860 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 11 05:17:41.011860 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 11 05:17:41.011860 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 11 05:17:41.011860 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 11 05:17:41.011860 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 11 05:17:41.011860 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 11 05:17:41.011860 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 11 05:17:41.011860 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 11 05:17:41.012884 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 11 05:17:41.012884 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 11 05:17:41.012884 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception Sep 11 05:17:41.012884 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 11 05:17:41.012884 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 11 05:17:41.012884 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 11 05:17:41.012884 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 11 05:17:41.012884 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 11 05:17:41.012884 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application result = self._query(query) Sep 11 05:17:41.012884 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 11 05:17:41.012884 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application conn.query(q) Sep 11 05:17:41.012884 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 11 05:17:41.012884 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 11 05:17:41.012884 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 11 05:17:41.012884 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application result.read() Sep 11 05:17:41.012884 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 11 05:17:41.012884 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 11 05:17:41.014026 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 11 05:17:41.014026 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 11 05:17:41.014026 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 11 05:17:41.014026 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 11 05:17:41.014026 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 11 05:17:41.014026 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 11 05:17:41.014026 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 11 05:17:41.014026 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 11 05:17:41.014026 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [parameters: {'id': '809f28e5f8bf498db5768ce9cd39edd4', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 11 05:17:41.014026 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 11 05:17:41.014026 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:41.014026 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 05:17:41.014026 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:41.014026 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:41.014026 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 11 05:17:41.015008 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 11 05:17:41.015008 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 11 05:17:41.015008 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 11 05:17:41.015008 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 11 05:17:41.015008 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:41.015008 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 05:17:41.015008 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:41.015008 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:41.015008 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:41.015008 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:41.015008 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:41.015008 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:41.015008 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:41.015008 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:41.015008 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:41.015008 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:41.015008 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:41.016601 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:41.016601 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 11 05:17:41.016601 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 11 05:17:41.016601 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:41.016601 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:41.016601 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 11 05:17:41.016601 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 11 05:17:41.016601 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 809f28e5f8bf498db5768ce9cd39edd4. Sep 11 05:17:41.016601 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:41.016601 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 476/954] 10.222.0.16 () {60 vars in 1140 bytes} [Sun Sep 11 05:17:40 2022] POST /identity/v3/projects => generated 262 bytes in 193 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:41.018241 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddf34da-2480-4a0a-a9f8-31db16c9b333 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:41.063785 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 479/955] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:17:40 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 05:17:41.139160 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddf34da-2480-4a0a-a9f8-31db16c9b333 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:41.174567 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3db823d-3f23-4345-9804-15c916af84ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:41.175207 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db823d-3f23-4345-9804-15c916af84ea None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:41.175480 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db823d-3f23-4345-9804-15c916af84ea None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:41.175777 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db823d-3f23-4345-9804-15c916af84ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:41.182877 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3db823d-3f23-4345-9804-15c916af84ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:41.184627 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3db823d-3f23-4345-9804-15c916af84ea None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:41.203087 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-e3db823d-3f23-4345-9804-15c916af84ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 05:17:41.203087 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:41.203087 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:41.203087 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:41.203087 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:41.203087 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:41.203087 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:41.203087 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:41.203087 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:41.203087 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:41.203087 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:41.203087 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:41.203087 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 05:17:41.203087 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 05:17:41.203087 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 05:17:41.204245 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 05:17:41.204245 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:41.204245 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:41.204245 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:41.204245 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:41.204245 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:41.204245 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:41.204245 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:41.204245 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:41.204245 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:41.204245 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:41.204245 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:41.204245 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:41.204245 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:41.204245 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:41.204245 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:41.204245 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:41.205828 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 05:17:41.205828 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 05:17:41.205828 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 05:17:41.205828 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 05:17:41.205828 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 05:17:41.205828 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 05:17:41.205828 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 05:17:41.205828 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:41.205828 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 477/956] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 05:17:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:41.208894 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694524db-acf0-41d7-8570-ce5e8deee6db None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:41.220947 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab38c5-2783-44a4-8477-89e95c31907f None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:41.221238 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab38c5-2783-44a4-8477-89e95c31907f None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:41.221478 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab38c5-2783-44a4-8477-89e95c31907f None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:41.228286 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 478/957] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:17:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 05:17:41.232755 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d84a6f-1c3e-4dc8-8f62-b07159359fb2 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:41.233035 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d84a6f-1c3e-4dc8-8f62-b07159359fb2 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:41.233303 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d84a6f-1c3e-4dc8-8f62-b07159359fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:41.256025 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-f2d84a6f-1c3e-4dc8-8f62-b07159359fb2 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:17:41.258152 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-f2d84a6f-1c3e-4dc8-8f62-b07159359fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:17:41.325166 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:41.329105 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694524db-acf0-41d7-8570-ce5e8deee6db None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:41.347819 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 479/958] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:17:41 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 05:17:41.355239 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d84a6f-1c3e-4dc8-8f62-b07159359fb2 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:41.360429 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:41.378009 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa8c268-7ad2-4b2e-8cbd-efaa2a1a0167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:41.379010 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa8c268-7ad2-4b2e-8cbd-efaa2a1a0167 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:41.379495 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa8c268-7ad2-4b2e-8cbd-efaa2a1a0167 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:41.380530 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa8c268-7ad2-4b2e-8cbd-efaa2a1a0167 None admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:41.381425 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa8c268-7ad2-4b2e-8cbd-efaa2a1a0167 None admin] RBAC: Adding query filter params (name=service) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:41.382032 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa8c268-7ad2-4b2e-8cbd-efaa2a1a0167 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:41.383835 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa8c268-7ad2-4b2e-8cbd-efaa2a1a0167 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:41.406337 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 480/959] 10.222.0.16 () {56 vars in 1112 bytes} [Sun Sep 11 05:17:41 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:41.477682 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d84a6f-1c3e-4dc8-8f62-b07159359fb2 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:41.522223 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dc8205-04df-47e3-ab8b-a5e532974458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:41.523415 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc8205-04df-47e3-ab8b-a5e532974458 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:41.524023 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc8205-04df-47e3-ab8b-a5e532974458 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:41.524504 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc8205-04df-47e3-ab8b-a5e532974458 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:41.537502 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dc8205-04df-47e3-ab8b-a5e532974458 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:17:41.542921 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-31dc8205-04df-47e3-ab8b-a5e532974458 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 11 05:17:41.542921 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:41.542921 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:41.542921 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:41.542921 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:41.542921 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:41.542921 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:41.542921 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:41.542921 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:41.542921 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:41.542921 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:41.542921 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:41.542921 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:17:41.542921 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:17:41.542921 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:17:41.542921 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:17:41.543890 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:17:41.543890 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:17:41.543890 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:17:41.543890 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:17:41.543890 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:41.543890 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:41.543890 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:41.543890 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:41.543890 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:41.543890 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:41.543890 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:41.543890 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:41.543890 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:41.543890 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:41.543890 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:41.543890 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:41.544859 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:41.544859 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:41.544859 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:41.544859 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:41.544859 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:17:41.544859 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:17:41.544859 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:17:41.544859 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:17:41.544859 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:17:41.544859 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:17:41.544859 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 11 05:17:41.544859 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:41.547653 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 480/960] 10.222.0.16 () {56 vars in 1120 bytes} [Sun Sep 11 05:17:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 05:17:41.554855 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa8c268-7ad2-4b2e-8cbd-efaa2a1a0167 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:41.616116 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dc8205-04df-47e3-ab8b-a5e532974458 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:41.675780 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa8c268-7ad2-4b2e-8cbd-efaa2a1a0167 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:41.683533 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:41.717881 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57bf5d7-aafc-41b4-8b7e-e8e85c9f3b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:41.718501 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57bf5d7-aafc-41b4-8b7e-e8e85c9f3b06 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:41.718775 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57bf5d7-aafc-41b4-8b7e-e8e85c9f3b06 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:41.719040 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57bf5d7-aafc-41b4-8b7e-e8e85c9f3b06 None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:41.719732 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57bf5d7-aafc-41b4-8b7e-e8e85c9f3b06 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:41.720041 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57bf5d7-aafc-41b4-8b7e-e8e85c9f3b06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:41.721989 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57bf5d7-aafc-41b4-8b7e-e8e85c9f3b06 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:41.737978 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 481/961] 10.222.0.16 () {56 vars in 1115 bytes} [Sun Sep 11 05:17:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:41.740656 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57bf5d7-aafc-41b4-8b7e-e8e85c9f3b06 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:41.757830 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dc8205-04df-47e3-ab8b-a5e532974458 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:41.791710 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:41.797046 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a53252-c146-4d21-bdbd-8573cd93908b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:41.797686 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a53252-c146-4d21-bdbd-8573cd93908b None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:41.797960 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a53252-c146-4d21-bdbd-8573cd93908b None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:41.798229 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a53252-c146-4d21-bdbd-8573cd93908b None admin] PATH_INFO: `/v3/services/compute` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:41.798901 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a53252-c146-4d21-bdbd-8573cd93908b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:41.800370 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a53252-c146-4d21-bdbd-8573cd93908b None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:41.809364 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-d2a53252-c146-4d21-bdbd-8573cd93908b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 11 05:17:41.809364 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:41.809364 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 05:17:41.809364 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 05:17:41.809364 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 05:17:41.809364 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 05:17:41.809364 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 05:17:41.809364 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 05:17:41.809364 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 11 05:17:41.809364 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:41.809364 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 05:17:41.809364 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:41.809364 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:41.809364 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:41.809364 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:41.809364 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:41.809364 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:41.810438 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:41.810438 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:41.810438 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:41.810438 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:41.810438 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:41.810438 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:41.810438 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 05:17:41.810438 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 05:17:41.810438 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 05:17:41.810438 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 05:17:41.810438 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:41.810438 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:41.810438 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:41.810438 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:41.810438 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:41.810438 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:41.811292 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:41.811292 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:41.811292 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:41.811292 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:41.811292 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:41.811292 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:41.811292 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:41.811292 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:41.811292 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:41.811292 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:41.811292 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 05:17:41.811292 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 05:17:41.811292 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 11 05:17:41.811292 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:41.815346 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 481/962] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 05:17:41 2022] GET /identity/v3/services/compute => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 05:17:41.816535 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a53252-c146-4d21-bdbd-8573cd93908b None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:41.861091 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57bf5d7-aafc-41b4-8b7e-e8e85c9f3b06 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:41.899237 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b12d41f-7b16-43dc-856a-08686c284893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:41.899971 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12d41f-7b16-43dc-856a-08686c284893 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:41.900356 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12d41f-7b16-43dc-856a-08686c284893 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:41.900642 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12d41f-7b16-43dc-856a-08686c284893 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:41.912864 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b12d41f-7b16-43dc-856a-08686c284893 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:41.914560 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b12d41f-7b16-43dc-856a-08686c284893 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:41.919960 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a53252-c146-4d21-bdbd-8573cd93908b None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:41.930021 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-5b12d41f-7b16-43dc-856a-08686c284893 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:17:41.930021 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:41.930021 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:41.930021 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:41.930021 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:41.930021 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:41.930021 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:41.930021 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:41.930021 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:41.930021 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:41.930021 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:41.930021 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:41.930021 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 05:17:41.930021 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 05:17:41.930021 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 05:17:41.930021 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 05:17:41.932218 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:41.932218 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:41.932218 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:41.932218 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:41.932218 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:41.932218 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:41.932218 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:41.932218 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:41.932218 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:41.932218 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:41.932218 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:41.932218 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:41.932218 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:41.932218 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:41.932218 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:41.932218 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:41.932218 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 05:17:41.934290 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 05:17:41.934290 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:17:41.934290 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:17:41.938889 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 482/963] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:17:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:41.939147 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:41.939315 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b12d41f-7b16-43dc-856a-08686c284893 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:41.955959 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111f971c-fbcb-43e0-b6d7-ac0ece33fe4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:41.956572 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f971c-fbcb-43e0-b6d7-ac0ece33fe4f None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:41.956827 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f971c-fbcb-43e0-b6d7-ac0ece33fe4f None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:41.957101 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f971c-fbcb-43e0-b6d7-ac0ece33fe4f None admin] PATH_INFO: `/v3/services` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:41.957725 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111f971c-fbcb-43e0-b6d7-ac0ece33fe4f None admin] RBAC: Adding query filter params (name=compute) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:41.958117 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111f971c-fbcb-43e0-b6d7-ac0ece33fe4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:41.959486 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111f971c-fbcb-43e0-b6d7-ac0ece33fe4f None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:41.969256 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 482/964] 10.222.0.16 () {56 vars in 1112 bytes} [Sun Sep 11 05:17:41 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:17:41.970441 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111f971c-fbcb-43e0-b6d7-ac0ece33fe4f None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:42.047639 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:42.056818 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b12d41f-7b16-43dc-856a-08686c284893 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:42.074358 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111f971c-fbcb-43e0-b6d7-ac0ece33fe4f None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:42.096057 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dad4cf-379e-418b-aa0d-c70e64988616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:42.096961 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dad4cf-379e-418b-aa0d-c70e64988616 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:42.097398 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dad4cf-379e-418b-aa0d-c70e64988616 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:42.097825 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dad4cf-379e-418b-aa0d-c70e64988616 None admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:42.099330 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dad4cf-379e-418b-aa0d-c70e64988616 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:42.099935 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dad4cf-379e-418b-aa0d-c70e64988616 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:42.101536 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dad4cf-379e-418b-aa0d-c70e64988616 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:42.112330 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb8760a-ff52-4c83-9d71-0dd20a5e7b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:42.112961 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb8760a-ff52-4c83-9d71-0dd20a5e7b9e None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:42.113655 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb8760a-ff52-4c83-9d71-0dd20a5e7b9e None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:42.113655 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb8760a-ff52-4c83-9d71-0dd20a5e7b9e None admin] PATH_INFO: `/v3/services` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:42.114135 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb8760a-ff52-4c83-9d71-0dd20a5e7b9e None admin] RBAC: Adding query filter params (type=compute) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:42.114552 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb8760a-ff52-4c83-9d71-0dd20a5e7b9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:42.116068 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb8760a-ff52-4c83-9d71-0dd20a5e7b9e None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:42.123154 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 483/966] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 05:17:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:17:42.124398 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dad4cf-379e-418b-aa0d-c70e64988616 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:42.128034 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 483/966] 10.222.0.16 () {56 vars in 1112 bytes} [Sun Sep 11 05:17:41 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:17:42.217306 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be5ce51-9e19-4ec4-a2df-1d20aad2f9c9 None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:42.217521 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be5ce51-9e19-4ec4-a2df-1d20aad2f9c9 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:42.218133 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be5ce51-9e19-4ec4-a2df-1d20aad2f9c9 None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:42.219507 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 484/967] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:17:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:17:42.225288 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd202a-961f-4266-9e2b-6a6c4f7a7fe0 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:42.225568 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd202a-961f-4266-9e2b-6a6c4f7a7fe0 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:42.225862 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd202a-961f-4266-9e2b-6a6c4f7a7fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:42.250517 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-44cd202a-961f-4266-9e2b-6a6c4f7a7fe0 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:17:42.251098 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dad4cf-379e-418b-aa0d-c70e64988616 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:42.252288 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-44cd202a-961f-4266-9e2b-6a6c4f7a7fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:17:42.292783 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb78aa60-6111-43e5-b908-c59802897d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:42.293445 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb78aa60-6111-43e5-b908-c59802897d68 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:42.293723 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb78aa60-6111-43e5-b908-c59802897d68 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:42.293995 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb78aa60-6111-43e5-b908-c59802897d68 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:42.297898 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:42.303567 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb78aa60-6111-43e5-b908-c59802897d68 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:42.304773 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb78aa60-6111-43e5-b908-c59802897d68 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:42.322204 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-bb78aa60-6111-43e5-b908-c59802897d68 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 11 05:17:42.322204 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:42.322204 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:42.322204 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:42.322204 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:42.322204 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:42.322204 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:42.322204 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:42.322204 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:42.322204 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:42.322204 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:42.322204 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:42.322204 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 05:17:42.322204 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 05:17:42.322204 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 05:17:42.322204 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 05:17:42.323264 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:42.323264 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:42.323264 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 05:17:42.323264 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 05:17:42.323264 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 05:17:42.323264 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 05:17:42.323264 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:42.323264 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:42.323264 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:42.323264 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:42.323264 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:42.323264 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:42.323264 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:42.323264 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:42.323264 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:42.323264 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:42.323264 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:42.323264 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:42.324429 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:42.324429 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:42.324429 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 05:17:42.324429 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 05:17:42.324429 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 05:17:42.324429 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 05:17:42.324429 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 05:17:42.324429 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 05:17:42.324429 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 11 05:17:42.324429 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:17:42.324429 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 484/968] 10.222.0.16 () {56 vars in 1117 bytes} [Sun Sep 11 05:17:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:42.329533 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb78aa60-6111-43e5-b908-c59802897d68 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:42.342166 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 485/969] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:17:42 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 05:17:42.358086 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:42.449334 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb78aa60-6111-43e5-b908-c59802897d68 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:42.485311 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b0a18e-8eff-4435-8899-0df6d0e672d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:42.486313 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0a18e-8eff-4435-8899-0df6d0e672d1 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:42.486801 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0a18e-8eff-4435-8899-0df6d0e672d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:42.487327 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0a18e-8eff-4435-8899-0df6d0e672d1 None admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:42.488307 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b0a18e-8eff-4435-8899-0df6d0e672d1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:42.488849 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b0a18e-8eff-4435-8899-0df6d0e672d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:42.491049 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b0a18e-8eff-4435-8899-0df6d0e672d1 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:42.509771 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 485/970] 10.222.0.16 () {56 vars in 1149 bytes} [Sun Sep 11 05:17:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:42.518452 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cd202a-961f-4266-9e2b-6a6c4f7a7fe0 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:42.611999 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b0a18e-8eff-4435-8899-0df6d0e672d1 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:42.622096 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cd202a-961f-4266-9e2b-6a6c4f7a7fe0 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:42.657527 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2487aa81-87bf-47e7-9b1f-88f697f0c450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:42.658151 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2487aa81-87bf-47e7-9b1f-88f697f0c450 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:42.658472 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2487aa81-87bf-47e7-9b1f-88f697f0c450 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:42.658810 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2487aa81-87bf-47e7-9b1f-88f697f0c450 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:42.701710 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:42.709263 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:42.737149 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2487aa81-87bf-47e7-9b1f-88f697f0c450 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:42.738818 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2487aa81-87bf-47e7-9b1f-88f697f0c450 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:42.752447 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b0a18e-8eff-4435-8899-0df6d0e672d1 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:42.791476 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48944a98-a1cf-4199-964f-fab7a2a8985d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:42.792349 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48944a98-a1cf-4199-964f-fab7a2a8985d None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:42.792772 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48944a98-a1cf-4199-964f-fab7a2a8985d None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:42.793224 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48944a98-a1cf-4199-964f-fab7a2a8985d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:42.793969 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48944a98-a1cf-4199-964f-fab7a2a8985d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:42.795497 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48944a98-a1cf-4199-964f-fab7a2a8985d None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:42.804886 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-48944a98-a1cf-4199-964f-fab7a2a8985d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 05:17:42.804886 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:42.804886 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 05:17:42.804886 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 05:17:42.804886 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 05:17:42.804886 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 05:17:42.804886 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 05:17:42.804886 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 05:17:42.804886 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 05:17:42.804886 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:17:42.804886 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 05:17:42.804886 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:17:42.804886 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:42.804886 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:42.804886 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:42.804886 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:42.804886 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:42.806108 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:42.806108 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:42.806108 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:42.806108 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:42.806108 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:42.806108 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:42.806108 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 05:17:42.806108 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 05:17:42.806108 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 05:17:42.806108 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 05:17:42.806108 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:42.806108 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:42.806108 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:42.806108 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:42.806108 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:42.806108 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:42.806968 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:42.806968 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:42.806968 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:42.806968 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:42.806968 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:42.806968 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:42.806968 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:42.806968 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:42.806968 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:42.806968 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:42.806968 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 05:17:42.806968 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 05:17:42.806968 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 05:17:42.806968 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:17:42.809304 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 486/971] 10.222.0.16 () {56 vars in 1126 bytes} [Sun Sep 11 05:17:42 2022] GET /identity/v3/services/object-store => generated 93 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:42.819198 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48944a98-a1cf-4199-964f-fab7a2a8985d None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:42.876957 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 486/972] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 05:17:42 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 05:17:42.887721 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2487aa81-87bf-47e7-9b1f-88f697f0c450 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:42.956566 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:42.958985 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48944a98-a1cf-4199-964f-fab7a2a8985d None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:42.990327 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2487aa81-87bf-47e7-9b1f-88f697f0c450 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:43.002033 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad0b2ae-ebbe-46b2-9c46-4fb6305c6254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:43.003136 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad0b2ae-ebbe-46b2-9c46-4fb6305c6254 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:43.003575 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad0b2ae-ebbe-46b2-9c46-4fb6305c6254 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:43.004026 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad0b2ae-ebbe-46b2-9c46-4fb6305c6254 None admin] PATH_INFO: `/v3/services` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:43.005037 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad0b2ae-ebbe-46b2-9c46-4fb6305c6254 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:43.005820 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad0b2ae-ebbe-46b2-9c46-4fb6305c6254 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:43.007776 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad0b2ae-ebbe-46b2-9c46-4fb6305c6254 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:43.009992 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:43.014936 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 487/973] 10.222.0.16 () {56 vars in 1122 bytes} [Sun Sep 11 05:17:42 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:17:43.023338 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad0b2ae-ebbe-46b2-9c46-4fb6305c6254 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:43.031724 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de61a421-f377-455b-8b1c-a1d92b10277b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:43.032687 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de61a421-f377-455b-8b1c-a1d92b10277b None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:43.032799 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de61a421-f377-455b-8b1c-a1d92b10277b None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:43.033022 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de61a421-f377-455b-8b1c-a1d92b10277b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:43.044798 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de61a421-f377-455b-8b1c-a1d92b10277b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:43.046509 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de61a421-f377-455b-8b1c-a1d92b10277b None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:43.064076 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-de61a421-f377-455b-8b1c-a1d92b10277b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:17:43.064076 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:43.064076 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:43.064076 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:43.064076 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:43.064076 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:43.064076 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:43.064076 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:43.064076 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:43.064076 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:43.064076 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:43.064076 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:43.064076 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 05:17:43.064076 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 05:17:43.064076 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 05:17:43.064076 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 05:17:43.065103 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:43.065103 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:43.065103 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:43.065103 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:43.065103 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:43.065103 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:43.065103 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:43.065103 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:43.065103 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:43.065103 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:43.065103 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:43.065103 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:43.065103 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:43.065103 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:43.065103 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:43.065103 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:43.065103 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 05:17:43.065989 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 05:17:43.065989 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:17:43.065989 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:43.070025 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 487/974] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:17:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:43.070869 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de61a421-f377-455b-8b1c-a1d92b10277b None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:43.146883 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad0b2ae-ebbe-46b2-9c46-4fb6305c6254 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:43.189037 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a6dae-1317-4729-90fd-d23b81e50fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:43.190196 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a6dae-1317-4729-90fd-d23b81e50fde None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:43.190908 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a6dae-1317-4729-90fd-d23b81e50fde None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:43.191336 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a6dae-1317-4729-90fd-d23b81e50fde None admin] PATH_INFO: `/v3/services` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:43.192321 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0a6dae-1317-4729-90fd-d23b81e50fde None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:43.192751 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de61a421-f377-455b-8b1c-a1d92b10277b None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:43.192992 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0a6dae-1317-4729-90fd-d23b81e50fde None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:43.194810 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0a6dae-1317-4729-90fd-d23b81e50fde None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:43.201584 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 488/975] 10.222.0.16 () {56 vars in 1122 bytes} [Sun Sep 11 05:17:43 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:17:43.206658 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a6dae-1317-4729-90fd-d23b81e50fde None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:43.221459 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:43.235811 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c83fe3-bbb1-4b77-a830-5e0c7d049239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:43.236979 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c83fe3-bbb1-4b77-a830-5e0c7d049239 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:43.237863 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c83fe3-bbb1-4b77-a830-5e0c7d049239 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:43.238321 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c83fe3-bbb1-4b77-a830-5e0c7d049239 None admin] PATH_INFO: `/v3/domains` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:43.240010 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c83fe3-bbb1-4b77-a830-5e0c7d049239 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:43.240649 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c83fe3-bbb1-4b77-a830-5e0c7d049239 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:43.242577 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c83fe3-bbb1-4b77-a830-5e0c7d049239 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:43.261239 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 488/976] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 05:17:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:43.263147 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c83fe3-bbb1-4b77-a830-5e0c7d049239 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:43.280110 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:43.322053 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a6dae-1317-4729-90fd-d23b81e50fde None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:43.364981 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5915587c-0b75-493c-96bf-49941b6fa2d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:43.365764 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5915587c-0b75-493c-96bf-49941b6fa2d2 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:43.366111 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5915587c-0b75-493c-96bf-49941b6fa2d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:43.366456 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5915587c-0b75-493c-96bf-49941b6fa2d2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:43.367568 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5915587c-0b75-493c-96bf-49941b6fa2d2 None admin] RBAC: Adding query filter params (interface=admin, service_id=ff845fbf7b474602a5cebc4acb51a188, region_id=RegionOne) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:43.368120 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5915587c-0b75-493c-96bf-49941b6fa2d2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:43.369710 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5915587c-0b75-493c-96bf-49941b6fa2d2 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:43.375158 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 489/977] 10.222.0.16 () {56 vars in 1249 bytes} [Sun Sep 11 05:17:43 2022] GET /identity/v3/endpoints?service_id=ff845fbf7b474602a5cebc4acb51a188&interface=admin®ion_id=RegionOne => generated 193 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:43.384954 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5915587c-0b75-493c-96bf-49941b6fa2d2 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:43.394801 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c83fe3-bbb1-4b77-a830-5e0c7d049239 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:43.435494 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf437dc-422f-4883-aae3-fb6e6e237351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:43.436550 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf437dc-422f-4883-aae3-fb6e6e237351 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:43.437151 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf437dc-422f-4883-aae3-fb6e6e237351 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:43.437627 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf437dc-422f-4883-aae3-fb6e6e237351 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:43.446728 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf437dc-422f-4883-aae3-fb6e6e237351 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:43.449245 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf437dc-422f-4883-aae3-fb6e6e237351 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:43.462875 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-9bf437dc-422f-4883-aae3-fb6e6e237351 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 05:17:43.462875 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:43.462875 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:43.462875 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:43.462875 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:43.462875 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:43.462875 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:43.462875 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:43.462875 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:43.462875 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:43.462875 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:43.462875 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:43.462875 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 05:17:43.462875 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 05:17:43.462875 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 05:17:43.463840 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 05:17:43.463840 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:43.463840 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:43.463840 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:43.463840 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:43.463840 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:43.463840 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:43.463840 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:43.463840 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:43.463840 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:43.463840 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:43.463840 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:43.463840 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:43.463840 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:43.463840 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:43.463840 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:43.463840 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:43.464748 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 05:17:43.464748 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 05:17:43.464748 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 05:17:43.464748 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 05:17:43.464748 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 05:17:43.464748 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 05:17:43.464748 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 05:17:43.464748 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:43.471752 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 489/978] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 05:17:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:43.472775 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf437dc-422f-4883-aae3-fb6e6e237351 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:43.514714 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5915587c-0b75-493c-96bf-49941b6fa2d2 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:43.529803 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:43.549350 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:43.560291 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11ac45b-abe4-4ef4-962e-656da534d2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:43.561251 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ac45b-abe4-4ef4-962e-656da534d2f3 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:43.561671 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ac45b-abe4-4ef4-962e-656da534d2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:43.562086 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ac45b-abe4-4ef4-962e-656da534d2f3 None admin] PATH_INFO: `/v3/services` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:43.563036 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11ac45b-abe4-4ef4-962e-656da534d2f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:43.564853 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11ac45b-abe4-4ef4-962e-656da534d2f3 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:43.580141 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 490/979] 10.222.0.16 () {56 vars in 1087 bytes} [Sun Sep 11 05:17:43 2022] GET /identity/v3/services => generated 1497 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:17:43.611106 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf437dc-422f-4883-aae3-fb6e6e237351 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:43.653642 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be58911c-7985-4aba-9d48-24a522332113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:43.654653 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be58911c-7985-4aba-9d48-24a522332113 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:43.655167 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be58911c-7985-4aba-9d48-24a522332113 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:43.655745 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be58911c-7985-4aba-9d48-24a522332113 None admin] PATH_INFO: `/v3/projects` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:43.656758 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be58911c-7985-4aba-9d48-24a522332113 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:43.657335 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be58911c-7985-4aba-9d48-24a522332113 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:43.659026 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be58911c-7985-4aba-9d48-24a522332113 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:43.675583 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 490/980] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 05:17:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:17:43.683933 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11ac45b-abe4-4ef4-962e-656da534d2f3 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:43.748775 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30335665-46b2-42ff-8925-8db37a47073e None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:43.749102 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30335665-46b2-42ff-8925-8db37a47073e None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:43.754897 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30335665-46b2-42ff-8925-8db37a47073e None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:43.759850 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 491/981] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:17:43 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 05:17:43.765126 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef6a67-048f-4568-bbb2-20d059ae51dd None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:43.765359 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef6a67-048f-4568-bbb2-20d059ae51dd None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:43.765631 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef6a67-048f-4568-bbb2-20d059ae51dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:43.785262 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-b6ef6a67-048f-4568-bbb2-20d059ae51dd None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:17:43.787057 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-b6ef6a67-048f-4568-bbb2-20d059ae51dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:17:43.804318 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11ac45b-abe4-4ef4-962e-656da534d2f3 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:43.840734 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1105301a-c365-4af0-882f-2ede716eee23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:43.841420 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1105301a-c365-4af0-882f-2ede716eee23 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:43.841687 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1105301a-c365-4af0-882f-2ede716eee23 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:43.841984 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1105301a-c365-4af0-882f-2ede716eee23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:43.842838 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1105301a-c365-4af0-882f-2ede716eee23 None admin] RBAC: Adding query filter params (role.id=fb8e0aff63fc43b9bb64198f0d940aeb, scope.project.id=61ffb079d9e1437084945554bcc0747b, user.id=62fffbcf330a4bc183d0885c175f5a90) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:43.844382 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1105301a-c365-4af0-882f-2ede716eee23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:43.845862 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1105301a-c365-4af0-882f-2ede716eee23 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:43.852976 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 491/982] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 05:17:43 2022] GET /identity/v3/role_assignments?user.id=62fffbcf330a4bc183d0885c175f5a90&scope.project.id=61ffb079d9e1437084945554bcc0747b&role.id=fb8e0aff63fc43b9bb64198f0d940aeb => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:43.876735 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 492/983] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:17:43 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 05:17:44.147200 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1105301a-c365-4af0-882f-2ede716eee23 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:44.205156 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:44.257952 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1105301a-c365-4af0-882f-2ede716eee23 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:44.297837 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a87739-4fb3-4ffc-8c9a-a0b5ac4ddd0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:44.298452 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a87739-4fb3-4ffc-8c9a-a0b5ac4ddd0f None admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:44.298730 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a87739-4fb3-4ffc-8c9a-a0b5ac4ddd0f None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:44.298997 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a87739-4fb3-4ffc-8c9a-a0b5ac4ddd0f None admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:44.299650 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a87739-4fb3-4ffc-8c9a-a0b5ac4ddd0f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:44.301118 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a87739-4fb3-4ffc-8c9a-a0b5ac4ddd0f None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:44.304246 dv-cinder-856921-1-smb devstack@keystone.service[81384]: WARNING keystone.server.flask.common [None req-e9a87739-4fb3-4ffc-8c9a-a0b5ac4ddd0f None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 11 05:17:44.318857 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.sql.core [None req-e9a87739-4fb3-4ffc-8c9a-a0b5ac4ddd0f None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 11 05:17:44.318857 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 11 05:17:44.318857 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [parameters: {'user_id': 'ec94dd5dbee04ea99b06b7fcd25cded1', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 11 05:17:44.318857 dv-cinder-856921-1-smb devstack@keystone.service[81384]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81384) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 11 05:17:44.335759 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-e9a87739-4fb3-4ffc-8c9a-a0b5ac4ddd0f None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 11 05:17:44.335759 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:44.335759 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 11 05:17:44.335759 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 11 05:17:44.335759 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 11 05:17:44.335759 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 11 05:17:44.335759 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 11 05:17:44.335759 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application result = self._query(query) Sep 11 05:17:44.335759 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 11 05:17:44.335759 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application conn.query(q) Sep 11 05:17:44.335759 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 11 05:17:44.335759 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 11 05:17:44.335759 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 11 05:17:44.335759 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application result.read() Sep 11 05:17:44.335759 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 11 05:17:44.336741 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 11 05:17:44.336741 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 11 05:17:44.336741 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 11 05:17:44.336741 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 11 05:17:44.336741 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 11 05:17:44.336741 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 11 05:17:44.336741 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 11 05:17:44.336741 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 11 05:17:44.336741 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:17:44.336741 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 11 05:17:44.336741 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:17:44.336741 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:44.336741 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 11 05:17:44.336741 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 11 05:17:44.336741 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 11 05:17:44.336741 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 11 05:17:44.336741 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 11 05:17:44.336741 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application next(self.gen) Sep 11 05:17:44.337687 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 11 05:17:44.337687 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application yield resource Sep 11 05:17:44.337687 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 11 05:17:44.337687 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application next(self.gen) Sep 11 05:17:44.337687 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 11 05:17:44.337687 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application self.session.rollback() Sep 11 05:17:44.337687 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 11 05:17:44.337687 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application self.force_reraise() Sep 11 05:17:44.337687 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 11 05:17:44.337687 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise self.value Sep 11 05:17:44.337687 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 11 05:17:44.337687 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 11 05:17:44.337687 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 11 05:17:44.337687 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application session.commit() Sep 11 05:17:44.337687 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 11 05:17:44.337687 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 11 05:17:44.337687 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 11 05:17:44.338590 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application self._prepare_impl() Sep 11 05:17:44.338590 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 11 05:17:44.338590 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application self.session.flush() Sep 11 05:17:44.338590 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 11 05:17:44.338590 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application self._flush(objects) Sep 11 05:17:44.338590 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 11 05:17:44.338590 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 11 05:17:44.338590 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 11 05:17:44.338590 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application compat.raise_( Sep 11 05:17:44.338590 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 11 05:17:44.338590 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception Sep 11 05:17:44.338590 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 11 05:17:44.338590 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application flush_context.execute() Sep 11 05:17:44.338590 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 11 05:17:44.338590 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rec.execute(self) Sep 11 05:17:44.338590 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 11 05:17:44.338590 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 11 05:17:44.339491 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 11 05:17:44.339491 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 11 05:17:44.339491 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 11 05:17:44.339491 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 11 05:17:44.339491 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 11 05:17:44.339491 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 11 05:17:44.339491 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 11 05:17:44.339491 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 11 05:17:44.339491 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 11 05:17:44.339491 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 11 05:17:44.339491 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 11 05:17:44.339491 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 11 05:17:44.339491 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 11 05:17:44.339491 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 11 05:17:44.339491 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 11 05:17:44.339491 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception Sep 11 05:17:44.340404 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 11 05:17:44.340404 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 11 05:17:44.340404 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 11 05:17:44.340404 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 11 05:17:44.340404 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 11 05:17:44.340404 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application result = self._query(query) Sep 11 05:17:44.340404 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 11 05:17:44.340404 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application conn.query(q) Sep 11 05:17:44.340404 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 11 05:17:44.340404 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 11 05:17:44.340404 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 11 05:17:44.340404 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application result.read() Sep 11 05:17:44.340404 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 11 05:17:44.340404 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 11 05:17:44.340404 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 11 05:17:44.340404 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 11 05:17:44.341248 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 11 05:17:44.341248 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 11 05:17:44.341248 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 11 05:17:44.341248 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 11 05:17:44.341248 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 11 05:17:44.341248 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 11 05:17:44.341248 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [parameters: {'user_id': 'ec94dd5dbee04ea99b06b7fcd25cded1', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 11 05:17:44.341248 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 11 05:17:44.341248 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:17:44.341248 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 05:17:44.341248 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:17:44.341248 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:44.341248 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:44.341248 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:44.341248 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:44.342041 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:44.342041 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:44.342041 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:44.342041 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:44.342041 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:44.342041 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:44.342041 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:44.342041 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 11 05:17:44.342041 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 11 05:17:44.342041 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:44.342041 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:44.342041 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 05:17:44.342041 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 05:17:44.342041 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 05:17:44.342041 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 05:17:44.342041 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 11 05:17:44.342041 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 11 05:17:44.342951 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 11 05:17:44.342951 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 11 05:17:44.342951 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 11 05:17:44.342951 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 11 05:17:44.342951 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 11 05:17:44.342951 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:17:44.342951 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 492/984] 10.222.0.16 () {60 vars in 1131 bytes} [Sun Sep 11 05:17:44 2022] POST /identity/v3/users => generated 160 bytes in 191 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:44.344922 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ef6a67-048f-4568-bbb2-20d059ae51dd None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:44.378230 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:44.452701 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ef6a67-048f-4568-bbb2-20d059ae51dd None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:44.456031 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c2fd2a-1648-479f-a557-12f86cb1675b None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:44.456312 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c2fd2a-1648-479f-a557-12f86cb1675b None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:44.456587 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c2fd2a-1648-479f-a557-12f86cb1675b None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:44.465285 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 493/985] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:17:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:17:44.466455 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8604fd53-9e38-4d42-9425-f2648d1e6338 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:44.466735 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8604fd53-9e38-4d42-9425-f2648d1e6338 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:44.467006 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8604fd53-9e38-4d42-9425-f2648d1e6338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:44.485920 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-8604fd53-9e38-4d42-9425-f2648d1e6338 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:17:44.487522 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-8604fd53-9e38-4d42-9425-f2648d1e6338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:17:44.490931 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72385c2d-0e90-485e-86d0-8c3f744e4ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:44.492575 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72385c2d-0e90-485e-86d0-8c3f744e4ab9 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:44.492850 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72385c2d-0e90-485e-86d0-8c3f744e4ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:44.493118 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72385c2d-0e90-485e-86d0-8c3f744e4ab9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:44.504564 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72385c2d-0e90-485e-86d0-8c3f744e4ab9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:44.507503 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72385c2d-0e90-485e-86d0-8c3f744e4ab9 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:44.520572 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-72385c2d-0e90-485e-86d0-8c3f744e4ab9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 11 05:17:44.520572 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:44.520572 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:44.520572 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:44.520572 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:44.520572 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:44.520572 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:44.520572 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:44.520572 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:44.520572 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:44.520572 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:44.520572 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:44.520572 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 05:17:44.520572 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 05:17:44.520572 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 05:17:44.520572 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 05:17:44.521574 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:44.521574 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:44.521574 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 05:17:44.521574 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 05:17:44.521574 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 05:17:44.521574 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 05:17:44.521574 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:44.521574 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:44.521574 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:44.521574 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:44.521574 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:44.521574 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:44.521574 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:44.521574 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:44.521574 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:44.521574 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:44.521574 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:44.521574 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:44.522584 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:44.522584 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:44.522584 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 05:17:44.522584 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 05:17:44.522584 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 05:17:44.522584 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 05:17:44.522584 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 05:17:44.522584 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 05:17:44.522584 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 11 05:17:44.522584 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:44.525346 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 493/986] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 05:17:44 2022] GET /identity/v3/users/cinder => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:44.533100 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72385c2d-0e90-485e-86d0-8c3f744e4ab9 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:44.570523 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 494/987] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:17:44 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 05:17:44.638650 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:44.650898 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72385c2d-0e90-485e-86d0-8c3f744e4ab9 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:44.686499 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4594de78-f115-4fde-b85f-6fa2f9c1d5bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:44.687111 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4594de78-f115-4fde-b85f-6fa2f9c1d5bc None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:44.687389 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4594de78-f115-4fde-b85f-6fa2f9c1d5bc None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:44.687660 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4594de78-f115-4fde-b85f-6fa2f9c1d5bc None admin] PATH_INFO: `/v3/users` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:44.688383 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4594de78-f115-4fde-b85f-6fa2f9c1d5bc None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:44.688686 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4594de78-f115-4fde-b85f-6fa2f9c1d5bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:44.690168 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4594de78-f115-4fde-b85f-6fa2f9c1d5bc None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:44.731935 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 494/988] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 11 05:17:44 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:17:44.851058 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8604fd53-9e38-4d42-9425-f2648d1e6338 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:44.905668 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:44.966486 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8604fd53-9e38-4d42-9425-f2648d1e6338 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:45.003471 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fafd0d-53c2-4dad-a272-c19c1230117b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:45.004074 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fafd0d-53c2-4dad-a272-c19c1230117b None admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:45.004408 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fafd0d-53c2-4dad-a272-c19c1230117b None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:45.004689 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fafd0d-53c2-4dad-a272-c19c1230117b None admin] PATH_INFO: `/v3/services` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:45.005893 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fafd0d-53c2-4dad-a272-c19c1230117b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:45.007395 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fafd0d-53c2-4dad-a272-c19c1230117b None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:45.024734 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 495/989] 10.222.0.16 () {60 vars in 1141 bytes} [Sun Sep 11 05:17:44 2022] POST /identity/v3/services => generated 242 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 05:17:45.901800 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb7dd45-03be-4a8c-8b6a-8a42233203db None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:45.902316 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb7dd45-03be-4a8c-8b6a-8a42233203db None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:45.902442 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb7dd45-03be-4a8c-8b6a-8a42233203db None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:45.903789 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 495/990] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:17:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:17:45.909101 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1466d0-0fd5-4c10-a927-eb5304ac293e None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:45.909518 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1466d0-0fd5-4c10-a927-eb5304ac293e None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:45.909707 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1466d0-0fd5-4c10-a927-eb5304ac293e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:45.930314 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-3d1466d0-0fd5-4c10-a927-eb5304ac293e None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:17:45.931507 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-3d1466d0-0fd5-4c10-a927-eb5304ac293e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:17:46.021733 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 496/991] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:17:45 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 05:17:46.079623 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d030a0-d6fa-41de-bb3a-613cff93b72e None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:46.079992 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d030a0-d6fa-41de-bb3a-613cff93b72e None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:46.080146 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d030a0-d6fa-41de-bb3a-613cff93b72e None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:46.081643 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 496/992] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:17:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:17:46.087116 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb018500-a88b-4132-8942-3fe052430f29 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:46.087411 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb018500-a88b-4132-8942-3fe052430f29 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:46.087701 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb018500-a88b-4132-8942-3fe052430f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:46.108162 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-bb018500-a88b-4132-8942-3fe052430f29 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:17:46.109352 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-bb018500-a88b-4132-8942-3fe052430f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:17:46.137146 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:46.181922 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 497/993] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:17:46 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 05:17:46.291197 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d030a0-d6fa-41de-bb3a-613cff93b72e None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:46.394929 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d030a0-d6fa-41de-bb3a-613cff93b72e None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:46.427977 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3abfcc1-dbd6-47c4-8550-ad1616a30979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:46.428600 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3abfcc1-dbd6-47c4-8550-ad1616a30979 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:46.428874 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3abfcc1-dbd6-47c4-8550-ad1616a30979 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:46.429142 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3abfcc1-dbd6-47c4-8550-ad1616a30979 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:46.429717 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3abfcc1-dbd6-47c4-8550-ad1616a30979 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:46.431070 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3abfcc1-dbd6-47c4-8550-ad1616a30979 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:46.439589 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-b3abfcc1-dbd6-47c4-8550-ad1616a30979 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 05:17:46.439589 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:46.439589 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 05:17:46.439589 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 05:17:46.439589 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 05:17:46.439589 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 05:17:46.439589 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 05:17:46.439589 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 05:17:46.439589 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 05:17:46.439589 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:46.439589 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 05:17:46.439589 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:46.439589 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:46.439589 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:46.439589 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:46.439589 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:46.439589 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:46.440702 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:46.440702 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:46.440702 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:46.440702 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:46.440702 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:46.440702 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:46.440702 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 05:17:46.440702 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 05:17:46.440702 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 05:17:46.440702 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 05:17:46.440702 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:46.440702 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:46.440702 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:46.440702 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:46.440702 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:46.440702 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:46.441987 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:46.441987 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:46.441987 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:46.441987 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:46.441987 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:46.441987 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:46.441987 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:46.441987 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:46.441987 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:46.441987 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:46.441987 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 05:17:46.441987 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 05:17:46.441987 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 05:17:46.441987 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:46.444023 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 497/994] 10.222.0.16 () {56 vars in 1126 bytes} [Sun Sep 11 05:17:46 2022] GET /identity/v3/services/object-store => generated 93 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:46.445568 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb018500-a88b-4132-8942-3fe052430f29 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:46.446794 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3abfcc1-dbd6-47c4-8550-ad1616a30979 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:46.465164 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:46.551470 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb018500-a88b-4132-8942-3fe052430f29 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:46.561337 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3abfcc1-dbd6-47c4-8550-ad1616a30979 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:46.586631 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1a1473-1e16-4a9b-8ed5-807d3a59e4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:46.587290 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a1473-1e16-4a9b-8ed5-807d3a59e4c5 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:46.587554 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a1473-1e16-4a9b-8ed5-807d3a59e4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:46.587861 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a1473-1e16-4a9b-8ed5-807d3a59e4c5 None admin] PATH_INFO: `/v3/services/image` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:46.588448 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1a1473-1e16-4a9b-8ed5-807d3a59e4c5 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:46.589845 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1a1473-1e16-4a9b-8ed5-807d3a59e4c5 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:46.599574 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-6a1a1473-1e16-4a9b-8ed5-807d3a59e4c5 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 11 05:17:46.599574 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:46.599574 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 05:17:46.599574 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 05:17:46.599574 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 05:17:46.599574 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 05:17:46.599574 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 05:17:46.599574 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 05:17:46.599574 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 11 05:17:46.599574 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:17:46.599574 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 05:17:46.599574 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:17:46.599574 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:46.599574 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:46.599574 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:46.599574 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:46.599574 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:46.600838 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:46.600838 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:46.600838 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:46.600838 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:46.600838 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:46.600838 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:46.600838 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 05:17:46.600838 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 05:17:46.600838 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 05:17:46.600838 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 05:17:46.600838 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:46.600838 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:46.600838 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:46.600838 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:46.600838 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:46.600838 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:46.601690 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:46.601690 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:46.601690 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:46.601690 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:46.601690 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:46.601690 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:46.601690 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:46.601690 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:46.601690 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:46.601690 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:46.601690 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 05:17:46.601690 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 05:17:46.601690 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 11 05:17:46.601690 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:17:46.601690 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 498/995] 10.222.0.16 () {56 vars in 1105 bytes} [Sun Sep 11 05:17:46 2022] GET /identity/v3/services/image => generated 86 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:46.605669 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1544c5c6-78b6-4c7d-a3c4-ef8e0d9eeb32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:46.606405 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1544c5c6-78b6-4c7d-a3c4-ef8e0d9eeb32 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:46.606681 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1544c5c6-78b6-4c7d-a3c4-ef8e0d9eeb32 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:46.606807 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1a1473-1e16-4a9b-8ed5-807d3a59e4c5 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:46.606972 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1544c5c6-78b6-4c7d-a3c4-ef8e0d9eeb32 None admin] PATH_INFO: `/v3/services` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:46.607571 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1544c5c6-78b6-4c7d-a3c4-ef8e0d9eeb32 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:46.607917 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1544c5c6-78b6-4c7d-a3c4-ef8e0d9eeb32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:46.609283 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1544c5c6-78b6-4c7d-a3c4-ef8e0d9eeb32 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:46.615391 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 498/996] 10.222.0.16 () {56 vars in 1122 bytes} [Sun Sep 11 05:17:46 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:17:46.621258 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1544c5c6-78b6-4c7d-a3c4-ef8e0d9eeb32 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:46.639358 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:46.710253 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:46.718131 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1a1473-1e16-4a9b-8ed5-807d3a59e4c5 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:46.734525 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1544c5c6-78b6-4c7d-a3c4-ef8e0d9eeb32 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:46.755283 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc05805-e57b-4031-83d6-b3cdc4fe8f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:46.756021 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc05805-e57b-4031-83d6-b3cdc4fe8f1f None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:46.756296 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc05805-e57b-4031-83d6-b3cdc4fe8f1f None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:46.756564 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc05805-e57b-4031-83d6-b3cdc4fe8f1f None admin] PATH_INFO: `/v3/services` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:46.757200 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc05805-e57b-4031-83d6-b3cdc4fe8f1f None admin] RBAC: Adding query filter params (name=image) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:46.757501 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc05805-e57b-4031-83d6-b3cdc4fe8f1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:46.758870 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc05805-e57b-4031-83d6-b3cdc4fe8f1f None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:46.767718 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 499/997] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:17:46 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:46.769616 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc05805-e57b-4031-83d6-b3cdc4fe8f1f None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:46.776990 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5572ef4-b69b-4af1-8e07-d20bf7936f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:46.777610 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5572ef4-b69b-4af1-8e07-d20bf7936f90 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:46.777888 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5572ef4-b69b-4af1-8e07-d20bf7936f90 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:46.778161 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5572ef4-b69b-4af1-8e07-d20bf7936f90 None admin] PATH_INFO: `/v3/services` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:46.778788 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5572ef4-b69b-4af1-8e07-d20bf7936f90 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:46.779090 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5572ef4-b69b-4af1-8e07-d20bf7936f90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:46.780486 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5572ef4-b69b-4af1-8e07-d20bf7936f90 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:46.788806 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 499/998] 10.222.0.16 () {56 vars in 1122 bytes} [Sun Sep 11 05:17:46 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:46.794066 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5572ef4-b69b-4af1-8e07-d20bf7936f90 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:46.871247 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:46.882989 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc05805-e57b-4031-83d6-b3cdc4fe8f1f None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:46.898209 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5572ef4-b69b-4af1-8e07-d20bf7936f90 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:46.918857 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4883222-a9d7-4d1a-a937-5c106a735f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:46.919630 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4883222-a9d7-4d1a-a937-5c106a735f6e None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:46.920065 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4883222-a9d7-4d1a-a937-5c106a735f6e None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:46.920346 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4883222-a9d7-4d1a-a937-5c106a735f6e None admin] PATH_INFO: `/v3/services` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:46.921143 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4883222-a9d7-4d1a-a937-5c106a735f6e None admin] RBAC: Adding query filter params (type=image) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:46.921452 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4883222-a9d7-4d1a-a937-5c106a735f6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:46.923152 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4883222-a9d7-4d1a-a937-5c106a735f6e None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:46.928581 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 500/999] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:17:46 2022] GET /identity/v3/services?type=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:17:46.940508 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3205d2e0-ac44-47fc-8f53-83c10f98740e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:46.941142 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3205d2e0-ac44-47fc-8f53-83c10f98740e None admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:46.941421 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3205d2e0-ac44-47fc-8f53-83c10f98740e None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:46.941691 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3205d2e0-ac44-47fc-8f53-83c10f98740e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:46.942462 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3205d2e0-ac44-47fc-8f53-83c10f98740e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:46.944016 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3205d2e0-ac44-47fc-8f53-83c10f98740e None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:46.964185 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 500/1000] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:17:46 2022] POST /identity/v3/endpoints => generated 325 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 05:17:47.240176 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7003a2d5-c502-41e5-8e8c-774e400db29d None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:47.240360 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7003a2d5-c502-41e5-8e8c-774e400db29d None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:47.240638 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7003a2d5-c502-41e5-8e8c-774e400db29d None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:47.242003 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 501/1001] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:17:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:17:47.247707 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb66384-0cce-42ce-bbcf-66fc820254e4 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:47.248010 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb66384-0cce-42ce-bbcf-66fc820254e4 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:47.248286 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb66384-0cce-42ce-bbcf-66fc820254e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:47.254534 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:47.267532 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-ffb66384-0cce-42ce-bbcf-66fc820254e4 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:17:47.268748 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-ffb66384-0cce-42ce-bbcf-66fc820254e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:17:47.342836 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 501/1002] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:17:47 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 05:17:47.611487 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7003a2d5-c502-41e5-8e8c-774e400db29d None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:47.717490 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7003a2d5-c502-41e5-8e8c-774e400db29d None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:47.755993 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f3f168-436f-48e8-868d-28af29a1ca08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:47.756631 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f3f168-436f-48e8-868d-28af29a1ca08 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:47.756906 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f3f168-436f-48e8-868d-28af29a1ca08 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:47.757219 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f3f168-436f-48e8-868d-28af29a1ca08 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:47.757802 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f3f168-436f-48e8-868d-28af29a1ca08 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:47.759179 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f3f168-436f-48e8-868d-28af29a1ca08 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:47.768169 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-58f3f168-436f-48e8-868d-28af29a1ca08 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 11 05:17:47.768169 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:47.768169 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 05:17:47.768169 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 05:17:47.768169 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 05:17:47.768169 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 05:17:47.768169 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 05:17:47.768169 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 05:17:47.768169 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 11 05:17:47.768169 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:17:47.768169 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 05:17:47.768169 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:17:47.768169 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:47.768169 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:47.768169 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:47.768169 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:47.768169 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:47.769159 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:47.769159 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:47.769159 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:47.769159 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:47.769159 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:47.769159 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:47.769159 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 05:17:47.769159 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 05:17:47.769159 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 05:17:47.769159 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 05:17:47.769159 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:47.769159 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:47.769159 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:47.769159 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:47.769159 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:47.769159 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:47.770002 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:47.770002 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:47.770002 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:47.770002 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:47.770002 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:47.770002 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:47.770002 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:47.770002 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:47.770002 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:47.770002 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:47.770002 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 05:17:47.770002 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 05:17:47.770002 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 11 05:17:47.770002 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:17:47.774754 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 502/1003] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 05:17:47 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:47.775918 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb66384-0cce-42ce-bbcf-66fc820254e4 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:47.882868 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb66384-0cce-42ce-bbcf-66fc820254e4 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:47.909764 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:47.919375 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebc17b3-600a-4ceb-9819-11086ee3c80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:47.920014 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebc17b3-600a-4ceb-9819-11086ee3c80e None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:47.920291 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebc17b3-600a-4ceb-9819-11086ee3c80e None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:47.920558 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebc17b3-600a-4ceb-9819-11086ee3c80e None admin] PATH_INFO: `/v3/services` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:47.921177 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebc17b3-600a-4ceb-9819-11086ee3c80e None admin] RBAC: Adding query filter params (name=compute) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:47.921472 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebc17b3-600a-4ceb-9819-11086ee3c80e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:47.922829 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebc17b3-600a-4ceb-9819-11086ee3c80e None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:47.932831 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 502/1004] 10.222.0.16 () {56 vars in 1112 bytes} [Sun Sep 11 05:17:47 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:47.933763 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f3f168-436f-48e8-868d-28af29a1ca08 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:47.956956 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:48.036020 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f3f168-436f-48e8-868d-28af29a1ca08 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:48.071535 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac6451b-5f56-4322-ab2e-102b5eda756c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:48.072380 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac6451b-5f56-4322-ab2e-102b5eda756c None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:48.072802 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac6451b-5f56-4322-ab2e-102b5eda756c None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:48.073240 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac6451b-5f56-4322-ab2e-102b5eda756c None admin] PATH_INFO: `/v3/services` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:48.074020 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac6451b-5f56-4322-ab2e-102b5eda756c None admin] RBAC: Adding query filter params (type=compute) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:48.074516 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac6451b-5f56-4322-ab2e-102b5eda756c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:48.076105 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac6451b-5f56-4322-ab2e-102b5eda756c None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:48.086495 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 503/1005] 10.222.0.16 () {56 vars in 1112 bytes} [Sun Sep 11 05:17:47 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:17:48.087667 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebc17b3-600a-4ceb-9819-11086ee3c80e None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:48.189032 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebc17b3-600a-4ceb-9819-11086ee3c80e None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:48.222895 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe362d9-d64d-4cd4-a0e6-f142703decdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:48.224087 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe362d9-d64d-4cd4-a0e6-f142703decdd None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:48.224373 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe362d9-d64d-4cd4-a0e6-f142703decdd None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:48.224641 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe362d9-d64d-4cd4-a0e6-f142703decdd None admin] PATH_INFO: `/v3/endpoints` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:48.225340 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe362d9-d64d-4cd4-a0e6-f142703decdd None admin] RBAC: Adding query filter params (interface=public, service_id=9941944966a9461b8ec40bbd0c559c9b, region_id=RegionOne) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:48.225645 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe362d9-d64d-4cd4-a0e6-f142703decdd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:48.227002 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe362d9-d64d-4cd4-a0e6-f142703decdd None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:48.236761 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 503/1006] 10.222.0.16 () {56 vars in 1251 bytes} [Sun Sep 11 05:17:48 2022] GET /identity/v3/endpoints?service_id=9941944966a9461b8ec40bbd0c559c9b&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:48.237920 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac6451b-5f56-4322-ab2e-102b5eda756c None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:48.321030 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:48.338039 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac6451b-5f56-4322-ab2e-102b5eda756c None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:48.371047 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38181d9c-90b6-47ad-8777-f928de5134ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:48.371646 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38181d9c-90b6-47ad-8777-f928de5134ed None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:48.371950 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38181d9c-90b6-47ad-8777-f928de5134ed None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:48.372219 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38181d9c-90b6-47ad-8777-f928de5134ed None admin] PATH_INFO: `/v3/services` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:48.372814 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38181d9c-90b6-47ad-8777-f928de5134ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:48.374175 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38181d9c-90b6-47ad-8777-f928de5134ed None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:48.380408 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 504/1007] 10.222.0.16 () {56 vars in 1087 bytes} [Sun Sep 11 05:17:48 2022] GET /identity/v3/services => generated 1727 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 05:17:49.118604 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99997339-8a64-4104-be7f-e227f45f18e3 None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:49.119116 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99997339-8a64-4104-be7f-e227f45f18e3 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:49.119116 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99997339-8a64-4104-be7f-e227f45f18e3 None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:49.120577 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 504/1008] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:17:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:17:49.125605 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b11c21-f793-47f7-96c8-0e0255c766ee None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:49.126007 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b11c21-f793-47f7-96c8-0e0255c766ee None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:49.126165 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b11c21-f793-47f7-96c8-0e0255c766ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:49.144193 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-85b11c21-f793-47f7-96c8-0e0255c766ee None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:17:49.145949 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-85b11c21-f793-47f7-96c8-0e0255c766ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:17:49.169308 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60577692-5a8f-4d5d-a696-45db23a01740 None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:49.169654 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60577692-5a8f-4d5d-a696-45db23a01740 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:49.169872 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60577692-5a8f-4d5d-a696-45db23a01740 None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:49.171222 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 505/1009] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:17:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 05:17:49.176280 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e0656-b6bf-44ac-83cc-a2b75371ea71 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:49.176664 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e0656-b6bf-44ac-83cc-a2b75371ea71 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:49.177011 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e0656-b6bf-44ac-83cc-a2b75371ea71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:49.197445 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-562e0656-b6bf-44ac-83cc-a2b75371ea71 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:17:49.198637 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-562e0656-b6bf-44ac-83cc-a2b75371ea71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:17:49.217303 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 505/1010] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:17:49 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 05:17:49.254506 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:49.275715 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 506/1011] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:17:49 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 05:17:49.484339 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b11c21-f793-47f7-96c8-0e0255c766ee None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:49.541317 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e0656-b6bf-44ac-83cc-a2b75371ea71 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:49.565252 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:49.588576 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b11c21-f793-47f7-96c8-0e0255c766ee None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:49.624380 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fac01d1-c81b-4758-b882-e94fdf14c364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:49.625672 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fac01d1-c81b-4758-b882-e94fdf14c364 None admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:49.626415 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fac01d1-c81b-4758-b882-e94fdf14c364 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:49.626880 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fac01d1-c81b-4758-b882-e94fdf14c364 None admin] PATH_INFO: `/v3/services` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:49.627745 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fac01d1-c81b-4758-b882-e94fdf14c364 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:49.629506 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fac01d1-c81b-4758-b882-e94fdf14c364 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:49.646835 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 506/1012] 10.222.0.16 () {60 vars in 1141 bytes} [Sun Sep 11 05:17:49 2022] POST /identity/v3/services => generated 242 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:17:49.649187 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e0656-b6bf-44ac-83cc-a2b75371ea71 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:49.694638 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19471956-f2e3-4c76-ab30-240c143ff203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:49.695285 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19471956-f2e3-4c76-ab30-240c143ff203 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:49.695559 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19471956-f2e3-4c76-ab30-240c143ff203 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:49.695858 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19471956-f2e3-4c76-ab30-240c143ff203 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:49.697392 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19471956-f2e3-4c76-ab30-240c143ff203 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:49.698896 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19471956-f2e3-4c76-ab30-240c143ff203 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:49.700845 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 507/1013] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:17:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:17:49.706625 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fac01d1-c81b-4758-b882-e94fdf14c364 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:49.824632 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fac01d1-c81b-4758-b882-e94fdf14c364 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:49.860935 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e47323-6c8e-4c05-979e-98e2634bae1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:49.861923 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e47323-6c8e-4c05-979e-98e2634bae1b None admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:49.862408 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e47323-6c8e-4c05-979e-98e2634bae1b None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:49.862897 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e47323-6c8e-4c05-979e-98e2634bae1b None admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:49.863799 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e47323-6c8e-4c05-979e-98e2634bae1b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:49.865956 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e47323-6c8e-4c05-979e-98e2634bae1b None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:49.876716 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:49.897604 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 507/1014] 10.222.0.16 () {60 vars in 1141 bytes} [Sun Sep 11 05:17:49 2022] POST /identity/v3/projects => generated 311 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:17:50.519263 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a74ae59-8890-4cbf-89d9-68a6d30c7cc0 None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:50.519815 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a74ae59-8890-4cbf-89d9-68a6d30c7cc0 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:50.519815 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a74ae59-8890-4cbf-89d9-68a6d30c7cc0 None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:50.521864 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 508/1015] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:17:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:17:50.526872 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b955c9d4-d7b3-4bc3-8db0-fd1ebda33085 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:50.527323 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b955c9d4-d7b3-4bc3-8db0-fd1ebda33085 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:50.527427 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b955c9d4-d7b3-4bc3-8db0-fd1ebda33085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:50.546786 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-b955c9d4-d7b3-4bc3-8db0-fd1ebda33085 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:17:50.547998 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-b955c9d4-d7b3-4bc3-8db0-fd1ebda33085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:17:50.615429 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 508/1016] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:17:50 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 05:17:50.882666 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a74ae59-8890-4cbf-89d9-68a6d30c7cc0 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:50.933096 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:50.984306 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a74ae59-8890-4cbf-89d9-68a6d30c7cc0 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:51.017463 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8339e13f-a813-4d70-a12f-605d34b69ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:51.018080 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8339e13f-a813-4d70-a12f-605d34b69ba6 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:51.018355 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8339e13f-a813-4d70-a12f-605d34b69ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:51.018620 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8339e13f-a813-4d70-a12f-605d34b69ba6 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:51.019190 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8339e13f-a813-4d70-a12f-605d34b69ba6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:51.020624 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8339e13f-a813-4d70-a12f-605d34b69ba6 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:51.029117 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-8339e13f-a813-4d70-a12f-605d34b69ba6 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 11 05:17:51.029117 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:51.029117 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 05:17:51.029117 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 05:17:51.029117 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 05:17:51.029117 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 05:17:51.029117 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 05:17:51.029117 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 05:17:51.029117 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 11 05:17:51.029117 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:51.029117 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 05:17:51.029117 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:51.029117 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:51.029117 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:51.029117 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:51.029117 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:51.029117 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:51.030130 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:51.030130 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:51.030130 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:51.030130 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:51.030130 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:51.030130 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:51.030130 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 05:17:51.030130 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 05:17:51.030130 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 05:17:51.030130 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 05:17:51.030130 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:51.030130 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:51.030130 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:51.030130 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:51.030130 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:51.030130 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:51.031055 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:51.031055 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:51.031055 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:51.031055 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:51.031055 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:51.031055 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:51.031055 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:51.031055 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:51.031055 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:51.031055 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:51.031055 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 05:17:51.031055 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 05:17:51.031055 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 11 05:17:51.031055 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:51.031055 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 509/1017] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 05:17:50 2022] GET /identity/v3/services/compute => generated 88 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:51.038603 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b955c9d4-d7b3-4bc3-8db0-fd1ebda33085 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:51.137654 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b955c9d4-d7b3-4bc3-8db0-fd1ebda33085 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:51.158386 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:51.183209 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ba26ce-e5f1-4f58-857a-2a62f4d5d5c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:51.183869 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba26ce-e5f1-4f58-857a-2a62f4d5d5c0 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:51.184153 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba26ce-e5f1-4f58-857a-2a62f4d5d5c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:51.184427 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba26ce-e5f1-4f58-857a-2a62f4d5d5c0 None admin] PATH_INFO: `/v3/services` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:51.185069 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ba26ce-e5f1-4f58-857a-2a62f4d5d5c0 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:51.185374 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ba26ce-e5f1-4f58-857a-2a62f4d5d5c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:51.186764 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ba26ce-e5f1-4f58-857a-2a62f4d5d5c0 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:51.196729 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 509/1018] 10.222.0.16 () {56 vars in 1112 bytes} [Sun Sep 11 05:17:51 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:51.197722 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8339e13f-a813-4d70-a12f-605d34b69ba6 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:51.301634 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8339e13f-a813-4d70-a12f-605d34b69ba6 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:51.314998 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:51.336760 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd01f802-8cce-425f-9996-8135f32f4175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:51.337372 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01f802-8cce-425f-9996-8135f32f4175 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:51.337652 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01f802-8cce-425f-9996-8135f32f4175 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:51.337923 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01f802-8cce-425f-9996-8135f32f4175 None admin] PATH_INFO: `/v3/services` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:51.338554 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd01f802-8cce-425f-9996-8135f32f4175 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:51.338855 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd01f802-8cce-425f-9996-8135f32f4175 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:51.340270 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd01f802-8cce-425f-9996-8135f32f4175 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:51.350432 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 510/1019] 10.222.0.16 () {56 vars in 1112 bytes} [Sun Sep 11 05:17:51 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:51.351401 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ba26ce-e5f1-4f58-857a-2a62f4d5d5c0 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:51.453670 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ba26ce-e5f1-4f58-857a-2a62f4d5d5c0 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:51.488368 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1849f4-abde-418d-97f8-08967415dc26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:51.489484 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1849f4-abde-418d-97f8-08967415dc26 None admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:51.489777 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1849f4-abde-418d-97f8-08967415dc26 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:51.490045 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1849f4-abde-418d-97f8-08967415dc26 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:51.490709 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1849f4-abde-418d-97f8-08967415dc26 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:51.492115 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1849f4-abde-418d-97f8-08967415dc26 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:51.511729 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 510/1020] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:17:51 2022] POST /identity/v3/endpoints => generated 334 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:17:51.815075 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff717f9-fc92-4d6a-b3e9-4f53daea45f6 None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:51.815644 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff717f9-fc92-4d6a-b3e9-4f53daea45f6 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:51.815644 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff717f9-fc92-4d6a-b3e9-4f53daea45f6 None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:51.817745 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 511/1021] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:17:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:17:51.823076 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c52595-3d07-4783-a995-bc9cea25879e None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:51.823471 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c52595-3d07-4783-a995-bc9cea25879e None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:51.823659 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c52595-3d07-4783-a995-bc9cea25879e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:51.841614 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-58c52595-3d07-4783-a995-bc9cea25879e None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:17:51.842788 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-58c52595-3d07-4783-a995-bc9cea25879e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:17:51.878026 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:51.918156 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 511/1022] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:17:51 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 05:17:52.147581 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cd3320-011b-4057-ba1f-29514f5cb801 None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:52.148000 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cd3320-011b-4057-ba1f-29514f5cb801 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:52.148170 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cd3320-011b-4057-ba1f-29514f5cb801 None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:52.149645 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 512/1023] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:17:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:17:52.154716 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc00fc-7ae6-4df5-9123-e03e78f6bc76 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:52.155008 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc00fc-7ae6-4df5-9123-e03e78f6bc76 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:52.155288 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc00fc-7ae6-4df5-9123-e03e78f6bc76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:52.173618 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-7ffc00fc-7ae6-4df5-9123-e03e78f6bc76 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:17:52.174812 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-7ffc00fc-7ae6-4df5-9123-e03e78f6bc76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:17:52.188956 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cd3320-011b-4057-ba1f-29514f5cb801 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:52.244590 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 512/1024] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:17:52 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 05:17:52.292901 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cd3320-011b-4057-ba1f-29514f5cb801 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:52.325829 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de9966f-1748-4865-9015-8c6383da48ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:52.326460 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de9966f-1748-4865-9015-8c6383da48ea None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:52.326735 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de9966f-1748-4865-9015-8c6383da48ea None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:52.327002 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de9966f-1748-4865-9015-8c6383da48ea None admin] PATH_INFO: `/v3/services/image` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:52.327582 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de9966f-1748-4865-9015-8c6383da48ea None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:52.328965 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de9966f-1748-4865-9015-8c6383da48ea None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:52.337771 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-2de9966f-1748-4865-9015-8c6383da48ea None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 11 05:17:52.337771 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:52.337771 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 05:17:52.337771 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 05:17:52.337771 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 05:17:52.337771 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 05:17:52.337771 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 05:17:52.337771 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 05:17:52.337771 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 11 05:17:52.337771 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:52.337771 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 05:17:52.337771 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:52.337771 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:52.337771 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:52.337771 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:52.337771 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:52.337771 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:52.338897 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:52.338897 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:52.338897 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:52.338897 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:52.338897 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:52.338897 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:52.338897 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 05:17:52.338897 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 05:17:52.338897 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 05:17:52.338897 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 05:17:52.338897 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:52.338897 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:52.338897 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:52.338897 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:52.338897 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:52.338897 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:52.339788 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:52.339788 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:52.339788 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:52.339788 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:52.339788 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:52.339788 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:52.339788 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:52.339788 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:52.339788 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:52.339788 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:52.339788 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 05:17:52.339788 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 05:17:52.339788 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 11 05:17:52.339788 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:52.343978 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 513/1025] 10.222.0.16 () {56 vars in 1105 bytes} [Sun Sep 11 05:17:52 2022] GET /identity/v3/services/image => generated 86 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 05:17:52.344744 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffc00fc-7ae6-4df5-9123-e03e78f6bc76 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:52.439645 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:52.446791 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffc00fc-7ae6-4df5-9123-e03e78f6bc76 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:52.480735 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cc0e44-565f-4784-9064-835af45f9771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:52.481330 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc0e44-565f-4784-9064-835af45f9771 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:52.481585 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc0e44-565f-4784-9064-835af45f9771 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:52.481859 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc0e44-565f-4784-9064-835af45f9771 None admin] PATH_INFO: `/v3/services` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:52.482485 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cc0e44-565f-4784-9064-835af45f9771 None admin] RBAC: Adding query filter params (name=image) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:52.482784 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cc0e44-565f-4784-9064-835af45f9771 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:52.484266 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cc0e44-565f-4784-9064-835af45f9771 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:52.489712 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 513/1026] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:17:52 2022] GET /identity/v3/services?name=image => generated 122 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:17:52.495808 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de9966f-1748-4865-9015-8c6383da48ea None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:52.538237 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cc0e44-565f-4784-9064-835af45f9771 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:52.541561 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:52.602083 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de9966f-1748-4865-9015-8c6383da48ea None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:52.638114 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cc0e44-565f-4784-9064-835af45f9771 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:52.639197 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e0c467-61a9-45dd-8d7b-3d90eece0492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:52.639831 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e0c467-61a9-45dd-8d7b-3d90eece0492 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:52.640107 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e0c467-61a9-45dd-8d7b-3d90eece0492 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:52.640374 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e0c467-61a9-45dd-8d7b-3d90eece0492 None admin] PATH_INFO: `/v3/services` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:52.641212 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e0c467-61a9-45dd-8d7b-3d90eece0492 None admin] RBAC: Adding query filter params (type=image) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:52.641334 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e0c467-61a9-45dd-8d7b-3d90eece0492 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:52.642632 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e0c467-61a9-45dd-8d7b-3d90eece0492 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:52.647617 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 514/1027] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:17:52 2022] GET /identity/v3/services?type=image => generated 350 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:52.653415 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e0c467-61a9-45dd-8d7b-3d90eece0492 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:52.675213 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91f1a23-0b89-463e-a932-dd2549e84b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:52.676019 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f1a23-0b89-463e-a932-dd2549e84b89 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:52.676297 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f1a23-0b89-463e-a932-dd2549e84b89 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:52.676660 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f1a23-0b89-463e-a932-dd2549e84b89 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:52.677771 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91f1a23-0b89-463e-a932-dd2549e84b89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:52.679193 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91f1a23-0b89-463e-a932-dd2549e84b89 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:52.680779 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 514/1028] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:17:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:17:52.686169 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91f1a23-0b89-463e-a932-dd2549e84b89 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:52.714977 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:52.760142 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e0c467-61a9-45dd-8d7b-3d90eece0492 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:52.768543 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:52.798340 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91f1a23-0b89-463e-a932-dd2549e84b89 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:52.803741 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96850c20-4380-47fa-8c5a-2f78c130007f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:52.804425 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96850c20-4380-47fa-8c5a-2f78c130007f None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:52.804767 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96850c20-4380-47fa-8c5a-2f78c130007f None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:52.805106 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96850c20-4380-47fa-8c5a-2f78c130007f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:52.805967 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96850c20-4380-47fa-8c5a-2f78c130007f None admin] RBAC: Adding query filter params (interface=public, service_id=c25204c535324348af6b9e79c9da15cf, region_id=RegionOne) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:52.806277 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96850c20-4380-47fa-8c5a-2f78c130007f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:52.807632 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96850c20-4380-47fa-8c5a-2f78c130007f None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:52.817463 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 515/1029] 10.222.0.16 () {56 vars in 1251 bytes} [Sun Sep 11 05:17:52 2022] GET /identity/v3/endpoints?service_id=c25204c535324348af6b9e79c9da15cf&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:17:52.818477 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96850c20-4380-47fa-8c5a-2f78c130007f None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:52.834117 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb5b1f-f9ed-402d-aba1-65ff96805d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:52.834806 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb5b1f-f9ed-402d-aba1-65ff96805d2b None admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:52.835008 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb5b1f-f9ed-402d-aba1-65ff96805d2b None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:52.835277 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb5b1f-f9ed-402d-aba1-65ff96805d2b None admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:52.835976 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdb5b1f-f9ed-402d-aba1-65ff96805d2b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:52.837410 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdb5b1f-f9ed-402d-aba1-65ff96805d2b None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:52.860477 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 515/1030] 10.222.0.16 () {60 vars in 1132 bytes} [Sun Sep 11 05:17:52 2022] POST /identity/v3/users => generated 285 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 05:17:52.943617 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96850c20-4380-47fa-8c5a-2f78c130007f None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:52.981315 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9564199-92e6-418c-8645-cefb166562cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:52.981858 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9564199-92e6-418c-8645-cefb166562cc None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:52.982138 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9564199-92e6-418c-8645-cefb166562cc None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:52.982412 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9564199-92e6-418c-8645-cefb166562cc None admin] PATH_INFO: `/v3/services` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:52.983060 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9564199-92e6-418c-8645-cefb166562cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:52.984513 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9564199-92e6-418c-8645-cefb166562cc None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:52.991892 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 516/1031] 10.222.0.16 () {56 vars in 1087 bytes} [Sun Sep 11 05:17:52 2022] GET /identity/v3/services => generated 1957 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:17:53.777429 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e579d5-3b75-4536-8ad1-a656fdbc1775 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:53.777787 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e579d5-3b75-4536-8ad1-a656fdbc1775 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:53.777986 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e579d5-3b75-4536-8ad1-a656fdbc1775 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:53.779366 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 516/1032] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:17:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:17:53.786662 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d916cffd-971f-4c99-838c-1d6ed066b207 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:53.786662 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d916cffd-971f-4c99-838c-1d6ed066b207 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:53.786662 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d916cffd-971f-4c99-838c-1d6ed066b207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:53.804106 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-d916cffd-971f-4c99-838c-1d6ed066b207 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:17:53.805337 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-d916cffd-971f-4c99-838c-1d6ed066b207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:17:53.835169 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:53.879040 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 517/1033] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:17:53 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 05:17:54.143921 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e579d5-3b75-4536-8ad1-a656fdbc1775 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:54.231659 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:54.251307 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e579d5-3b75-4536-8ad1-a656fdbc1775 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:54.285191 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8b56ba-3c6a-4a7d-9499-e436fd2940d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:54.285844 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8b56ba-3c6a-4a7d-9499-e436fd2940d2 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:54.286162 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8b56ba-3c6a-4a7d-9499-e436fd2940d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:54.286439 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8b56ba-3c6a-4a7d-9499-e436fd2940d2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:54.296558 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8b56ba-3c6a-4a7d-9499-e436fd2940d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:17:54.301294 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-6b8b56ba-3c6a-4a7d-9499-e436fd2940d2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 11 05:17:54.301294 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:54.301294 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:54.301294 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:54.301294 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:54.301294 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:54.301294 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:54.301294 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:54.301294 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:54.301294 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:54.301294 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:54.301294 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:54.301294 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:17:54.301294 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:17:54.301294 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:17:54.301294 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:17:54.302737 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:17:54.302737 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:17:54.302737 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:17:54.302737 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:17:54.302737 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:54.302737 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:54.302737 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:54.302737 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:54.302737 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:54.302737 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:54.302737 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:54.302737 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:54.302737 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:54.302737 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:54.302737 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:54.302737 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:54.303594 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:54.303594 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:54.303594 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:54.303594 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:54.303594 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:17:54.303594 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:17:54.303594 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:17:54.303594 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:17:54.303594 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:17:54.303594 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:17:54.303594 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 11 05:17:54.303594 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:17:54.303594 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 517/1034] 10.222.0.16 () {56 vars in 1120 bytes} [Sun Sep 11 05:17:54 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:54.310314 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d916cffd-971f-4c99-838c-1d6ed066b207 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:54.406775 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d916cffd-971f-4c99-838c-1d6ed066b207 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:54.439617 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba1d48-9eff-4a9d-8ea6-68cfbbc43373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:54.440243 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba1d48-9eff-4a9d-8ea6-68cfbbc43373 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:54.440519 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba1d48-9eff-4a9d-8ea6-68cfbbc43373 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:54.440787 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba1d48-9eff-4a9d-8ea6-68cfbbc43373 None admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:54.441433 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ba1d48-9eff-4a9d-8ea6-68cfbbc43373 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:54.441731 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ba1d48-9eff-4a9d-8ea6-68cfbbc43373 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:54.443142 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ba1d48-9eff-4a9d-8ea6-68cfbbc43373 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:54.455798 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 518/1035] 10.222.0.16 () {56 vars in 1115 bytes} [Sun Sep 11 05:17:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:54.457361 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8b56ba-3c6a-4a7d-9499-e436fd2940d2 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:54.557104 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8b56ba-3c6a-4a7d-9499-e436fd2940d2 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:54.590669 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e607eea8-6fed-43ad-b17c-7096592c68ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:54.591296 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607eea8-6fed-43ad-b17c-7096592c68ff None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:54.591569 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607eea8-6fed-43ad-b17c-7096592c68ff None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:54.591948 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607eea8-6fed-43ad-b17c-7096592c68ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:54.602382 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e607eea8-6fed-43ad-b17c-7096592c68ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:54.603865 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e607eea8-6fed-43ad-b17c-7096592c68ff None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:54.606410 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:54.620879 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-e607eea8-6fed-43ad-b17c-7096592c68ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:17:54.620879 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:54.620879 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:54.620879 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:54.620879 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:54.620879 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:54.620879 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:54.620879 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:54.620879 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:54.620879 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:54.620879 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:54.620879 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:54.620879 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 05:17:54.620879 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 05:17:54.620879 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 05:17:54.620879 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 05:17:54.621859 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:54.621859 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:54.621859 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:54.621859 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:54.621859 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:54.621859 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:54.621859 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:54.621859 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:54.621859 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:54.621859 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:54.621859 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:54.621859 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:54.621859 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:54.621859 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:54.621859 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:54.621859 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:54.621859 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 05:17:54.627473 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 05:17:54.627473 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:17:54.627473 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:17:54.627473 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 518/1036] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:17:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 05:17:54.629223 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba1d48-9eff-4a9d-8ea6-68cfbbc43373 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:54.658006 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:54.733683 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba1d48-9eff-4a9d-8ea6-68cfbbc43373 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:54.769998 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ecb8fe-f7da-4c5f-b12c-94b769618613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:54.771670 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ecb8fe-f7da-4c5f-b12c-94b769618613 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:54.772171 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ecb8fe-f7da-4c5f-b12c-94b769618613 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:54.772640 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ecb8fe-f7da-4c5f-b12c-94b769618613 None admin] PATH_INFO: `/v3/domains` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:54.773526 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ecb8fe-f7da-4c5f-b12c-94b769618613 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:54.774044 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ecb8fe-f7da-4c5f-b12c-94b769618613 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:54.775625 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ecb8fe-f7da-4c5f-b12c-94b769618613 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:54.794225 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 519/1037] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 05:17:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:54.795837 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e607eea8-6fed-43ad-b17c-7096592c68ff None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:54.899029 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e607eea8-6fed-43ad-b17c-7096592c68ff None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:54.932326 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f41edb2-d452-4fe1-8568-9eae07288aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:54.932881 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41edb2-d452-4fe1-8568-9eae07288aa6 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:54.933160 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41edb2-d452-4fe1-8568-9eae07288aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:54.933431 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41edb2-d452-4fe1-8568-9eae07288aa6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:54.941437 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f41edb2-d452-4fe1-8568-9eae07288aa6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:54.943441 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f41edb2-d452-4fe1-8568-9eae07288aa6 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:54.954866 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-8f41edb2-d452-4fe1-8568-9eae07288aa6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 11 05:17:54.954866 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:54.954866 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:54.954866 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:54.954866 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:54.954866 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:54.954866 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:54.954866 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:54.954866 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:54.954866 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:54.954866 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:54.954866 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:54.954866 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 05:17:54.954866 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 05:17:54.954866 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 05:17:54.954866 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 05:17:54.955912 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:54.955912 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:54.955912 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 05:17:54.955912 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 05:17:54.955912 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 05:17:54.955912 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 05:17:54.955912 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:54.955912 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:54.955912 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:54.955912 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:54.955912 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:54.955912 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:54.955912 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:54.955912 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:54.955912 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:54.955912 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:54.955912 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:54.955912 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:54.956883 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:54.956883 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:54.956883 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 05:17:54.956883 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 05:17:54.956883 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 05:17:54.956883 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 05:17:54.956883 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 05:17:54.956883 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 05:17:54.956883 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 11 05:17:54.956883 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:17:54.959768 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 519/1038] 10.222.0.16 () {56 vars in 1093 bytes} [Sun Sep 11 05:17:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 05:17:54.962589 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ecb8fe-f7da-4c5f-b12c-94b769618613 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:55.056940 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:55.073274 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ecb8fe-f7da-4c5f-b12c-94b769618613 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:55.080826 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a666c2-6307-47db-83cf-195cf4602727 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:55.081113 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a666c2-6307-47db-83cf-195cf4602727 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:55.081388 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a666c2-6307-47db-83cf-195cf4602727 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:55.083423 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 520/1039] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:17:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:17:55.090642 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61bd955-72e0-4841-afff-d2b1678802b1 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:55.091014 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61bd955-72e0-4841-afff-d2b1678802b1 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:55.091192 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61bd955-72e0-4841-afff-d2b1678802b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:55.113815 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b6eddb-ac23-4cb9-b203-6fec528b756d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:55.114459 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b6eddb-ac23-4cb9-b203-6fec528b756d None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:55.114735 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b6eddb-ac23-4cb9-b203-6fec528b756d None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:55.115003 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b6eddb-ac23-4cb9-b203-6fec528b756d None admin] PATH_INFO: `/v3/users` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:55.115771 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b6eddb-ac23-4cb9-b203-6fec528b756d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:55.116078 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b6eddb-ac23-4cb9-b203-6fec528b756d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:55.116948 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-e61bd955-72e0-4841-afff-d2b1678802b1 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:17:55.117756 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b6eddb-ac23-4cb9-b203-6fec528b756d None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:55.118955 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-e61bd955-72e0-4841-afff-d2b1678802b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:17:55.135167 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 520/1040] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Sep 11 05:17:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:17:55.136504 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b21d7f5-3b4f-473f-88f3-d5d0eb92e60b None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:55.136847 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b21d7f5-3b4f-473f-88f3-d5d0eb92e60b None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:55.137126 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b21d7f5-3b4f-473f-88f3-d5d0eb92e60b None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:55.138440 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 521/1041] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:17:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:17:55.141205 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b21d7f5-3b4f-473f-88f3-d5d0eb92e60b None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:55.188237 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:55.205113 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 521/1042] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:17:55 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 05:17:55.206623 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b9b9f-289b-4154-ae16-47823e3e5bf2 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:55.206900 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b9b9f-289b-4154-ae16-47823e3e5bf2 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:55.207173 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b9b9f-289b-4154-ae16-47823e3e5bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:55.228900 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-a70b9b9f-289b-4154-ae16-47823e3e5bf2 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:17:55.230329 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-a70b9b9f-289b-4154-ae16-47823e3e5bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:17:55.246275 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b21d7f5-3b4f-473f-88f3-d5d0eb92e60b None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:55.281996 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bafc8c-6c3a-4c85-a370-5fc0b8bc9ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:55.282607 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bafc8c-6c3a-4c85-a370-5fc0b8bc9ece None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:55.282887 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bafc8c-6c3a-4c85-a370-5fc0b8bc9ece None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:55.283161 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bafc8c-6c3a-4c85-a370-5fc0b8bc9ece None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:55.298007 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:55.304532 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 522/1043] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:17:55 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 05:17:55.357477 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bafc8c-6c3a-4c85-a370-5fc0b8bc9ece None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:55.358920 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bafc8c-6c3a-4c85-a370-5fc0b8bc9ece None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:55.461834 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 522/1044] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 05:17:55 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 11 05:17:55.463248 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70b9b9f-289b-4154-ae16-47823e3e5bf2 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:55.479242 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bafc8c-6c3a-4c85-a370-5fc0b8bc9ece None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:55.531219 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:55.574977 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70b9b9f-289b-4154-ae16-47823e3e5bf2 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:55.586370 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bafc8c-6c3a-4c85-a370-5fc0b8bc9ece None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:55.593732 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:55.612173 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d03d0f2-5e93-4e66-b756-23c4473c3e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:55.612805 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d03d0f2-5e93-4e66-b756-23c4473c3e0d None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:55.613082 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d03d0f2-5e93-4e66-b756-23c4473c3e0d None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:55.613352 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d03d0f2-5e93-4e66-b756-23c4473c3e0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:55.621571 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13540e4f-29d9-47eb-b7fb-e806d6510040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:55.622190 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13540e4f-29d9-47eb-b7fb-e806d6510040 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:55.622471 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13540e4f-29d9-47eb-b7fb-e806d6510040 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:55.622738 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13540e4f-29d9-47eb-b7fb-e806d6510040 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:55.624101 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d03d0f2-5e93-4e66-b756-23c4473c3e0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:55.625546 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d03d0f2-5e93-4e66-b756-23c4473c3e0d None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:55.632580 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13540e4f-29d9-47eb-b7fb-e806d6510040 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:17:55.637371 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-13540e4f-29d9-47eb-b7fb-e806d6510040 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 05:17:55.637371 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:55.637371 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:55.637371 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:55.637371 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:55.637371 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:55.637371 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:55.637371 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:55.637371 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:55.637371 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:55.637371 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:55.637371 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:55.637371 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:17:55.637371 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:17:55.637371 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:17:55.637371 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:17:55.638478 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:17:55.638478 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:17:55.638478 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:17:55.638478 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:17:55.638478 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:55.638478 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:55.638478 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:55.638478 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:55.638478 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:55.638478 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:55.638478 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:55.638478 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:55.638478 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:55.638478 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:55.638478 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:55.638478 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:55.639361 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:55.639361 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:55.639361 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:55.639361 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:55.639361 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:17:55.639361 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:17:55.639361 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:17:55.639361 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:17:55.639361 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:17:55.639361 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:17:55.639361 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 05:17:55.639361 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:55.639361 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 523/1045] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 05:17:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:55.640110 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13540e4f-29d9-47eb-b7fb-e806d6510040 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:55.640203 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-7d03d0f2-5e93-4e66-b756-23c4473c3e0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:17:55.640203 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:55.640203 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:55.640203 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:55.640203 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:55.640203 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:55.640203 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:55.640203 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:55.640203 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:55.640203 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:55.640203 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:55.640203 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:55.640203 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 05:17:55.640203 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 05:17:55.640203 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 05:17:55.640203 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 05:17:55.641072 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:55.641072 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:55.641072 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:55.641072 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:55.641072 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:55.641072 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:55.641072 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:55.641072 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:55.641072 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:55.641072 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:55.641072 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:55.641072 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:55.641072 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:55.641072 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:55.641072 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:55.641072 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:55.641072 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 05:17:55.641967 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 05:17:55.641967 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:17:55.641967 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:17:55.641967 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 523/1046] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:17:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:55.644355 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d03d0f2-5e93-4e66-b756-23c4473c3e0d None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:55.740990 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13540e4f-29d9-47eb-b7fb-e806d6510040 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:55.743609 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:55.744495 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d03d0f2-5e93-4e66-b756-23c4473c3e0d None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:55.779108 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ce44a8-6148-46dd-9cc4-608c84e50296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:55.779756 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce44a8-6148-46dd-9cc4-608c84e50296 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:55.780034 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce44a8-6148-46dd-9cc4-608c84e50296 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:55.780302 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d11cb-1e37-4978-aa64-1bbe06bb7aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:55.780437 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce44a8-6148-46dd-9cc4-608c84e50296 None admin] PATH_INFO: `/v3/services/image` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:55.780876 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ce44a8-6148-46dd-9cc4-608c84e50296 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:55.780967 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d11cb-1e37-4978-aa64-1bbe06bb7aa5 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:55.781171 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d11cb-1e37-4978-aa64-1bbe06bb7aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:55.781446 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d11cb-1e37-4978-aa64-1bbe06bb7aa5 None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:55.782109 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15d11cb-1e37-4978-aa64-1bbe06bb7aa5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:55.782228 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ce44a8-6148-46dd-9cc4-608c84e50296 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:55.782418 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15d11cb-1e37-4978-aa64-1bbe06bb7aa5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:55.783827 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15d11cb-1e37-4978-aa64-1bbe06bb7aa5 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:55.794328 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 524/1047] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 05:17:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:17:55.795055 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d11cb-1e37-4978-aa64-1bbe06bb7aa5 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:55.796523 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-26ce44a8-6148-46dd-9cc4-608c84e50296 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 11 05:17:55.796523 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:55.796523 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 05:17:55.796523 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 05:17:55.796523 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 05:17:55.796523 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 05:17:55.796523 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 05:17:55.796523 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 05:17:55.796523 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 11 05:17:55.796523 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:55.796523 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 05:17:55.796523 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:55.796523 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:55.796523 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:55.796523 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:55.796523 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:55.796523 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:55.797495 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:55.797495 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:55.797495 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:55.797495 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:55.797495 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:55.797495 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:55.797495 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 05:17:55.797495 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 05:17:55.797495 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 05:17:55.797495 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 05:17:55.797495 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:55.797495 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:55.797495 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:55.797495 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:55.797495 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:55.797495 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:55.798354 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:55.798354 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:55.798354 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:55.798354 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:55.798354 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:55.798354 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:55.798354 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:55.798354 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:55.798354 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:55.798354 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:55.798354 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 05:17:55.798354 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 05:17:55.798354 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 11 05:17:55.798354 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:55.798354 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 524/1048] 10.222.0.16 () {56 vars in 1105 bytes} [Sun Sep 11 05:17:55 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:55.799925 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ce44a8-6148-46dd-9cc4-608c84e50296 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:55.830693 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:55.898972 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ce44a8-6148-46dd-9cc4-608c84e50296 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:55.902098 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d11cb-1e37-4978-aa64-1bbe06bb7aa5 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:55.931879 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb8645c-59cf-440d-bc90-c2db37944121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:55.932500 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb8645c-59cf-440d-bc90-c2db37944121 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:55.932778 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb8645c-59cf-440d-bc90-c2db37944121 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:55.933047 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb8645c-59cf-440d-bc90-c2db37944121 None admin] PATH_INFO: `/v3/users/7476485893884a458e1b9c43bb15c56f` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:55.935737 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e6e235-e5ce-4721-b0ff-bfc11ee1d920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:55.936350 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e6e235-e5ce-4721-b0ff-bfc11ee1d920 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:55.936627 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e6e235-e5ce-4721-b0ff-bfc11ee1d920 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:55.936901 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e6e235-e5ce-4721-b0ff-bfc11ee1d920 None admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:55.937544 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e6e235-e5ce-4721-b0ff-bfc11ee1d920 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:55.937850 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e6e235-e5ce-4721-b0ff-bfc11ee1d920 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:55.939222 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e6e235-e5ce-4721-b0ff-bfc11ee1d920 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:55.946610 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb8645c-59cf-440d-bc90-c2db37944121 None admin] RBAC: Authorizing `identity:get_user(user_id=7476485893884a458e1b9c43bb15c56f)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:55.948073 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb8645c-59cf-440d-bc90-c2db37944121 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:55.949689 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 525/1049] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 05:17:55 2022] GET /identity/v3/users/7476485893884a458e1b9c43bb15c56f => generated 285 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:55.950448 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb8645c-59cf-440d-bc90-c2db37944121 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:55.955470 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 525/1050] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 05:17:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:55.956472 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e6e235-e5ce-4721-b0ff-bfc11ee1d920 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:55.980348 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:56.044842 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:56.053535 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb8645c-59cf-440d-bc90-c2db37944121 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:56.055404 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e6e235-e5ce-4721-b0ff-bfc11ee1d920 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:56.086741 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bedf6e-8454-4ee3-a60a-d1414fd13fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:56.087372 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bedf6e-8454-4ee3-a60a-d1414fd13fbe None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:56.087647 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bedf6e-8454-4ee3-a60a-d1414fd13fbe None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:56.087950 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bedf6e-8454-4ee3-a60a-d1414fd13fbe None admin] PATH_INFO: `/v3/services` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:56.088237 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c760a5-ff2d-4ac0-a6ad-8ca644dc62fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:56.088572 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bedf6e-8454-4ee3-a60a-d1414fd13fbe None admin] RBAC: Adding query filter params (name=image) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:56.088847 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c760a5-ff2d-4ac0-a6ad-8ca644dc62fd None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:56.088939 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bedf6e-8454-4ee3-a60a-d1414fd13fbe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:56.089132 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c760a5-ff2d-4ac0-a6ad-8ca644dc62fd None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:56.089410 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c760a5-ff2d-4ac0-a6ad-8ca644dc62fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:56.090222 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bedf6e-8454-4ee3-a60a-d1414fd13fbe None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:56.094975 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 526/1051] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:17:55 2022] GET /identity/v3/services?name=image => generated 122 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:56.095778 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bedf6e-8454-4ee3-a60a-d1414fd13fbe None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:56.160034 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c760a5-ff2d-4ac0-a6ad-8ca644dc62fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:56.161531 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c760a5-ff2d-4ac0-a6ad-8ca644dc62fd None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:56.183303 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:56.193506 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bedf6e-8454-4ee3-a60a-d1414fd13fbe None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:56.227438 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c6be1a-8430-4deb-82b4-1c27984c0056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:56.228101 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c6be1a-8430-4deb-82b4-1c27984c0056 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:56.228386 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c6be1a-8430-4deb-82b4-1c27984c0056 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:56.228659 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c6be1a-8430-4deb-82b4-1c27984c0056 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:56.235319 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c6be1a-8430-4deb-82b4-1c27984c0056 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:56.236791 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c6be1a-8430-4deb-82b4-1c27984c0056 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:56.248047 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:56.248507 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-48c6be1a-8430-4deb-82b4-1c27984c0056 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 05:17:56.248507 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:56.248507 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:56.248507 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:56.248507 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:56.248507 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:56.248507 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:56.248507 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:56.248507 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:56.248507 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:56.248507 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:56.248507 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:56.248507 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 05:17:56.248507 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 05:17:56.248507 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 05:17:56.249351 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 05:17:56.249351 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:56.249351 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:56.249351 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:56.249351 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:56.249351 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:56.249351 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:56.249351 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:56.249351 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:56.249351 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:56.249351 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:56.249351 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:56.249351 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:56.249351 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:56.249351 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:56.249351 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:56.249351 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:56.250355 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 05:17:56.250355 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 05:17:56.250355 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 05:17:56.250355 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 05:17:56.250355 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 05:17:56.250355 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 05:17:56.250355 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 05:17:56.250355 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:56.250355 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 527/1052] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 05:17:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:56.251290 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c6be1a-8430-4deb-82b4-1c27984c0056 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:56.259480 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 526/1053] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 05:17:55 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 05:17:56.260385 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c760a5-ff2d-4ac0-a6ad-8ca644dc62fd None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:56.353169 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c6be1a-8430-4deb-82b4-1c27984c0056 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:56.355926 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c760a5-ff2d-4ac0-a6ad-8ca644dc62fd None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:56.386432 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecce5f9-b659-4081-9482-826a8efa4950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:56.387044 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecce5f9-b659-4081-9482-826a8efa4950 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:56.387325 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecce5f9-b659-4081-9482-826a8efa4950 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:56.387600 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecce5f9-b659-4081-9482-826a8efa4950 None admin] PATH_INFO: `/v3/services` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:56.388281 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecce5f9-b659-4081-9482-826a8efa4950 None admin] RBAC: Adding query filter params (type=image) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:56.388585 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecce5f9-b659-4081-9482-826a8efa4950 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:56.389134 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2bbea3-548f-4abe-8c03-66d9ba5b6a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:56.389735 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2bbea3-548f-4abe-8c03-66d9ba5b6a10 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:56.389953 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecce5f9-b659-4081-9482-826a8efa4950 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:56.390042 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2bbea3-548f-4abe-8c03-66d9ba5b6a10 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:56.390267 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2bbea3-548f-4abe-8c03-66d9ba5b6a10 None admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:56.390955 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2bbea3-548f-4abe-8c03-66d9ba5b6a10 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:56.391261 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2bbea3-548f-4abe-8c03-66d9ba5b6a10 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:56.392721 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2bbea3-548f-4abe-8c03-66d9ba5b6a10 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:56.394831 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 528/1054] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:17:56 2022] GET /identity/v3/services?type=image => generated 350 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:56.396051 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecce5f9-b659-4081-9482-826a8efa4950 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:56.414283 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 527/1055] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 05:17:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:56.414283 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2bbea3-548f-4abe-8c03-66d9ba5b6a10 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:56.415743 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:56.458674 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:56.502391 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecce5f9-b659-4081-9482-826a8efa4950 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:56.509118 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2bbea3-548f-4abe-8c03-66d9ba5b6a10 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:56.536934 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6661ef-69cb-459f-acd3-7372bb524bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:56.537566 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6661ef-69cb-459f-acd3-7372bb524bd8 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:56.537844 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6661ef-69cb-459f-acd3-7372bb524bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:56.538111 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6661ef-69cb-459f-acd3-7372bb524bd8 None admin] PATH_INFO: `/v3/projects/77c360b338924e8280a9e0bed2042d31` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:56.539226 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6661ef-69cb-459f-acd3-7372bb524bd8 None admin] RBAC: Authorizing `identity:get_project(project_id=77c360b338924e8280a9e0bed2042d31)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:56.540696 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6661ef-69cb-459f-acd3-7372bb524bd8 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:56.542333 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 529/1056] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 05:17:56 2022] GET /identity/v3/projects/77c360b338924e8280a9e0bed2042d31 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:56.543092 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6661ef-69cb-459f-acd3-7372bb524bd8 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:56.544516 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a6612-e682-4aa5-be33-e89c8fe93348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:56.545133 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a6612-e682-4aa5-be33-e89c8fe93348 None admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:56.545412 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a6612-e682-4aa5-be33-e89c8fe93348 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:56.545692 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a6612-e682-4aa5-be33-e89c8fe93348 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:56.546539 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1a6612-e682-4aa5-be33-e89c8fe93348 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:56.548760 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1a6612-e682-4aa5-be33-e89c8fe93348 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:56.568686 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 528/1057] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:17:56 2022] POST /identity/v3/endpoints => generated 327 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:17:56.569497 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a6612-e682-4aa5-be33-e89c8fe93348 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:56.639458 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:56.666480 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6661ef-69cb-459f-acd3-7372bb524bd8 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:56.695558 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a6612-e682-4aa5-be33-e89c8fe93348 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:56.697425 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:56.712243 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2dbe54-0240-4d48-9373-961ea3673453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:56.713049 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2dbe54-0240-4d48-9373-961ea3673453 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:56.713330 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2dbe54-0240-4d48-9373-961ea3673453 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:56.714012 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2dbe54-0240-4d48-9373-961ea3673453 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:56.715057 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2dbe54-0240-4d48-9373-961ea3673453 None admin] RBAC: Adding query filter params (role.id=fb8e0aff63fc43b9bb64198f0d940aeb, scope.project.id=61ffb079d9e1437084945554bcc0747b, user.id=6cd6136036bd467c946cae90d5c29263) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:56.715375 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2dbe54-0240-4d48-9373-961ea3673453 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:56.716879 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2dbe54-0240-4d48-9373-961ea3673453 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:56.727774 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 530/1058] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 05:17:56 2022] GET /identity/v3/role_assignments?user.id=6cd6136036bd467c946cae90d5c29263&scope.project.id=61ffb079d9e1437084945554bcc0747b&role.id=fb8e0aff63fc43b9bb64198f0d940aeb => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:56.736242 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f366d27-2510-4676-bbea-899f933aa5eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:56.737166 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f366d27-2510-4676-bbea-899f933aa5eb None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:56.737166 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f366d27-2510-4676-bbea-899f933aa5eb None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:56.737433 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f366d27-2510-4676-bbea-899f933aa5eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:56.738189 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f366d27-2510-4676-bbea-899f933aa5eb None admin] RBAC: Adding query filter params (role.id=5b702713e40145b49e0b42abd0a5fba9, scope.project.id=77c360b338924e8280a9e0bed2042d31, user.id=7476485893884a458e1b9c43bb15c56f) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:56.738502 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f366d27-2510-4676-bbea-899f933aa5eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:56.740099 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f366d27-2510-4676-bbea-899f933aa5eb None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:56.747654 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 529/1059] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 05:17:56 2022] GET /identity/v3/role_assignments?user.id=7476485893884a458e1b9c43bb15c56f&scope.project.id=77c360b338924e8280a9e0bed2042d31&role.id=5b702713e40145b49e0b42abd0a5fba9 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:58.756335 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7922644b-7d87-4802-ba53-39d43618dd45 None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:58.756879 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7922644b-7d87-4802-ba53-39d43618dd45 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:58.756879 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7922644b-7d87-4802-ba53-39d43618dd45 None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:58.759740 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 531/1060] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:17:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:17:58.764094 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328cdab5-338c-4c09-9a4a-2521f2ca60a0 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:58.764629 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328cdab5-338c-4c09-9a4a-2521f2ca60a0 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:58.764718 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328cdab5-338c-4c09-9a4a-2521f2ca60a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:58.787158 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-328cdab5-338c-4c09-9a4a-2521f2ca60a0 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:17:58.787158 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-328cdab5-338c-4c09-9a4a-2521f2ca60a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:17:58.863715 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 530/1061] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:17:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 05:17:58.865674 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a87cb7-669e-49d9-917b-0111d518bc7d None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:58.866021 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a87cb7-669e-49d9-917b-0111d518bc7d None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:58.866231 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a87cb7-669e-49d9-917b-0111d518bc7d None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:58.867875 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 532/1062] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:17:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:17:58.872963 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a360ac1-8f8b-4d21-ad30-972defb1b70c None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:58.873251 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a360ac1-8f8b-4d21-ad30-972defb1b70c None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:58.873519 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a360ac1-8f8b-4d21-ad30-972defb1b70c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:58.896090 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-4a360ac1-8f8b-4d21-ad30-972defb1b70c None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:17:58.897271 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-4a360ac1-8f8b-4d21-ad30-972defb1b70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:17:58.910284 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe6c52-0f83-4ac8-8701-ed71580d6557 None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:58.910688 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe6c52-0f83-4ac8-8701-ed71580d6557 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:58.910905 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe6c52-0f83-4ac8-8701-ed71580d6557 None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:58.912942 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 533/1063] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:17:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 05:17:58.917632 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eca9ca-5196-419f-a875-518941e48812 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:58.917919 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eca9ca-5196-419f-a875-518941e48812 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:58.918548 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eca9ca-5196-419f-a875-518941e48812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:58.937981 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-c2eca9ca-5196-419f-a875-518941e48812 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:17:58.939581 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-c2eca9ca-5196-419f-a875-518941e48812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:17:58.966378 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 531/1064] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:17:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 05:17:59.012394 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 534/1065] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:17:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 05:17:59.126000 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a360ac1-8f8b-4d21-ad30-972defb1b70c None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:59.152558 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:59.229957 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a360ac1-8f8b-4d21-ad30-972defb1b70c None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:59.238662 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eca9ca-5196-419f-a875-518941e48812 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:59.267474 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cefdf7-26c0-41b8-bad1-436f96c14418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:59.268031 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cefdf7-26c0-41b8-bad1-436f96c14418 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:59.268312 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cefdf7-26c0-41b8-bad1-436f96c14418 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:59.268585 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cefdf7-26c0-41b8-bad1-436f96c14418 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:59.319917 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:59.337418 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cefdf7-26c0-41b8-bad1-436f96c14418 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:59.338877 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cefdf7-26c0-41b8-bad1-436f96c14418 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:59.343531 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eca9ca-5196-419f-a875-518941e48812 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:59.365511 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:59.378830 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658a6380-4912-48bb-aaf4-b5ac9f9a001f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:59.379461 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a6380-4912-48bb-aaf4-b5ac9f9a001f None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:59.379768 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a6380-4912-48bb-aaf4-b5ac9f9a001f None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:59.380044 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a6380-4912-48bb-aaf4-b5ac9f9a001f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:59.389765 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658a6380-4912-48bb-aaf4-b5ac9f9a001f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:17:59.394544 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-658a6380-4912-48bb-aaf4-b5ac9f9a001f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 11 05:17:59.394544 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:59.394544 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:59.394544 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:59.394544 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:59.394544 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:59.394544 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:59.394544 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:59.394544 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:59.394544 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:59.394544 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:59.394544 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:59.394544 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:17:59.394544 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:17:59.394544 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:17:59.394544 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:17:59.396009 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:17:59.396009 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:17:59.396009 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:17:59.396009 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:17:59.396009 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:59.396009 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:59.396009 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:59.396009 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:59.396009 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:59.396009 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:59.396009 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:59.396009 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:59.396009 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:59.396009 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:59.396009 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:59.396009 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:59.396950 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:59.396950 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:59.396950 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:59.396950 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:59.396950 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:17:59.396950 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:17:59.396950 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:17:59.396950 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:17:59.396950 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:17:59.396950 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:17:59.396950 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 11 05:17:59.396950 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:59.396950 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 535/1066] 10.222.0.16 () {56 vars in 1120 bytes} [Sun Sep 11 05:17:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 05:17:59.396950 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658a6380-4912-48bb-aaf4-b5ac9f9a001f None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:59.443744 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 532/1067] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 05:17:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 05:17:59.443744 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cefdf7-26c0-41b8-bad1-436f96c14418 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:59.501846 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658a6380-4912-48bb-aaf4-b5ac9f9a001f None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:59.538493 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8b320a-bff8-4f36-bdb6-ca64adbf729c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:59.539047 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b320a-bff8-4f36-bdb6-ca64adbf729c None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:59.539326 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b320a-bff8-4f36-bdb6-ca64adbf729c None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:59.539595 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b320a-bff8-4f36-bdb6-ca64adbf729c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:59.542202 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:59.550655 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8b320a-bff8-4f36-bdb6-ca64adbf729c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:17:59.556066 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-6c8b320a-bff8-4f36-bdb6-ca64adbf729c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 05:17:59.556066 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:59.556066 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:59.556066 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:59.556066 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:59.556066 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:59.556066 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:59.556066 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:59.556066 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:59.556066 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:59.556066 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:59.556066 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:59.556066 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:17:59.556066 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:17:59.556066 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:17:59.556066 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:17:59.557184 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:17:59.557184 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:17:59.557184 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:17:59.557184 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:17:59.557184 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:59.557184 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:59.557184 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:59.557184 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:59.557184 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:59.557184 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:59.557184 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:59.557184 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:59.557184 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:59.557184 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:59.557184 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:59.557184 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:59.558020 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:59.558020 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:59.558020 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:59.558020 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:59.558020 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:17:59.558020 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:17:59.558020 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:17:59.558020 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:17:59.558020 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:17:59.558020 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:17:59.558020 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 05:17:59.558020 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:59.558020 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 536/1068] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 05:17:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:59.558020 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8b320a-bff8-4f36-bdb6-ca64adbf729c None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:59.561818 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cefdf7-26c0-41b8-bad1-436f96c14418 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:59.588243 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:59.597899 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71206aee-7055-46e5-b2b3-4f52b561256c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:59.598541 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71206aee-7055-46e5-b2b3-4f52b561256c None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:59.598823 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71206aee-7055-46e5-b2b3-4f52b561256c None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:59.599099 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71206aee-7055-46e5-b2b3-4f52b561256c None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:59.599802 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71206aee-7055-46e5-b2b3-4f52b561256c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:59.600107 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71206aee-7055-46e5-b2b3-4f52b561256c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:59.602109 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71206aee-7055-46e5-b2b3-4f52b561256c None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:59.612051 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 533/1069] 10.222.0.16 () {56 vars in 1115 bytes} [Sun Sep 11 05:17:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:59.612854 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71206aee-7055-46e5-b2b3-4f52b561256c None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:59.663050 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8b320a-bff8-4f36-bdb6-ca64adbf729c None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:59.699093 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1a6477-2ecf-453d-a5c4-ac154040263a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:59.699737 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a6477-2ecf-453d-a5c4-ac154040263a None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:59.700017 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a6477-2ecf-453d-a5c4-ac154040263a None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:59.700283 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a6477-2ecf-453d-a5c4-ac154040263a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:59.710455 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1a6477-2ecf-453d-a5c4-ac154040263a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:59.711925 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1a6477-2ecf-453d-a5c4-ac154040263a None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:59.712857 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71206aee-7055-46e5-b2b3-4f52b561256c None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:59.726295 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-0a1a6477-2ecf-453d-a5c4-ac154040263a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:17:59.726295 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:59.726295 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:59.726295 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:59.726295 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:59.726295 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:59.726295 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:59.726295 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:59.726295 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:59.726295 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:59.726295 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:59.726295 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:59.726295 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 05:17:59.726295 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 05:17:59.726295 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 05:17:59.726295 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 05:17:59.727468 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:59.727468 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:59.727468 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:59.727468 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:59.727468 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:59.727468 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:59.727468 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:59.727468 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:59.727468 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:59.727468 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:59.727468 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:59.727468 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:59.727468 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:59.727468 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:59.727468 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:59.727468 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:59.727468 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 05:17:59.728747 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 05:17:59.728747 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:17:59.728747 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:59.728747 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 537/1070] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:17:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:59.728747 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1a6477-2ecf-453d-a5c4-ac154040263a None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:59.751208 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7674ac29-d70d-4abe-b49e-86f2cace727c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:59.751852 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674ac29-d70d-4abe-b49e-86f2cace727c None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:59.752130 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674ac29-d70d-4abe-b49e-86f2cace727c None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:59.752399 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674ac29-d70d-4abe-b49e-86f2cace727c None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:59.753055 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7674ac29-d70d-4abe-b49e-86f2cace727c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:59.753369 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7674ac29-d70d-4abe-b49e-86f2cace727c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:59.755312 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7674ac29-d70d-4abe-b49e-86f2cace727c None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:59.763768 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 534/1071] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 05:17:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:59.764558 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7674ac29-d70d-4abe-b49e-86f2cace727c None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:59.779528 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:59.815523 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:17:59.834990 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1a6477-2ecf-453d-a5c4-ac154040263a None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:59.867301 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7674ac29-d70d-4abe-b49e-86f2cace727c None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:17:59.876827 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd15d5c-d092-47c3-abb7-9be3c06bd62c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:59.877477 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd15d5c-d092-47c3-abb7-9be3c06bd62c None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:59.877757 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd15d5c-d092-47c3-abb7-9be3c06bd62c None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:59.878037 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd15d5c-d092-47c3-abb7-9be3c06bd62c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:59.892629 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd15d5c-d092-47c3-abb7-9be3c06bd62c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:59.894078 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd15d5c-d092-47c3-abb7-9be3c06bd62c None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:59.908355 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-0cd15d5c-d092-47c3-abb7-9be3c06bd62c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:17:59.908355 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:17:59.908355 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:17:59.908355 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:17:59.908355 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:17:59.908355 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:17:59.908355 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:17:59.908355 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:17:59.908355 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:17:59.908355 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:17:59.908355 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:17:59.908355 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:17:59.908355 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 05:17:59.908355 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 05:17:59.908355 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 05:17:59.908355 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 05:17:59.909495 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:17:59.909495 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:17:59.909495 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:17:59.909495 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:17:59.909495 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:17:59.909495 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:17:59.909495 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:17:59.909495 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:17:59.909495 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:17:59.909495 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:17:59.909495 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:17:59.909495 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:17:59.909495 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:17:59.909495 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:17:59.909495 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:17:59.909495 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:17:59.909495 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 05:17:59.910394 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 05:17:59.910394 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:17:59.910394 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:17:59.910565 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bd6ef4-99e7-464e-9b87-42dfbf440b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:17:59.910565 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd6ef4-99e7-464e-9b87-42dfbf440b58 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:17:59.910565 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd6ef4-99e7-464e-9b87-42dfbf440b58 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:17:59.910565 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd6ef4-99e7-464e-9b87-42dfbf440b58 None admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:17:59.911375 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 538/1072] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:17:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:17:59.911451 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bd6ef4-99e7-464e-9b87-42dfbf440b58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:17:59.911526 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd15d5c-d092-47c3-abb7-9be3c06bd62c None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:17:59.911595 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bd6ef4-99e7-464e-9b87-42dfbf440b58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:17:59.912515 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bd6ef4-99e7-464e-9b87-42dfbf440b58 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:17:59.925129 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 535/1073] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 05:17:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:17:59.925935 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bd6ef4-99e7-464e-9b87-42dfbf440b58 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:18:00.039254 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bd6ef4-99e7-464e-9b87-42dfbf440b58 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:18:00.039487 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:18:00.044464 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd15d5c-d092-47c3-abb7-9be3c06bd62c None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:18:00.051525 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:18:00.080238 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e54cbdd-514e-41d4-ba60-068466b418ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:18:00.080912 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e54cbdd-514e-41d4-ba60-068466b418ff None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:00.081142 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e54cbdd-514e-41d4-ba60-068466b418ff None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:00.081417 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e54cbdd-514e-41d4-ba60-068466b418ff None admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:00.082084 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e54cbdd-514e-41d4-ba60-068466b418ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:18:00.082392 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e54cbdd-514e-41d4-ba60-068466b418ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:18:00.083951 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e54cbdd-514e-41d4-ba60-068466b418ff None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:18:00.089033 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4895a3b-0429-430c-8bb6-8319873c5b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:18:00.089888 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4895a3b-0429-430c-8bb6-8319873c5b76 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:00.090417 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4895a3b-0429-430c-8bb6-8319873c5b76 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:00.090840 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4895a3b-0429-430c-8bb6-8319873c5b76 None admin] PATH_INFO: `/v3/users/7476485893884a458e1b9c43bb15c56f` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:00.092886 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4895a3b-0429-430c-8bb6-8319873c5b76 None admin] RBAC: Authorizing `identity:get_user(user_id=7476485893884a458e1b9c43bb15c56f)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:18:00.094815 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4895a3b-0429-430c-8bb6-8319873c5b76 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:18:00.097116 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 536/1074] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 05:17:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:18:00.100515 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 539/1075] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 05:17:59 2022] GET /identity/v3/users/7476485893884a458e1b9c43bb15c56f => generated 285 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:18:00.102684 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e54cbdd-514e-41d4-ba60-068466b418ff None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:18:00.102824 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4895a3b-0429-430c-8bb6-8319873c5b76 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:18:00.229188 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4895a3b-0429-430c-8bb6-8319873c5b76 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:18:00.233425 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e54cbdd-514e-41d4-ba60-068466b418ff None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:18:00.264391 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6338daf9-1353-413b-9a50-0e7d15ba47b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:18:00.265006 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6338daf9-1353-413b-9a50-0e7d15ba47b8 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:00.265286 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6338daf9-1353-413b-9a50-0e7d15ba47b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:00.265555 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6338daf9-1353-413b-9a50-0e7d15ba47b8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:00.270586 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058e5c55-087a-47c1-907d-aa5f573518db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:18:00.271216 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e5c55-087a-47c1-907d-aa5f573518db None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:00.271497 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e5c55-087a-47c1-907d-aa5f573518db None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:00.271798 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e5c55-087a-47c1-907d-aa5f573518db None admin] PATH_INFO: `/v3/projects/77c360b338924e8280a9e0bed2042d31` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:00.272909 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058e5c55-087a-47c1-907d-aa5f573518db None admin] RBAC: Authorizing `identity:get_project(project_id=77c360b338924e8280a9e0bed2042d31)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:18:00.273074 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6338daf9-1353-413b-9a50-0e7d15ba47b8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:18:00.274387 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058e5c55-087a-47c1-907d-aa5f573518db None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:18:00.274495 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6338daf9-1353-413b-9a50-0e7d15ba47b8 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:18:00.276104 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 537/1076] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 05:18:00 2022] GET /identity/v3/projects/77c360b338924e8280a9e0bed2042d31 => generated 311 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:18:00.281945 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058e5c55-087a-47c1-907d-aa5f573518db None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:18:00.286050 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-6338daf9-1353-413b-9a50-0e7d15ba47b8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 11 05:18:00.286050 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:18:00.286050 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:18:00.286050 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:18:00.286050 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:18:00.286050 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:18:00.286050 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:18:00.286050 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:18:00.286050 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:18:00.286050 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:18:00.286050 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:18:00.286050 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:18:00.286050 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 05:18:00.286050 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 05:18:00.286050 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 05:18:00.286050 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 05:18:00.292016 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:18:00.292016 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:18:00.292016 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 05:18:00.292016 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 05:18:00.292016 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 05:18:00.292016 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 05:18:00.292016 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:18:00.292016 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:18:00.292016 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:18:00.292016 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:18:00.292016 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:18:00.292016 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:18:00.292016 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:18:00.292016 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:18:00.292016 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:18:00.292016 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:18:00.292016 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:18:00.292016 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:18:00.293240 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:18:00.293240 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:18:00.293240 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 05:18:00.293240 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 05:18:00.293240 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 05:18:00.293240 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 05:18:00.293240 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 05:18:00.293240 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 05:18:00.293240 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 11 05:18:00.293240 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:18:00.293240 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 540/1077] 10.222.0.16 () {56 vars in 1093 bytes} [Sun Sep 11 05:18:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 05:18:00.295173 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6338daf9-1353-413b-9a50-0e7d15ba47b8 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:18:00.323156 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:18:00.323310 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:18:00.384178 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058e5c55-087a-47c1-907d-aa5f573518db None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:18:00.394786 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6338daf9-1353-413b-9a50-0e7d15ba47b8 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:18:00.418099 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669fef42-706b-4b36-aeab-858e70e7da74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:18:00.418748 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669fef42-706b-4b36-aeab-858e70e7da74 None admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:00.419027 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669fef42-706b-4b36-aeab-858e70e7da74 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:00.419302 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669fef42-706b-4b36-aeab-858e70e7da74 None admin] PATH_INFO: `/v3/projects/77c360b338924e8280a9e0bed2042d31/users/7476485893884a458e1b9c43bb15c56f/roles/5b702713e40145b49e0b42abd0a5fba9` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:00.421254 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669fef42-706b-4b36-aeab-858e70e7da74 None admin] RBAC: Authorizing `identity:create_grant(project_id=77c360b338924e8280a9e0bed2042d31, user_id=7476485893884a458e1b9c43bb15c56f, role_id=5b702713e40145b49e0b42abd0a5fba9)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:18:00.422690 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669fef42-706b-4b36-aeab-858e70e7da74 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:18:00.429827 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b83f700-06c4-4028-a06d-0e890aec143d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:18:00.430434 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b83f700-06c4-4028-a06d-0e890aec143d None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:00.430716 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b83f700-06c4-4028-a06d-0e890aec143d None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:00.431048 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b83f700-06c4-4028-a06d-0e890aec143d None admin] PATH_INFO: `/v3/users` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:00.432028 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b83f700-06c4-4028-a06d-0e890aec143d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:18:00.432627 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b83f700-06c4-4028-a06d-0e890aec143d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:18:00.434232 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b83f700-06c4-4028-a06d-0e890aec143d None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:18:00.436303 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 538/1078] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 11 05:18:00 2022] PUT /identity/v3/projects/77c360b338924e8280a9e0bed2042d31/users/7476485893884a458e1b9c43bb15c56f/roles/5b702713e40145b49e0b42abd0a5fba9 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 05:18:00.454497 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 541/1079] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Sep 11 05:18:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:18:00.460582 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669fef42-706b-4b36-aeab-858e70e7da74 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:18:00.566661 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:18:00.571464 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669fef42-706b-4b36-aeab-858e70e7da74 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:18:00.611816 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4978871-b3e9-46f8-96da-3ed21d64defb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:18:00.612460 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4978871-b3e9-46f8-96da-3ed21d64defb None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:00.612750 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4978871-b3e9-46f8-96da-3ed21d64defb None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:00.613022 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4978871-b3e9-46f8-96da-3ed21d64defb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:00.623768 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4978871-b3e9-46f8-96da-3ed21d64defb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:18:00.625224 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4978871-b3e9-46f8-96da-3ed21d64defb None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:18:00.640384 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-e4978871-b3e9-46f8-96da-3ed21d64defb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:18:00.640384 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:18:00.640384 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:18:00.640384 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:18:00.640384 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:18:00.640384 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:18:00.640384 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:18:00.640384 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:18:00.640384 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:18:00.640384 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:18:00.640384 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:18:00.640384 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:18:00.640384 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 05:18:00.640384 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 05:18:00.640384 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 05:18:00.640384 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 05:18:00.641407 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:18:00.641407 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:18:00.641407 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:18:00.641407 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:18:00.641407 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:18:00.641407 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:18:00.641407 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:18:00.641407 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:18:00.641407 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:18:00.641407 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:18:00.641407 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:18:00.641407 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:18:00.641407 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:18:00.641407 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:18:00.641407 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:18:00.641407 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:18:00.641407 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 05:18:00.642882 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 05:18:00.642882 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:18:00.642882 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:18:00.642882 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 539/1080] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:18:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:18:00.647804 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b83f700-06c4-4028-a06d-0e890aec143d None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:18:00.729751 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:18:00.745558 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b83f700-06c4-4028-a06d-0e890aec143d None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:18:00.779994 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf2e78a-0416-4aba-9e0c-84eae296f7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:18:00.780631 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf2e78a-0416-4aba-9e0c-84eae296f7cb None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:00.780873 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf2e78a-0416-4aba-9e0c-84eae296f7cb None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:00.781147 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf2e78a-0416-4aba-9e0c-84eae296f7cb None admin] PATH_INFO: `/v3/domains` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:00.781786 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf2e78a-0416-4aba-9e0c-84eae296f7cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:18:00.782091 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf2e78a-0416-4aba-9e0c-84eae296f7cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:18:00.783453 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf2e78a-0416-4aba-9e0c-84eae296f7cb None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:18:00.794986 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 542/1081] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 05:18:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:18:00.800766 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4978871-b3e9-46f8-96da-3ed21d64defb None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:18:00.900291 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4978871-b3e9-46f8-96da-3ed21d64defb None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:18:00.933901 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60c0c17-bd34-4afd-9fdc-3b6ff173bf1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:18:00.934528 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60c0c17-bd34-4afd-9fdc-3b6ff173bf1c None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:00.934809 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60c0c17-bd34-4afd-9fdc-3b6ff173bf1c None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:00.935084 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60c0c17-bd34-4afd-9fdc-3b6ff173bf1c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:00.941647 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60c0c17-bd34-4afd-9fdc-3b6ff173bf1c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:18:00.943170 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60c0c17-bd34-4afd-9fdc-3b6ff173bf1c None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:18:00.954402 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-b60c0c17-bd34-4afd-9fdc-3b6ff173bf1c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 05:18:00.954402 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:18:00.954402 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:18:00.954402 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:18:00.954402 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:18:00.954402 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:18:00.954402 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:18:00.954402 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:18:00.954402 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:18:00.954402 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:18:00.954402 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:18:00.954402 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:18:00.954402 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 05:18:00.954402 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 05:18:00.954402 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 05:18:00.955377 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 05:18:00.955377 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:18:00.955377 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:18:00.955377 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:18:00.955377 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:18:00.955377 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:18:00.955377 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:18:00.955377 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:18:00.955377 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:18:00.955377 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:18:00.955377 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:18:00.955377 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:18:00.955377 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:18:00.955377 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:18:00.955377 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:18:00.955377 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:18:00.955377 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:18:00.956350 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 05:18:00.956350 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 05:18:00.956350 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 05:18:00.956350 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 05:18:00.956350 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 05:18:00.956350 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 05:18:00.956350 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 05:18:00.956350 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:18:00.956350 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 540/1082] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 05:18:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:18:00.961820 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf2e78a-0416-4aba-9e0c-84eae296f7cb None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:18:01.059892 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf2e78a-0416-4aba-9e0c-84eae296f7cb None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:18:01.093153 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e95bc36-181e-4dcf-8b7f-45592124a181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:18:01.093759 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e95bc36-181e-4dcf-8b7f-45592124a181 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:01.094043 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e95bc36-181e-4dcf-8b7f-45592124a181 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:01.094321 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e95bc36-181e-4dcf-8b7f-45592124a181 None admin] PATH_INFO: `/v3/projects` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:01.095011 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e95bc36-181e-4dcf-8b7f-45592124a181 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:18:01.095319 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e95bc36-181e-4dcf-8b7f-45592124a181 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:18:01.096783 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e95bc36-181e-4dcf-8b7f-45592124a181 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:18:01.109211 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 543/1083] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 05:18:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:18:01.115230 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60c0c17-bd34-4afd-9fdc-3b6ff173bf1c None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:18:01.128285 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:18:01.215398 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60c0c17-bd34-4afd-9fdc-3b6ff173bf1c None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:18:01.248261 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da83fdb-7486-44c7-bbfe-056a15f1330f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:18:01.248914 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da83fdb-7486-44c7-bbfe-056a15f1330f None admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:01.249195 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da83fdb-7486-44c7-bbfe-056a15f1330f None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:01.249471 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da83fdb-7486-44c7-bbfe-056a15f1330f None admin] PATH_INFO: `/v3/projects/61ffb079d9e1437084945554bcc0747b/users/6cd6136036bd467c946cae90d5c29263/roles/fb8e0aff63fc43b9bb64198f0d940aeb` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:01.251607 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da83fdb-7486-44c7-bbfe-056a15f1330f None admin] RBAC: Authorizing `identity:create_grant(project_id=61ffb079d9e1437084945554bcc0747b, user_id=6cd6136036bd467c946cae90d5c29263, role_id=fb8e0aff63fc43b9bb64198f0d940aeb)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:18:01.253085 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da83fdb-7486-44c7-bbfe-056a15f1330f None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:18:01.266869 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 541/1084] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 11 05:18:01 2022] PUT /identity/v3/projects/61ffb079d9e1437084945554bcc0747b/users/6cd6136036bd467c946cae90d5c29263/roles/fb8e0aff63fc43b9bb64198f0d940aeb => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:18:02.563117 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b8081-0b0a-4e16-aa4a-a53845e389b6 None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:02.563697 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b8081-0b0a-4e16-aa4a-a53845e389b6 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:02.563697 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b8081-0b0a-4e16-aa4a-a53845e389b6 None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:02.565060 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 544/1085] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:18:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:18:02.571116 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa5267-ac15-4f21-bef4-1214144bf25e None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:02.571614 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa5267-ac15-4f21-bef4-1214144bf25e None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:02.571740 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa5267-ac15-4f21-bef4-1214144bf25e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:02.589536 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-92aa5267-ac15-4f21-bef4-1214144bf25e None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:18:02.590720 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-92aa5267-ac15-4f21-bef4-1214144bf25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:18:02.651158 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:18:02.663805 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 542/1086] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:18:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 05:18:02.925781 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b8081-0b0a-4e16-aa4a-a53845e389b6 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:18:02.934769 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:18:03.026733 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b8081-0b0a-4e16-aa4a-a53845e389b6 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:18:03.060411 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac57801-9dd5-49e9-aadc-45e1434d6b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:18:03.061039 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac57801-9dd5-49e9-aadc-45e1434d6b02 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:03.061319 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac57801-9dd5-49e9-aadc-45e1434d6b02 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:03.061592 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac57801-9dd5-49e9-aadc-45e1434d6b02 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:03.071802 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac57801-9dd5-49e9-aadc-45e1434d6b02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:18:03.076598 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-1ac57801-9dd5-49e9-aadc-45e1434d6b02 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 05:18:03.076598 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:18:03.076598 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:18:03.076598 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:18:03.076598 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:18:03.076598 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:18:03.076598 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:18:03.076598 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:18:03.076598 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:18:03.076598 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:18:03.076598 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:18:03.076598 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:18:03.076598 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:18:03.076598 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:18:03.076598 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:18:03.076598 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:18:03.077658 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:18:03.077658 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:18:03.077658 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:18:03.077658 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:18:03.077658 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:18:03.077658 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:18:03.077658 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:18:03.077658 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:18:03.077658 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:18:03.077658 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:18:03.077658 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:18:03.077658 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:18:03.077658 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:18:03.077658 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:18:03.077658 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:18:03.077658 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:18:03.078502 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:18:03.078502 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:18:03.078502 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:18:03.078502 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:18:03.078502 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:18:03.078502 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:18:03.078502 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:18:03.078502 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:18:03.078502 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:18:03.078502 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:18:03.078502 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 05:18:03.078502 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:18:03.079973 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 545/1087] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 05:18:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:18:03.083624 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aa5267-ac15-4f21-bef4-1214144bf25e None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:18:03.182303 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aa5267-ac15-4f21-bef4-1214144bf25e None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:18:03.216298 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde825bf-2572-4e44-9681-4a37858cd96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:18:03.216900 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde825bf-2572-4e44-9681-4a37858cd96e None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:03.217177 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde825bf-2572-4e44-9681-4a37858cd96e None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:03.217447 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde825bf-2572-4e44-9681-4a37858cd96e None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:03.218104 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde825bf-2572-4e44-9681-4a37858cd96e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:18:03.218407 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde825bf-2572-4e44-9681-4a37858cd96e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:18:03.219813 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde825bf-2572-4e44-9681-4a37858cd96e None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:18:03.228421 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 543/1088] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 05:18:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:18:03.234040 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac57801-9dd5-49e9-aadc-45e1434d6b02 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:18:03.299063 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:18:03.336696 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac57801-9dd5-49e9-aadc-45e1434d6b02 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:18:03.371873 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f295f51b-639f-41a1-a000-5fa83000c6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:18:03.372502 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f295f51b-639f-41a1-a000-5fa83000c6f8 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:03.372780 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f295f51b-639f-41a1-a000-5fa83000c6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:03.373051 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f295f51b-639f-41a1-a000-5fa83000c6f8 None admin] PATH_INFO: `/v3/users/7476485893884a458e1b9c43bb15c56f` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:03.374168 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f295f51b-639f-41a1-a000-5fa83000c6f8 None admin] RBAC: Authorizing `identity:get_user(user_id=7476485893884a458e1b9c43bb15c56f)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:18:03.375599 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f295f51b-639f-41a1-a000-5fa83000c6f8 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:18:03.377212 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 546/1089] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 05:18:03 2022] GET /identity/v3/users/7476485893884a458e1b9c43bb15c56f => generated 285 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:18:03.382928 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde825bf-2572-4e44-9681-4a37858cd96e None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:18:03.435274 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a25fcd-77b8-4570-9be1-b4c76cd172a5 None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:03.435466 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a25fcd-77b8-4570-9be1-b4c76cd172a5 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:03.435772 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a25fcd-77b8-4570-9be1-b4c76cd172a5 None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:03.437111 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 547/1090] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:18:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 05:18:03.442019 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381aae68-87ec-4732-a389-a3cb221d2be1 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:03.442297 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381aae68-87ec-4732-a389-a3cb221d2be1 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:03.442567 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381aae68-87ec-4732-a389-a3cb221d2be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:03.443047 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:18:03.461265 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-381aae68-87ec-4732-a389-a3cb221d2be1 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:18:03.462439 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-381aae68-87ec-4732-a389-a3cb221d2be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:18:03.482142 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde825bf-2572-4e44-9681-4a37858cd96e None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:18:03.515209 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84860ef-1d59-40f3-8dfb-bda6c8667eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:18:03.515851 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84860ef-1d59-40f3-8dfb-bda6c8667eb5 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:03.516132 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84860ef-1d59-40f3-8dfb-bda6c8667eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:03.516426 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84860ef-1d59-40f3-8dfb-bda6c8667eb5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:03.531000 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 548/1091] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:18:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 05:18:03.586513 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84860ef-1d59-40f3-8dfb-bda6c8667eb5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:18:03.588063 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84860ef-1d59-40f3-8dfb-bda6c8667eb5 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:18:03.646961 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:18:03.686372 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 544/1092] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 05:18:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 11 05:18:03.692122 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381aae68-87ec-4732-a389-a3cb221d2be1 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:18:03.752601 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:18:03.791338 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381aae68-87ec-4732-a389-a3cb221d2be1 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:18:03.798516 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84860ef-1d59-40f3-8dfb-bda6c8667eb5 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:18:03.824472 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af4f27-78b2-476b-bc4a-f70939266603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:18:03.825109 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af4f27-78b2-476b-bc4a-f70939266603 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:03.825389 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af4f27-78b2-476b-bc4a-f70939266603 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:03.825657 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af4f27-78b2-476b-bc4a-f70939266603 None admin] PATH_INFO: `/v3/projects/77c360b338924e8280a9e0bed2042d31` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:03.826770 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37af4f27-78b2-476b-bc4a-f70939266603 None admin] RBAC: Authorizing `identity:get_project(project_id=77c360b338924e8280a9e0bed2042d31)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:18:03.828250 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37af4f27-78b2-476b-bc4a-f70939266603 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:18:03.829960 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 549/1093] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 05:18:03 2022] GET /identity/v3/projects/77c360b338924e8280a9e0bed2042d31 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:18:03.835863 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af4f27-78b2-476b-bc4a-f70939266603 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:18:03.901505 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84860ef-1d59-40f3-8dfb-bda6c8667eb5 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:18:03.932422 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af4f27-78b2-476b-bc4a-f70939266603 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:18:03.934573 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4d6261-0b32-4b11-ab6a-d55a055ecb6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:18:03.935195 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d6261-0b32-4b11-ab6a-d55a055ecb6e None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:03.935471 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d6261-0b32-4b11-ab6a-d55a055ecb6e None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:03.935886 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d6261-0b32-4b11-ab6a-d55a055ecb6e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:03.945711 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4d6261-0b32-4b11-ab6a-d55a055ecb6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:18:03.950573 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-bc4d6261-0b32-4b11-ab6a-d55a055ecb6e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 11 05:18:03.950573 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:18:03.950573 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:18:03.950573 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:18:03.950573 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:18:03.950573 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:18:03.950573 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:18:03.950573 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:18:03.950573 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:18:03.950573 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:18:03.950573 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:18:03.950573 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:18:03.950573 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:18:03.950573 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:18:03.950573 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:18:03.950573 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:18:03.951720 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:18:03.951720 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:18:03.951720 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:18:03.951720 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:18:03.951720 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:18:03.951720 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:18:03.951720 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:18:03.951720 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:18:03.951720 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:18:03.951720 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:18:03.951720 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:18:03.951720 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:18:03.951720 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:18:03.951720 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:18:03.951720 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:18:03.951720 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:18:03.952821 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:18:03.952821 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:18:03.952821 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:18:03.952821 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:18:03.952821 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:18:03.952821 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:18:03.952821 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:18:03.952821 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:18:03.952821 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:18:03.952821 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:18:03.952821 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 11 05:18:03.952821 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:18:03.952821 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 545/1094] 10.222.0.16 () {56 vars in 1120 bytes} [Sun Sep 11 05:18:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 05:18:03.958121 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4d6261-0b32-4b11-ab6a-d55a055ecb6e None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:18:03.963440 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:18:03.968969 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a863a32-2bd9-43be-bd07-cc6eccd30ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:18:03.969570 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a863a32-2bd9-43be-bd07-cc6eccd30ace None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:03.969843 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a863a32-2bd9-43be-bd07-cc6eccd30ace None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:03.970116 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a863a32-2bd9-43be-bd07-cc6eccd30ace None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:03.970837 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a863a32-2bd9-43be-bd07-cc6eccd30ace None admin] RBAC: Adding query filter params (role.id=5b702713e40145b49e0b42abd0a5fba9, scope.project.id=77c360b338924e8280a9e0bed2042d31, user.id=7476485893884a458e1b9c43bb15c56f) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:18:03.971143 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a863a32-2bd9-43be-bd07-cc6eccd30ace None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:18:03.972607 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a863a32-2bd9-43be-bd07-cc6eccd30ace None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:18:03.978972 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 550/1095] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 05:18:03 2022] GET /identity/v3/role_assignments?user.id=7476485893884a458e1b9c43bb15c56f&scope.project.id=77c360b338924e8280a9e0bed2042d31&role.id=5b702713e40145b49e0b42abd0a5fba9 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:18:03.983662 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:18:04.063165 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4d6261-0b32-4b11-ab6a-d55a055ecb6e None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:18:04.098642 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9156594-c2b9-4c65-9ad8-be196290b559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:18:04.099257 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9156594-c2b9-4c65-9ad8-be196290b559 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:04.099531 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9156594-c2b9-4c65-9ad8-be196290b559 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:04.099837 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9156594-c2b9-4c65-9ad8-be196290b559 None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:04.100632 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9156594-c2b9-4c65-9ad8-be196290b559 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:18:04.100936 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9156594-c2b9-4c65-9ad8-be196290b559 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:18:04.102344 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9156594-c2b9-4c65-9ad8-be196290b559 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:18:04.111093 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 546/1096] 10.222.0.16 () {56 vars in 1115 bytes} [Sun Sep 11 05:18:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:18:04.117932 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a863a32-2bd9-43be-bd07-cc6eccd30ace None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:18:04.219360 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a863a32-2bd9-43be-bd07-cc6eccd30ace None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:18:04.252110 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1799f4-55c4-4fbd-83af-50f819b9a681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:18:04.252738 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1799f4-55c4-4fbd-83af-50f819b9a681 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:04.253016 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1799f4-55c4-4fbd-83af-50f819b9a681 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:04.253285 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1799f4-55c4-4fbd-83af-50f819b9a681 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:04.264120 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1799f4-55c4-4fbd-83af-50f819b9a681 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:18:04.265565 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1799f4-55c4-4fbd-83af-50f819b9a681 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:18:04.279339 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-8f1799f4-55c4-4fbd-83af-50f819b9a681 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:18:04.279339 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:18:04.279339 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:18:04.279339 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:18:04.279339 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:18:04.279339 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:18:04.279339 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:18:04.279339 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:18:04.279339 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:18:04.279339 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:18:04.279339 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:18:04.279339 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:18:04.279339 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 05:18:04.279339 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 05:18:04.279339 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 05:18:04.279339 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 05:18:04.280321 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:18:04.280321 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:18:04.280321 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:18:04.280321 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:18:04.280321 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:18:04.280321 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:18:04.280321 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:18:04.280321 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:18:04.280321 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:18:04.280321 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:18:04.280321 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:18:04.280321 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:18:04.280321 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:18:04.280321 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:18:04.280321 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:18:04.280321 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:18:04.280321 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 05:18:04.281298 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 05:18:04.281298 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:18:04.281298 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:18:04.281298 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 551/1097] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:18:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:18:04.286686 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9156594-c2b9-4c65-9ad8-be196290b559 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:18:04.371417 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:18:04.386950 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9156594-c2b9-4c65-9ad8-be196290b559 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:18:04.419010 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799bea0b-7d8c-4e69-a7f2-68a89b53d495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:18:04.419605 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799bea0b-7d8c-4e69-a7f2-68a89b53d495 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:04.419910 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799bea0b-7d8c-4e69-a7f2-68a89b53d495 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:04.420178 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799bea0b-7d8c-4e69-a7f2-68a89b53d495 None admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:04.420810 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799bea0b-7d8c-4e69-a7f2-68a89b53d495 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:18:04.421109 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799bea0b-7d8c-4e69-a7f2-68a89b53d495 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:18:04.422473 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799bea0b-7d8c-4e69-a7f2-68a89b53d495 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:18:04.433877 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 547/1098] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 05:18:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:18:04.439439 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1799f4-55c4-4fbd-83af-50f819b9a681 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:18:04.487864 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:18:04.538557 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1799f4-55c4-4fbd-83af-50f819b9a681 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:18:04.571104 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2998cf31-8904-4f5e-bf8e-e28fc5f852f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:18:04.571749 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2998cf31-8904-4f5e-bf8e-e28fc5f852f3 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:04.572027 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2998cf31-8904-4f5e-bf8e-e28fc5f852f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:04.572298 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2998cf31-8904-4f5e-bf8e-e28fc5f852f3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:04.579485 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2998cf31-8904-4f5e-bf8e-e28fc5f852f3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:18:04.580945 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2998cf31-8904-4f5e-bf8e-e28fc5f852f3 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:18:04.591719 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-2998cf31-8904-4f5e-bf8e-e28fc5f852f3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 11 05:18:04.591719 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:18:04.591719 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:18:04.591719 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:18:04.591719 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:18:04.591719 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:18:04.591719 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:18:04.591719 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:18:04.591719 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:18:04.591719 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:18:04.591719 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:18:04.591719 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:18:04.591719 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 05:18:04.591719 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 05:18:04.591719 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 05:18:04.591719 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 05:18:04.592797 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:18:04.592797 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:18:04.592797 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 05:18:04.592797 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 05:18:04.592797 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 05:18:04.592797 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 05:18:04.592797 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:18:04.592797 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:18:04.592797 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:18:04.592797 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:18:04.592797 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:18:04.592797 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:18:04.592797 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:18:04.592797 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:18:04.592797 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:18:04.592797 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:18:04.592797 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:18:04.592797 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:18:04.593749 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:18:04.593749 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:18:04.593749 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 05:18:04.593749 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 05:18:04.593749 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 05:18:04.593749 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 05:18:04.593749 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 05:18:04.593749 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 05:18:04.593749 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 11 05:18:04.593749 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:18:04.593749 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 552/1099] 10.222.0.16 () {56 vars in 1093 bytes} [Sun Sep 11 05:18:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 05:18:04.599042 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799bea0b-7d8c-4e69-a7f2-68a89b53d495 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:18:04.695591 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799bea0b-7d8c-4e69-a7f2-68a89b53d495 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:18:04.729639 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee869800-25ef-425b-9f86-28200bc38ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:18:04.730244 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee869800-25ef-425b-9f86-28200bc38ff7 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:04.730521 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee869800-25ef-425b-9f86-28200bc38ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:04.730793 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee869800-25ef-425b-9f86-28200bc38ff7 None admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:04.731514 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee869800-25ef-425b-9f86-28200bc38ff7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:18:04.731852 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee869800-25ef-425b-9f86-28200bc38ff7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:18:04.733289 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee869800-25ef-425b-9f86-28200bc38ff7 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:18:04.752666 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 548/1100] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Sep 11 05:18:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:18:04.755925 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2998cf31-8904-4f5e-bf8e-e28fc5f852f3 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:18:04.856411 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2998cf31-8904-4f5e-bf8e-e28fc5f852f3 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:18:04.866345 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:18:04.892175 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34381f0f-be6c-4719-b865-bb32e7a8cdd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:18:04.892782 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34381f0f-be6c-4719-b865-bb32e7a8cdd2 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:04.893061 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34381f0f-be6c-4719-b865-bb32e7a8cdd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:04.893333 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34381f0f-be6c-4719-b865-bb32e7a8cdd2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:04.958799 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34381f0f-be6c-4719-b865-bb32e7a8cdd2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:18:04.960272 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34381f0f-be6c-4719-b865-bb32e7a8cdd2 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:18:05.059190 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 553/1101] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 05:18:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 05:18:05.060341 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee869800-25ef-425b-9f86-28200bc38ff7 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:18:05.063205 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:18:05.161377 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee869800-25ef-425b-9f86-28200bc38ff7 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:18:05.195206 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9d78b2-d489-4817-a5f8-992ee01d75d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:18:05.195858 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d78b2-d489-4817-a5f8-992ee01d75d0 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:05.196141 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d78b2-d489-4817-a5f8-992ee01d75d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:05.196414 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d78b2-d489-4817-a5f8-992ee01d75d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:05.206216 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9d78b2-d489-4817-a5f8-992ee01d75d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:18:05.208268 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9d78b2-d489-4817-a5f8-992ee01d75d0 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:18:05.222582 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-7a9d78b2-d489-4817-a5f8-992ee01d75d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:18:05.222582 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:18:05.222582 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:18:05.222582 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:18:05.222582 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:18:05.222582 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:18:05.222582 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:18:05.222582 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:18:05.222582 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:18:05.222582 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:18:05.222582 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:18:05.222582 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:18:05.222582 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 05:18:05.222582 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 05:18:05.222582 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 05:18:05.222582 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 05:18:05.223712 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:18:05.223712 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:18:05.223712 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:18:05.223712 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:18:05.223712 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:18:05.223712 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:18:05.223712 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:18:05.223712 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:18:05.223712 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:18:05.223712 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:18:05.223712 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:18:05.223712 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:18:05.223712 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:18:05.223712 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:18:05.223712 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:18:05.223712 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:18:05.223712 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 05:18:05.225059 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 05:18:05.225059 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:18:05.225059 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:18:05.225059 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 549/1102] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:18:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 05:18:05.229397 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34381f0f-be6c-4719-b865-bb32e7a8cdd2 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:18:05.239318 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:18:05.326534 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34381f0f-be6c-4719-b865-bb32e7a8cdd2 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:18:05.360072 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193ccb3e-1e5f-4319-9691-9a1c8a110b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:18:05.360686 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ccb3e-1e5f-4319-9691-9a1c8a110b77 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:05.360967 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ccb3e-1e5f-4319-9691-9a1c8a110b77 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:05.361242 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ccb3e-1e5f-4319-9691-9a1c8a110b77 None admin] PATH_INFO: `/v3/domains` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:05.361878 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193ccb3e-1e5f-4319-9691-9a1c8a110b77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:18:05.362180 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193ccb3e-1e5f-4319-9691-9a1c8a110b77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:18:05.363548 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193ccb3e-1e5f-4319-9691-9a1c8a110b77 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:18:05.374773 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 554/1103] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 05:18:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:18:05.380994 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9d78b2-d489-4817-a5f8-992ee01d75d0 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:18:05.434436 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:18:05.477428 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9d78b2-d489-4817-a5f8-992ee01d75d0 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:18:05.510079 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a870b02-d570-400e-82d3-62047df79733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:18:05.510683 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a870b02-d570-400e-82d3-62047df79733 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:05.510957 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a870b02-d570-400e-82d3-62047df79733 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:05.511225 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a870b02-d570-400e-82d3-62047df79733 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:05.517721 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a870b02-d570-400e-82d3-62047df79733 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:18:05.519155 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a870b02-d570-400e-82d3-62047df79733 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:18:05.530096 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-7a870b02-d570-400e-82d3-62047df79733 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 05:18:05.530096 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:18:05.530096 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:18:05.530096 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:18:05.530096 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:18:05.530096 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:18:05.530096 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:18:05.530096 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:18:05.530096 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:18:05.530096 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:18:05.530096 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:18:05.530096 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:18:05.530096 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 05:18:05.530096 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 05:18:05.530096 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 05:18:05.531170 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 05:18:05.531170 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:18:05.531170 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:18:05.531170 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:18:05.531170 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:18:05.531170 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:18:05.531170 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:18:05.531170 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:18:05.531170 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:18:05.531170 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:18:05.531170 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:18:05.531170 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:18:05.531170 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:18:05.531170 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:18:05.531170 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:18:05.531170 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:18:05.531170 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:18:05.532150 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 05:18:05.532150 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 05:18:05.532150 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 05:18:05.532150 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 05:18:05.532150 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 05:18:05.532150 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 05:18:05.532150 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 05:18:05.532150 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:18:05.532150 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 550/1104] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 05:18:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:18:05.537417 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193ccb3e-1e5f-4319-9691-9a1c8a110b77 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:18:05.614054 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:18:05.649394 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193ccb3e-1e5f-4319-9691-9a1c8a110b77 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:18:05.682427 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25343ca7-98d0-4d0d-af87-e622fc1416a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:18:05.683040 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25343ca7-98d0-4d0d-af87-e622fc1416a7 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:05.683325 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25343ca7-98d0-4d0d-af87-e622fc1416a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:05.683601 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25343ca7-98d0-4d0d-af87-e622fc1416a7 None admin] PATH_INFO: `/v3/projects` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:05.684334 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25343ca7-98d0-4d0d-af87-e622fc1416a7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:18:05.684650 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25343ca7-98d0-4d0d-af87-e622fc1416a7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:18:05.686106 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25343ca7-98d0-4d0d-af87-e622fc1416a7 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:18:05.698548 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 555/1105] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 05:18:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:18:05.704751 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a870b02-d570-400e-82d3-62047df79733 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:18:05.807018 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a870b02-d570-400e-82d3-62047df79733 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:18:05.820340 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:18:05.839974 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60749f59-ccec-4475-b861-4c59c351d4e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:18:05.840569 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60749f59-ccec-4475-b861-4c59c351d4e3 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:05.840844 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60749f59-ccec-4475-b861-4c59c351d4e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:05.841111 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60749f59-ccec-4475-b861-4c59c351d4e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:05.841818 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60749f59-ccec-4475-b861-4c59c351d4e3 None admin] RBAC: Adding query filter params (role.id=fb8e0aff63fc43b9bb64198f0d940aeb, scope.project.id=61ffb079d9e1437084945554bcc0747b, user.id=6cd6136036bd467c946cae90d5c29263) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:18:05.842122 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60749f59-ccec-4475-b861-4c59c351d4e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:18:05.843543 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60749f59-ccec-4475-b861-4c59c351d4e3 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:18:05.849638 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 551/1106] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 05:18:05 2022] GET /identity/v3/role_assignments?user.id=6cd6136036bd467c946cae90d5c29263&scope.project.id=61ffb079d9e1437084945554bcc0747b&role.id=fb8e0aff63fc43b9bb64198f0d940aeb => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:18:06.141865 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07295a51-d29b-480e-a1be-b74fc559bbad None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:06.142388 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07295a51-d29b-480e-a1be-b74fc559bbad None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:06.142388 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07295a51-d29b-480e-a1be-b74fc559bbad None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:06.143894 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 556/1107] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:18:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:18:06.150162 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc33dd2f-efd7-41df-aad0-d050fbc6adf2 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:06.150445 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc33dd2f-efd7-41df-aad0-d050fbc6adf2 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:06.150719 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc33dd2f-efd7-41df-aad0-d050fbc6adf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:06.169166 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-cc33dd2f-efd7-41df-aad0-d050fbc6adf2 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:18:06.170337 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-cc33dd2f-efd7-41df-aad0-d050fbc6adf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:18:06.236327 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 552/1108] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:18:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 05:18:06.502081 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07295a51-d29b-480e-a1be-b74fc559bbad None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:18:06.609391 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07295a51-d29b-480e-a1be-b74fc559bbad None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:18:06.636993 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:18:06.646256 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b863600a-01ce-4114-942a-4f641371d72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:18:06.646886 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b863600a-01ce-4114-942a-4f641371d72f None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:06.647160 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b863600a-01ce-4114-942a-4f641371d72f None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:06.647427 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b863600a-01ce-4114-942a-4f641371d72f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:06.648582 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b863600a-01ce-4114-942a-4f641371d72f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:18:06.650009 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b863600a-01ce-4114-942a-4f641371d72f None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:18:06.651579 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 557/1109] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:18:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:18:06.660803 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc33dd2f-efd7-41df-aad0-d050fbc6adf2 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:18:06.766862 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc33dd2f-efd7-41df-aad0-d050fbc6adf2 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:18:06.776513 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:18:06.801100 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d07715-4d89-434f-8c33-911414458d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:18:06.801698 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d07715-4d89-434f-8c33-911414458d78 None admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:06.801971 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d07715-4d89-434f-8c33-911414458d78 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:06.802239 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d07715-4d89-434f-8c33-911414458d78 None admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:06.802883 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d07715-4d89-434f-8c33-911414458d78 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:18:06.804348 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d07715-4d89-434f-8c33-911414458d78 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:18:06.824145 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 553/1110] 10.222.0.16 () {60 vars in 1132 bytes} [Sun Sep 11 05:18:06 2022] POST /identity/v3/users => generated 286 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:18:08.970951 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621e152a-d401-455b-876d-37ed493df915 None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:08.971503 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621e152a-d401-455b-876d-37ed493df915 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:08.971503 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621e152a-d401-455b-876d-37ed493df915 None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:08.973349 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 558/1111] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:18:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:18:08.978478 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b9ddff-2bd3-409b-9110-2ed37c65b433 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:08.978887 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b9ddff-2bd3-409b-9110-2ed37c65b433 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:08.979025 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b9ddff-2bd3-409b-9110-2ed37c65b433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:08.997473 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-89b9ddff-2bd3-409b-9110-2ed37c65b433 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:18:08.998651 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-89b9ddff-2bd3-409b-9110-2ed37c65b433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:18:09.061531 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 554/1112] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:18:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 05:18:09.330194 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621e152a-d401-455b-876d-37ed493df915 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:18:09.427909 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621e152a-d401-455b-876d-37ed493df915 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:18:09.460803 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0ca01a-20eb-4088-989c-738f2fff9805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:18:09.461415 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0ca01a-20eb-4088-989c-738f2fff9805 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:09.461687 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0ca01a-20eb-4088-989c-738f2fff9805 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:09.461953 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0ca01a-20eb-4088-989c-738f2fff9805 None admin] PATH_INFO: `/v3/roles/ada04449ee1f42599a060f4795ec1a74` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:09.463313 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0ca01a-20eb-4088-989c-738f2fff9805 None admin] RBAC: Authorizing `identity:get_role(role_id=ada04449ee1f42599a060f4795ec1a74)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:18:09.464706 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0ca01a-20eb-4088-989c-738f2fff9805 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:18:09.465994 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 559/1113] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 05:18:09 2022] GET /identity/v3/roles/ada04449ee1f42599a060f4795ec1a74 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:18:09.471711 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b9ddff-2bd3-409b-9110-2ed37c65b433 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:18:09.559942 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:18:09.567190 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b9ddff-2bd3-409b-9110-2ed37c65b433 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:18:09.600030 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d179d43-5e35-4526-91f5-0c7d3593b1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:18:09.600583 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d179d43-5e35-4526-91f5-0c7d3593b1d5 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:09.600862 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d179d43-5e35-4526-91f5-0c7d3593b1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:09.601126 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d179d43-5e35-4526-91f5-0c7d3593b1d5 None admin] PATH_INFO: `/v3/users/e90ce46710544b008010ffdf2b87da8c` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:09.613499 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d179d43-5e35-4526-91f5-0c7d3593b1d5 None admin] RBAC: Authorizing `identity:get_user(user_id=e90ce46710544b008010ffdf2b87da8c)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:18:09.614930 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d179d43-5e35-4526-91f5-0c7d3593b1d5 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:18:09.616552 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 555/1114] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 05:18:09 2022] GET /identity/v3/users/e90ce46710544b008010ffdf2b87da8c => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:18:09.622565 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0ca01a-20eb-4088-989c-738f2fff9805 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:18:09.681628 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:18:09.718322 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0ca01a-20eb-4088-989c-738f2fff9805 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:18:09.750686 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaf6769-a58e-4475-99a2-6edf78def9a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:18:09.751288 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf6769-a58e-4475-99a2-6edf78def9a4 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:09.751564 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf6769-a58e-4475-99a2-6edf78def9a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:09.751861 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf6769-a58e-4475-99a2-6edf78def9a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:09.819176 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaf6769-a58e-4475-99a2-6edf78def9a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:18:09.820660 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaf6769-a58e-4475-99a2-6edf78def9a4 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:18:09.878315 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:18:09.916113 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 560/1115] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 05:18:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 05:18:09.922061 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d179d43-5e35-4526-91f5-0c7d3593b1d5 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:18:10.018649 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d179d43-5e35-4526-91f5-0c7d3593b1d5 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:18:10.051465 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9fb9d0-cad0-40ee-9f7c-e1acb9d9eb42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:18:10.052107 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9fb9d0-cad0-40ee-9f7c-e1acb9d9eb42 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:10.052386 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9fb9d0-cad0-40ee-9f7c-e1acb9d9eb42 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:10.052656 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9fb9d0-cad0-40ee-9f7c-e1acb9d9eb42 None admin] PATH_INFO: `/v3/projects/77c360b338924e8280a9e0bed2042d31` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:10.053761 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9fb9d0-cad0-40ee-9f7c-e1acb9d9eb42 None admin] RBAC: Authorizing `identity:get_project(project_id=77c360b338924e8280a9e0bed2042d31)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:18:10.055190 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9fb9d0-cad0-40ee-9f7c-e1acb9d9eb42 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:18:10.056811 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 556/1116] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 05:18:09 2022] GET /identity/v3/projects/77c360b338924e8280a9e0bed2042d31 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:18:10.062902 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaf6769-a58e-4475-99a2-6edf78def9a4 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:18:10.157659 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaf6769-a58e-4475-99a2-6edf78def9a4 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:18:10.189977 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db130655-4510-4816-a3bf-0a541eaba5fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:18:10.190561 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db130655-4510-4816-a3bf-0a541eaba5fa None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:10.190835 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db130655-4510-4816-a3bf-0a541eaba5fa None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:10.191103 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db130655-4510-4816-a3bf-0a541eaba5fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:10.192425 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db130655-4510-4816-a3bf-0a541eaba5fa None admin] RBAC: Adding query filter params (role.id=ada04449ee1f42599a060f4795ec1a74, scope.project.id=77c360b338924e8280a9e0bed2042d31, user.id=e90ce46710544b008010ffdf2b87da8c) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:18:10.192731 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db130655-4510-4816-a3bf-0a541eaba5fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:18:10.194131 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db130655-4510-4816-a3bf-0a541eaba5fa None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:18:10.199227 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 561/1117] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 05:18:10 2022] GET /identity/v3/role_assignments?user.id=e90ce46710544b008010ffdf2b87da8c&scope.project.id=77c360b338924e8280a9e0bed2042d31&role.id=ada04449ee1f42599a060f4795ec1a74 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:18:12.321418 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880a245-448a-4442-8e78-435e09609048 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:12.321983 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880a245-448a-4442-8e78-435e09609048 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:12.322405 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880a245-448a-4442-8e78-435e09609048 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:12.324870 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 557/1118] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:18:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:18:12.330260 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd1ad3-aba7-4947-bdf9-a83d5e599055 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:12.330664 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd1ad3-aba7-4947-bdf9-a83d5e599055 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:12.330800 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd1ad3-aba7-4947-bdf9-a83d5e599055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:12.348560 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-b3dd1ad3-aba7-4947-bdf9-a83d5e599055 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:18:12.349729 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-b3dd1ad3-aba7-4947-bdf9-a83d5e599055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:18:12.372165 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:18:12.414627 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 562/1119] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:18:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 05:18:12.682302 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e880a245-448a-4442-8e78-435e09609048 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:18:12.703477 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:18:12.781050 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e880a245-448a-4442-8e78-435e09609048 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:18:12.814021 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b090f7f-1473-4263-8ddf-af737c7c102c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:18:12.814638 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b090f7f-1473-4263-8ddf-af737c7c102c None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:12.814912 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b090f7f-1473-4263-8ddf-af737c7c102c None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:12.815181 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b090f7f-1473-4263-8ddf-af737c7c102c None admin] PATH_INFO: `/v3/roles/ada04449ee1f42599a060f4795ec1a74` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:12.816582 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b090f7f-1473-4263-8ddf-af737c7c102c None admin] RBAC: Authorizing `identity:get_role(role_id=ada04449ee1f42599a060f4795ec1a74)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:18:12.817975 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b090f7f-1473-4263-8ddf-af737c7c102c None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:18:12.819270 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 558/1120] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 05:18:12 2022] GET /identity/v3/roles/ada04449ee1f42599a060f4795ec1a74 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:18:12.825308 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dd1ad3-aba7-4947-bdf9-a83d5e599055 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:18:12.918781 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dd1ad3-aba7-4947-bdf9-a83d5e599055 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:18:12.951026 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215431ad-3767-442b-8460-a3317acb4dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:18:12.951582 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215431ad-3767-442b-8460-a3317acb4dfb None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:12.951885 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215431ad-3767-442b-8460-a3317acb4dfb None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:12.952158 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215431ad-3767-442b-8460-a3317acb4dfb None admin] PATH_INFO: `/v3/users/e90ce46710544b008010ffdf2b87da8c` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:12.953253 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215431ad-3767-442b-8460-a3317acb4dfb None admin] RBAC: Authorizing `identity:get_user(user_id=e90ce46710544b008010ffdf2b87da8c)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:18:12.954664 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215431ad-3767-442b-8460-a3317acb4dfb None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:18:12.956232 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 563/1121] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 05:18:12 2022] GET /identity/v3/users/e90ce46710544b008010ffdf2b87da8c => generated 286 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:18:12.962271 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b090f7f-1473-4263-8ddf-af737c7c102c None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:18:13.047493 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:18:13.061019 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b090f7f-1473-4263-8ddf-af737c7c102c None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:18:13.093478 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7956174-70f2-4d92-8e3f-9f677c642270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:18:13.094097 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7956174-70f2-4d92-8e3f-9f677c642270 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:13.094379 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7956174-70f2-4d92-8e3f-9f677c642270 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:13.094653 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7956174-70f2-4d92-8e3f-9f677c642270 None admin] PATH_INFO: `/v3/projects/77c360b338924e8280a9e0bed2042d31` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:13.095800 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7956174-70f2-4d92-8e3f-9f677c642270 None admin] RBAC: Authorizing `identity:get_project(project_id=77c360b338924e8280a9e0bed2042d31)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:18:13.097238 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7956174-70f2-4d92-8e3f-9f677c642270 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:18:13.099425 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 559/1122] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 05:18:12 2022] GET /identity/v3/projects/77c360b338924e8280a9e0bed2042d31 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:18:13.105205 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215431ad-3767-442b-8460-a3317acb4dfb None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:18:13.131448 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:18:13.201277 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215431ad-3767-442b-8460-a3317acb4dfb None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:18:13.233293 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4a9d81-d599-4c0b-8fe3-059f42cc85b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:18:13.233927 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a9d81-d599-4c0b-8fe3-059f42cc85b7 None admin] REQUEST_METHOD: `PUT` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:13.234202 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a9d81-d599-4c0b-8fe3-059f42cc85b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:13.234471 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a9d81-d599-4c0b-8fe3-059f42cc85b7 None admin] PATH_INFO: `/v3/projects/77c360b338924e8280a9e0bed2042d31/users/e90ce46710544b008010ffdf2b87da8c/roles/ada04449ee1f42599a060f4795ec1a74` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:13.236593 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4a9d81-d599-4c0b-8fe3-059f42cc85b7 None admin] RBAC: Authorizing `identity:create_grant(project_id=77c360b338924e8280a9e0bed2042d31, user_id=e90ce46710544b008010ffdf2b87da8c, role_id=ada04449ee1f42599a060f4795ec1a74)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:18:13.238007 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4a9d81-d599-4c0b-8fe3-059f42cc85b7 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:18:13.250770 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 564/1123] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 11 05:18:13 2022] PUT /identity/v3/projects/77c360b338924e8280a9e0bed2042d31/users/e90ce46710544b008010ffdf2b87da8c/roles/ada04449ee1f42599a060f4795ec1a74 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:18:15.406933 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b62f89-da17-4ea8-9271-c44a43ee0811 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:15.407494 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b62f89-da17-4ea8-9271-c44a43ee0811 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:15.407494 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b62f89-da17-4ea8-9271-c44a43ee0811 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:15.408863 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 560/1124] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:18:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:18:15.415038 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb3fda4-e9fc-40e5-b4a0-3fa88eeffeef None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:15.415477 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb3fda4-e9fc-40e5-b4a0-3fa88eeffeef None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:15.415580 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb3fda4-e9fc-40e5-b4a0-3fa88eeffeef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:15.433613 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-cdb3fda4-e9fc-40e5-b4a0-3fa88eeffeef None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:18:15.434777 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-cdb3fda4-e9fc-40e5-b4a0-3fa88eeffeef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:18:15.498080 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 565/1125] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:18:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 05:18:15.792951 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b62f89-da17-4ea8-9271-c44a43ee0811 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:18:15.892041 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b62f89-da17-4ea8-9271-c44a43ee0811 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:18:15.924501 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909a3c41-c8f8-4682-a90d-927d64f69a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:18:15.925110 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a3c41-c8f8-4682-a90d-927d64f69a34 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:15.925386 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a3c41-c8f8-4682-a90d-927d64f69a34 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:15.925659 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a3c41-c8f8-4682-a90d-927d64f69a34 None admin] PATH_INFO: `/v3/roles/ada04449ee1f42599a060f4795ec1a74` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:15.927085 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909a3c41-c8f8-4682-a90d-927d64f69a34 None admin] RBAC: Authorizing `identity:get_role(role_id=ada04449ee1f42599a060f4795ec1a74)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:18:15.928479 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909a3c41-c8f8-4682-a90d-927d64f69a34 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:18:15.930041 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 561/1126] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 05:18:15 2022] GET /identity/v3/roles/ada04449ee1f42599a060f4795ec1a74 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:18:15.935703 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb3fda4-e9fc-40e5-b4a0-3fa88eeffeef None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:18:15.953630 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:18:16.033843 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb3fda4-e9fc-40e5-b4a0-3fa88eeffeef None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:18:16.067506 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f373440-6fdb-499e-8b92-4350a7bded2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:18:16.068084 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f373440-6fdb-499e-8b92-4350a7bded2a None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:16.068359 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f373440-6fdb-499e-8b92-4350a7bded2a None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:16.068627 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f373440-6fdb-499e-8b92-4350a7bded2a None admin] PATH_INFO: `/v3/users/e90ce46710544b008010ffdf2b87da8c` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:16.069730 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f373440-6fdb-499e-8b92-4350a7bded2a None admin] RBAC: Authorizing `identity:get_user(user_id=e90ce46710544b008010ffdf2b87da8c)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:18:16.071156 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f373440-6fdb-499e-8b92-4350a7bded2a None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:18:16.072772 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 566/1127] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 05:18:15 2022] GET /identity/v3/users/e90ce46710544b008010ffdf2b87da8c => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:18:16.078593 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909a3c41-c8f8-4682-a90d-927d64f69a34 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:18:16.104882 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:18:16.177300 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909a3c41-c8f8-4682-a90d-927d64f69a34 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:18:16.209118 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96d6e15-50ba-4d9c-ab9f-34babe81608a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:18:16.209725 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d6e15-50ba-4d9c-ab9f-34babe81608a None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:16.210000 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d6e15-50ba-4d9c-ab9f-34babe81608a None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:16.210267 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d6e15-50ba-4d9c-ab9f-34babe81608a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:16.273759 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96d6e15-50ba-4d9c-ab9f-34babe81608a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:18:16.275205 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96d6e15-50ba-4d9c-ab9f-34babe81608a None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:18:16.297830 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:18:16.370441 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 562/1128] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 05:18:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 05:18:16.376358 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f373440-6fdb-499e-8b92-4350a7bded2a None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:18:16.456759 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:18:16.472290 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f373440-6fdb-499e-8b92-4350a7bded2a None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:18:16.505747 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aafd72-c97e-4477-8e06-dbe6065c4573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:18:16.506372 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aafd72-c97e-4477-8e06-dbe6065c4573 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:16.506648 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aafd72-c97e-4477-8e06-dbe6065c4573 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:16.506918 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aafd72-c97e-4477-8e06-dbe6065c4573 None admin] PATH_INFO: `/v3/projects/77c360b338924e8280a9e0bed2042d31` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:16.508057 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aafd72-c97e-4477-8e06-dbe6065c4573 None admin] RBAC: Authorizing `identity:get_project(project_id=77c360b338924e8280a9e0bed2042d31)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:18:16.509476 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aafd72-c97e-4477-8e06-dbe6065c4573 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:18:16.511088 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 567/1129] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 05:18:16 2022] GET /identity/v3/projects/77c360b338924e8280a9e0bed2042d31 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:18:16.517266 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96d6e15-50ba-4d9c-ab9f-34babe81608a None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:18:16.611641 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96d6e15-50ba-4d9c-ab9f-34babe81608a None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:18:16.634728 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:18:16.645407 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd8e25e-aabb-48df-8117-515e5d6430ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:18:16.645990 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd8e25e-aabb-48df-8117-515e5d6430ee None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:16.646265 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd8e25e-aabb-48df-8117-515e5d6430ee None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:16.646527 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd8e25e-aabb-48df-8117-515e5d6430ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:16.647237 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd8e25e-aabb-48df-8117-515e5d6430ee None admin] RBAC: Adding query filter params (role.id=ada04449ee1f42599a060f4795ec1a74, scope.project.id=77c360b338924e8280a9e0bed2042d31, user.id=e90ce46710544b008010ffdf2b87da8c) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:18:16.647537 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd8e25e-aabb-48df-8117-515e5d6430ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:18:16.648975 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd8e25e-aabb-48df-8117-515e5d6430ee None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:18:16.654486 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 563/1130] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 05:18:16 2022] GET /identity/v3/role_assignments?user.id=e90ce46710544b008010ffdf2b87da8c&scope.project.id=77c360b338924e8280a9e0bed2042d31&role.id=ada04449ee1f42599a060f4795ec1a74 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:18:18.809640 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a7382e-adde-437b-a158-dc7eef508412 None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:18.810120 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a7382e-adde-437b-a158-dc7eef508412 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:18.810219 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a7382e-adde-437b-a158-dc7eef508412 None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:18.811540 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 568/1131] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:18:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:18:18.817364 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd112b-2d31-4895-9827-ad67a8db3e24 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:18.817752 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd112b-2d31-4895-9827-ad67a8db3e24 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:18.817916 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd112b-2d31-4895-9827-ad67a8db3e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:18.836035 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-f5cd112b-2d31-4895-9827-ad67a8db3e24 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:18:18.837223 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-f5cd112b-2d31-4895-9827-ad67a8db3e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:18:18.900791 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 564/1132] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:18:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 05:18:19.167123 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a7382e-adde-437b-a158-dc7eef508412 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:18:19.265757 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a7382e-adde-437b-a158-dc7eef508412 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:18:19.298450 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46972751-bb0e-404b-b4bc-41daaaf59551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:18:19.299063 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46972751-bb0e-404b-b4bc-41daaaf59551 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:19.299340 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46972751-bb0e-404b-b4bc-41daaaf59551 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:19.299609 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46972751-bb0e-404b-b4bc-41daaaf59551 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:19.300814 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46972751-bb0e-404b-b4bc-41daaaf59551 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:18:19.302233 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46972751-bb0e-404b-b4bc-41daaaf59551 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:18:19.303796 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 569/1133] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:18:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:18:19.309413 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cd112b-2d31-4895-9827-ad67a8db3e24 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:18:19.404745 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cd112b-2d31-4895-9827-ad67a8db3e24 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:18:19.421165 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:18:19.437823 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff36d7a-9537-4ad8-b1d1-4fcf9305dfbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:18:19.438416 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff36d7a-9537-4ad8-b1d1-4fcf9305dfbc None admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:19.438692 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff36d7a-9537-4ad8-b1d1-4fcf9305dfbc None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:19.438961 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff36d7a-9537-4ad8-b1d1-4fcf9305dfbc None admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:19.439588 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff36d7a-9537-4ad8-b1d1-4fcf9305dfbc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:18:19.441034 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff36d7a-9537-4ad8-b1d1-4fcf9305dfbc None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:18:19.468104 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 565/1134] 10.222.0.16 () {60 vars in 1141 bytes} [Sun Sep 11 05:18:19 2022] POST /identity/v3/projects => generated 311 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:18:21.593123 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab9282b-ac5d-4fd1-9fed-ea1ab7b63ac4 None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:21.593683 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab9282b-ac5d-4fd1-9fed-ea1ab7b63ac4 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:21.593683 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab9282b-ac5d-4fd1-9fed-ea1ab7b63ac4 None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:21.595037 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 570/1135] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:18:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:18:21.600663 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5258e9d0-b517-4f79-b473-29c3f17ca081 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:21.601083 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5258e9d0-b517-4f79-b473-29c3f17ca081 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:21.601210 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5258e9d0-b517-4f79-b473-29c3f17ca081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:21.619706 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-5258e9d0-b517-4f79-b473-29c3f17ca081 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:18:21.620864 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-5258e9d0-b517-4f79-b473-29c3f17ca081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:18:21.683617 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 566/1136] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:18:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 05:18:21.952304 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab9282b-ac5d-4fd1-9fed-ea1ab7b63ac4 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:18:21.975367 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:18:22.057157 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab9282b-ac5d-4fd1-9fed-ea1ab7b63ac4 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:18:22.091473 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85dc9e6-9c02-4f13-a148-07bf402bce49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:18:22.092150 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85dc9e6-9c02-4f13-a148-07bf402bce49 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:22.092433 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85dc9e6-9c02-4f13-a148-07bf402bce49 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:22.092703 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85dc9e6-9c02-4f13-a148-07bf402bce49 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:22.094239 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85dc9e6-9c02-4f13-a148-07bf402bce49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:18:22.095673 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85dc9e6-9c02-4f13-a148-07bf402bce49 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:18:22.097278 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 571/1137] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:18:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:18:22.103891 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5258e9d0-b517-4f79-b473-29c3f17ca081 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:18:22.205796 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:18:22.209148 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5258e9d0-b517-4f79-b473-29c3f17ca081 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:18:22.245687 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071b814c-0222-44f6-acd8-d8bf2155c54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:18:22.246306 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b814c-0222-44f6-acd8-d8bf2155c54e None admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:22.246583 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b814c-0222-44f6-acd8-d8bf2155c54e None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:22.246886 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b814c-0222-44f6-acd8-d8bf2155c54e None admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:22.247518 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071b814c-0222-44f6-acd8-d8bf2155c54e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:18:22.249128 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071b814c-0222-44f6-acd8-d8bf2155c54e None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:18:22.271314 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 567/1138] 10.222.0.16 () {60 vars in 1132 bytes} [Sun Sep 11 05:18:22 2022] POST /identity/v3/users => generated 286 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:18:24.523812 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c13fa66-0400-4088-aea6-bb23da9c98a1 None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:24.524347 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c13fa66-0400-4088-aea6-bb23da9c98a1 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:24.524347 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c13fa66-0400-4088-aea6-bb23da9c98a1 None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:24.525709 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 572/1139] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:18:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:18:24.530997 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a46532-ea8a-4567-81de-2a57dbff753d None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:24.531427 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a46532-ea8a-4567-81de-2a57dbff753d None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:24.531537 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a46532-ea8a-4567-81de-2a57dbff753d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:24.550039 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-35a46532-ea8a-4567-81de-2a57dbff753d None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:18:24.551887 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-35a46532-ea8a-4567-81de-2a57dbff753d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:18:24.615692 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 568/1140] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:18:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 05:18:24.883367 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c13fa66-0400-4088-aea6-bb23da9c98a1 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:18:24.970224 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:18:24.983778 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c13fa66-0400-4088-aea6-bb23da9c98a1 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:18:25.016360 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb95aa6-8f9e-496f-99f8-dcf54e80158b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:18:25.016979 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb95aa6-8f9e-496f-99f8-dcf54e80158b None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:25.017259 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb95aa6-8f9e-496f-99f8-dcf54e80158b None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:25.017532 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb95aa6-8f9e-496f-99f8-dcf54e80158b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:25.027762 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb95aa6-8f9e-496f-99f8-dcf54e80158b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:18:25.032505 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-3bb95aa6-8f9e-496f-99f8-dcf54e80158b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 05:18:25.032505 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:18:25.032505 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:18:25.032505 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:18:25.032505 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:18:25.032505 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:18:25.032505 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:18:25.032505 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:18:25.032505 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:18:25.032505 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:18:25.032505 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:18:25.032505 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:18:25.032505 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:18:25.032505 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:18:25.032505 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:18:25.032505 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:18:25.033675 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:18:25.033675 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:18:25.033675 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:18:25.033675 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:18:25.033675 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:18:25.033675 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:18:25.033675 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:18:25.033675 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:18:25.033675 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:18:25.033675 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:18:25.033675 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:18:25.033675 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:18:25.033675 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:18:25.033675 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:18:25.033675 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:18:25.033675 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:18:25.034739 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:18:25.034739 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:18:25.034739 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:18:25.034739 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:18:25.034739 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:18:25.034739 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:18:25.034739 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:18:25.034739 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:18:25.034739 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:18:25.034739 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:18:25.034739 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 05:18:25.034739 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:18:25.034739 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 573/1141] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 05:18:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:18:25.040103 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a46532-ea8a-4567-81de-2a57dbff753d None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:18:25.121391 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:18:25.136503 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a46532-ea8a-4567-81de-2a57dbff753d None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:18:25.170447 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402728bf-84ca-4b9b-a8dd-3acd5cd2143c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:18:25.171043 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402728bf-84ca-4b9b-a8dd-3acd5cd2143c None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:25.171321 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402728bf-84ca-4b9b-a8dd-3acd5cd2143c None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:25.171590 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402728bf-84ca-4b9b-a8dd-3acd5cd2143c None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:25.172281 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402728bf-84ca-4b9b-a8dd-3acd5cd2143c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:18:25.172578 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402728bf-84ca-4b9b-a8dd-3acd5cd2143c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:18:25.173946 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402728bf-84ca-4b9b-a8dd-3acd5cd2143c None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:18:25.181875 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 569/1142] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 05:18:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:18:25.187721 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb95aa6-8f9e-496f-99f8-dcf54e80158b None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:18:25.284429 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb95aa6-8f9e-496f-99f8-dcf54e80158b None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:18:25.317562 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cb1ac9-26a9-467f-ac35-6df6a449e3cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:18:25.318116 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb1ac9-26a9-467f-ac35-6df6a449e3cc None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:25.318395 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb1ac9-26a9-467f-ac35-6df6a449e3cc None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:25.318668 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb1ac9-26a9-467f-ac35-6df6a449e3cc None admin] PATH_INFO: `/v3/users/23ffc16cf2b64bea933d1570af576027` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:25.331137 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cb1ac9-26a9-467f-ac35-6df6a449e3cc None admin] RBAC: Authorizing `identity:get_user(user_id=23ffc16cf2b64bea933d1570af576027)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:18:25.332651 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cb1ac9-26a9-467f-ac35-6df6a449e3cc None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:18:25.334216 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 574/1143] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 05:18:25 2022] GET /identity/v3/users/23ffc16cf2b64bea933d1570af576027 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:18:25.339601 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402728bf-84ca-4b9b-a8dd-3acd5cd2143c None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:18:25.436912 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402728bf-84ca-4b9b-a8dd-3acd5cd2143c None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:18:25.468742 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9be6592-b9ae-4939-9ddd-26566bf89ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:18:25.469338 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be6592-b9ae-4939-9ddd-26566bf89ff5 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:25.469617 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be6592-b9ae-4939-9ddd-26566bf89ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:25.469888 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be6592-b9ae-4939-9ddd-26566bf89ff5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:25.486832 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:18:25.534323 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9be6592-b9ae-4939-9ddd-26566bf89ff5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:18:25.536302 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9be6592-b9ae-4939-9ddd-26566bf89ff5 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:18:25.630214 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 570/1144] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 05:18:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 05:18:25.636027 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cb1ac9-26a9-467f-ac35-6df6a449e3cc None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:18:25.644634 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:18:25.732338 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cb1ac9-26a9-467f-ac35-6df6a449e3cc None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:18:25.765513 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53c0f10-365d-4dbf-b319-9bb5c325a3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:18:25.766144 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53c0f10-365d-4dbf-b319-9bb5c325a3ae None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:25.766416 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53c0f10-365d-4dbf-b319-9bb5c325a3ae None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:25.766685 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53c0f10-365d-4dbf-b319-9bb5c325a3ae None admin] PATH_INFO: `/v3/projects/6b3777ebebe4457ab532812b585fb939` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:25.767986 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53c0f10-365d-4dbf-b319-9bb5c325a3ae None admin] RBAC: Authorizing `identity:get_project(project_id=6b3777ebebe4457ab532812b585fb939)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:18:25.769764 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53c0f10-365d-4dbf-b319-9bb5c325a3ae None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:18:25.771392 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 575/1145] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 05:18:25 2022] GET /identity/v3/projects/6b3777ebebe4457ab532812b585fb939 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:18:25.777742 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9be6592-b9ae-4939-9ddd-26566bf89ff5 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:18:25.825630 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:18:25.875010 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9be6592-b9ae-4939-9ddd-26566bf89ff5 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:18:25.907664 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b2f686-503e-4c2d-b74b-7c56b7efe9fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:18:25.908276 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b2f686-503e-4c2d-b74b-7c56b7efe9fc None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:25.908550 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b2f686-503e-4c2d-b74b-7c56b7efe9fc None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:25.908816 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b2f686-503e-4c2d-b74b-7c56b7efe9fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:25.909524 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b2f686-503e-4c2d-b74b-7c56b7efe9fc None admin] RBAC: Adding query filter params (role.id=5b702713e40145b49e0b42abd0a5fba9, scope.project.id=6b3777ebebe4457ab532812b585fb939, user.id=23ffc16cf2b64bea933d1570af576027) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:18:25.910429 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b2f686-503e-4c2d-b74b-7c56b7efe9fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:18:25.911891 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b2f686-503e-4c2d-b74b-7c56b7efe9fc None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:18:25.917044 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 571/1146] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 05:18:25 2022] GET /identity/v3/role_assignments?user.id=23ffc16cf2b64bea933d1570af576027&scope.project.id=6b3777ebebe4457ab532812b585fb939&role.id=5b702713e40145b49e0b42abd0a5fba9 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:18:28.001439 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74753ca7-7ebb-42f4-882a-e1e4011bc1b8 None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:28.001962 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74753ca7-7ebb-42f4-882a-e1e4011bc1b8 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:28.001962 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74753ca7-7ebb-42f4-882a-e1e4011bc1b8 None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:28.003311 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 576/1147] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:18:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:18:28.008879 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab9a842-922b-48aa-b71d-d5778069fb7d None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:28.009294 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab9a842-922b-48aa-b71d-d5778069fb7d None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:28.009424 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab9a842-922b-48aa-b71d-d5778069fb7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:28.027102 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-aab9a842-922b-48aa-b71d-d5778069fb7d None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:18:28.028320 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-aab9a842-922b-48aa-b71d-d5778069fb7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:18:28.093781 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 572/1148] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:18:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 05:18:28.360332 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74753ca7-7ebb-42f4-882a-e1e4011bc1b8 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:18:28.433418 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:18:28.457948 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74753ca7-7ebb-42f4-882a-e1e4011bc1b8 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:18:28.490771 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291ef670-822f-45ee-b8d6-960c4b5a1a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:18:28.491376 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ef670-822f-45ee-b8d6-960c4b5a1a0b None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:28.491650 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ef670-822f-45ee-b8d6-960c4b5a1a0b None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:28.491949 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ef670-822f-45ee-b8d6-960c4b5a1a0b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:28.502099 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291ef670-822f-45ee-b8d6-960c4b5a1a0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:18:28.506860 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-291ef670-822f-45ee-b8d6-960c4b5a1a0b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 05:18:28.506860 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:18:28.506860 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:18:28.506860 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:18:28.506860 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:18:28.506860 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:18:28.506860 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:18:28.506860 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:18:28.506860 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:18:28.506860 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:18:28.506860 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:18:28.506860 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:18:28.506860 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:18:28.506860 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:18:28.506860 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:18:28.506860 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:18:28.507994 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:18:28.507994 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:18:28.507994 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:18:28.507994 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:18:28.507994 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:18:28.507994 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:18:28.507994 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:18:28.507994 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:18:28.507994 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:18:28.507994 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:18:28.507994 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:18:28.507994 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:18:28.507994 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:18:28.507994 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:18:28.507994 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:18:28.507994 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:18:28.509075 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:18:28.509075 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:18:28.509075 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:18:28.509075 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:18:28.509075 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:18:28.509075 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:18:28.509075 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:18:28.509075 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:18:28.509075 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:18:28.509075 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:18:28.509075 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 05:18:28.509075 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:18:28.509075 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 577/1149] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 05:18:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:18:28.513781 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab9a842-922b-48aa-b71d-d5778069fb7d None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:18:28.556086 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:18:28.610263 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab9a842-922b-48aa-b71d-d5778069fb7d None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:18:28.643619 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e8d277-b6ee-4647-aeb9-44dbbb32300c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:18:28.644243 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e8d277-b6ee-4647-aeb9-44dbbb32300c None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:28.644522 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e8d277-b6ee-4647-aeb9-44dbbb32300c None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:28.644795 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e8d277-b6ee-4647-aeb9-44dbbb32300c None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:28.645448 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e8d277-b6ee-4647-aeb9-44dbbb32300c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:18:28.645749 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e8d277-b6ee-4647-aeb9-44dbbb32300c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:18:28.647110 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e8d277-b6ee-4647-aeb9-44dbbb32300c None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:18:28.654829 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 573/1150] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 05:18:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:18:28.660996 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291ef670-822f-45ee-b8d6-960c4b5a1a0b None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:18:28.756750 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291ef670-822f-45ee-b8d6-960c4b5a1a0b None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:18:28.790513 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3db1b7-8c82-4376-be11-64c6b298aeb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:18:28.791133 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3db1b7-8c82-4376-be11-64c6b298aeb3 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:28.791406 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3db1b7-8c82-4376-be11-64c6b298aeb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:28.791697 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3db1b7-8c82-4376-be11-64c6b298aeb3 None admin] PATH_INFO: `/v3/users/23ffc16cf2b64bea933d1570af576027` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:28.792793 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3db1b7-8c82-4376-be11-64c6b298aeb3 None admin] RBAC: Authorizing `identity:get_user(user_id=23ffc16cf2b64bea933d1570af576027)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:18:28.794211 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3db1b7-8c82-4376-be11-64c6b298aeb3 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:18:28.795798 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 578/1151] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 05:18:28 2022] GET /identity/v3/users/23ffc16cf2b64bea933d1570af576027 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:18:28.801588 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e8d277-b6ee-4647-aeb9-44dbbb32300c None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:18:28.908169 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e8d277-b6ee-4647-aeb9-44dbbb32300c None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:18:28.910948 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:18:28.940601 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fad31b2-cf47-4163-b92a-6c938df5fcad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:18:28.941247 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fad31b2-cf47-4163-b92a-6c938df5fcad None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:28.941521 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fad31b2-cf47-4163-b92a-6c938df5fcad None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:28.941789 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fad31b2-cf47-4163-b92a-6c938df5fcad None admin] PATH_INFO: `/v3/projects/6b3777ebebe4457ab532812b585fb939` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:28.942874 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fad31b2-cf47-4163-b92a-6c938df5fcad None admin] RBAC: Authorizing `identity:get_project(project_id=6b3777ebebe4457ab532812b585fb939)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:18:28.944353 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fad31b2-cf47-4163-b92a-6c938df5fcad None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:18:28.945952 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 574/1152] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 05:18:28 2022] GET /identity/v3/projects/6b3777ebebe4457ab532812b585fb939 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:18:28.951921 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3db1b7-8c82-4376-be11-64c6b298aeb3 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:18:28.954731 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:18:29.050140 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3db1b7-8c82-4376-be11-64c6b298aeb3 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:18:29.083720 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bc3160-ab90-4bc0-90d8-2e579ef6ce80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:18:29.084368 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc3160-ab90-4bc0-90d8-2e579ef6ce80 None admin] REQUEST_METHOD: `PUT` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:29.084647 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc3160-ab90-4bc0-90d8-2e579ef6ce80 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:29.084920 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc3160-ab90-4bc0-90d8-2e579ef6ce80 None admin] PATH_INFO: `/v3/projects/6b3777ebebe4457ab532812b585fb939/users/23ffc16cf2b64bea933d1570af576027/roles/5b702713e40145b49e0b42abd0a5fba9` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:29.086803 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bc3160-ab90-4bc0-90d8-2e579ef6ce80 None admin] RBAC: Authorizing `identity:create_grant(project_id=6b3777ebebe4457ab532812b585fb939, user_id=23ffc16cf2b64bea933d1570af576027, role_id=5b702713e40145b49e0b42abd0a5fba9)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:18:29.088267 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bc3160-ab90-4bc0-90d8-2e579ef6ce80 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:18:29.100753 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 579/1153] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 11 05:18:28 2022] PUT /identity/v3/projects/6b3777ebebe4457ab532812b585fb939/users/23ffc16cf2b64bea933d1570af576027/roles/5b702713e40145b49e0b42abd0a5fba9 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:18:31.186537 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352b44ad-700e-45eb-bcae-b1f05d25f5bc None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:31.187111 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352b44ad-700e-45eb-bcae-b1f05d25f5bc None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:31.187111 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352b44ad-700e-45eb-bcae-b1f05d25f5bc None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:31.188499 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 575/1154] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:18:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:18:31.194501 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed356107-9dc3-4712-8c47-23c546bedd03 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:31.194933 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed356107-9dc3-4712-8c47-23c546bedd03 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:31.195031 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed356107-9dc3-4712-8c47-23c546bedd03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:31.212701 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-ed356107-9dc3-4712-8c47-23c546bedd03 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:18:31.213877 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-ed356107-9dc3-4712-8c47-23c546bedd03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:18:31.268561 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:18:31.279759 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 580/1155] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:18:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 05:18:31.552444 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352b44ad-700e-45eb-bcae-b1f05d25f5bc None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:18:31.650482 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352b44ad-700e-45eb-bcae-b1f05d25f5bc None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:18:31.684125 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bd0407-1918-417e-a9de-a788323cdfac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:18:31.684740 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd0407-1918-417e-a9de-a788323cdfac None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:31.685015 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd0407-1918-417e-a9de-a788323cdfac None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:31.685284 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd0407-1918-417e-a9de-a788323cdfac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:31.695220 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bd0407-1918-417e-a9de-a788323cdfac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:18:31.700001 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-64bd0407-1918-417e-a9de-a788323cdfac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 05:18:31.700001 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:18:31.700001 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:18:31.700001 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:18:31.700001 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:18:31.700001 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:18:31.700001 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:18:31.700001 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:18:31.700001 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:18:31.700001 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:18:31.700001 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:18:31.700001 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:18:31.700001 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:18:31.700001 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:18:31.700001 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:18:31.700001 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:18:31.701209 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:18:31.701209 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:18:31.701209 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:18:31.701209 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:18:31.701209 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:18:31.701209 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:18:31.701209 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:18:31.701209 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:18:31.701209 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:18:31.701209 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:18:31.701209 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:18:31.701209 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:18:31.701209 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:18:31.701209 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:18:31.701209 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:18:31.701209 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:18:31.702341 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:18:31.702341 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:18:31.702341 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:18:31.702341 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:18:31.702341 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:18:31.702341 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:18:31.702341 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:18:31.702341 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:18:31.702341 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:18:31.702341 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:18:31.702341 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 05:18:31.702341 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:18:31.702341 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 576/1156] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 05:18:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:18:31.707510 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed356107-9dc3-4712-8c47-23c546bedd03 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:18:31.803636 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed356107-9dc3-4712-8c47-23c546bedd03 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:18:31.837531 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfde4ce-2442-435c-878b-99aae300be31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:18:31.838142 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfde4ce-2442-435c-878b-99aae300be31 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:31.838417 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfde4ce-2442-435c-878b-99aae300be31 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:31.838684 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfde4ce-2442-435c-878b-99aae300be31 None admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:31.839339 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfde4ce-2442-435c-878b-99aae300be31 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:18:31.839638 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfde4ce-2442-435c-878b-99aae300be31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:18:31.841106 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfde4ce-2442-435c-878b-99aae300be31 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:18:31.849548 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 581/1157] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 05:18:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:18:31.857638 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bd0407-1918-417e-a9de-a788323cdfac None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:18:31.888264 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:18:31.954129 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bd0407-1918-417e-a9de-a788323cdfac None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:18:31.987009 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac2111e-bf01-4e75-b495-20b954e743c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:18:31.987614 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac2111e-bf01-4e75-b495-20b954e743c9 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:31.987941 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac2111e-bf01-4e75-b495-20b954e743c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:31.988211 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac2111e-bf01-4e75-b495-20b954e743c9 None admin] PATH_INFO: `/v3/users/23ffc16cf2b64bea933d1570af576027` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:31.989303 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac2111e-bf01-4e75-b495-20b954e743c9 None admin] RBAC: Authorizing `identity:get_user(user_id=23ffc16cf2b64bea933d1570af576027)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:18:31.990722 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac2111e-bf01-4e75-b495-20b954e743c9 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:18:31.992297 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 577/1158] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 05:18:31 2022] GET /identity/v3/users/23ffc16cf2b64bea933d1570af576027 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:18:31.998200 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfde4ce-2442-435c-878b-99aae300be31 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:18:32.051898 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:18:32.095726 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfde4ce-2442-435c-878b-99aae300be31 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:18:32.127586 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe43b43-8cdd-4988-844e-bb0b215a611c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:18:32.128209 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe43b43-8cdd-4988-844e-bb0b215a611c None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:32.129067 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe43b43-8cdd-4988-844e-bb0b215a611c None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:32.129341 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe43b43-8cdd-4988-844e-bb0b215a611c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:32.215783 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe43b43-8cdd-4988-844e-bb0b215a611c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:18:32.217236 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe43b43-8cdd-4988-844e-bb0b215a611c None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:18:32.267950 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:18:32.310758 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 582/1159] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 05:18:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 05:18:32.317164 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac2111e-bf01-4e75-b495-20b954e743c9 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:18:32.409472 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:18:32.412470 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac2111e-bf01-4e75-b495-20b954e743c9 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:18:32.445945 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8ce331-601b-4454-86b7-b3c70a9f8073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:18:32.446559 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8ce331-601b-4454-86b7-b3c70a9f8073 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:32.446835 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8ce331-601b-4454-86b7-b3c70a9f8073 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:32.447106 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8ce331-601b-4454-86b7-b3c70a9f8073 None admin] PATH_INFO: `/v3/projects/6b3777ebebe4457ab532812b585fb939` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:32.448227 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8ce331-601b-4454-86b7-b3c70a9f8073 None admin] RBAC: Authorizing `identity:get_project(project_id=6b3777ebebe4457ab532812b585fb939)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:18:32.449662 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8ce331-601b-4454-86b7-b3c70a9f8073 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:18:32.451252 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 578/1160] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 05:18:32 2022] GET /identity/v3/projects/6b3777ebebe4457ab532812b585fb939 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:18:32.457316 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe43b43-8cdd-4988-844e-bb0b215a611c None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:18:32.574005 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe43b43-8cdd-4988-844e-bb0b215a611c None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:18:32.605975 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20d3c6d-5b55-4f37-86b0-c995a3350e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:18:32.606575 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20d3c6d-5b55-4f37-86b0-c995a3350e26 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:32.606850 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20d3c6d-5b55-4f37-86b0-c995a3350e26 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:32.607117 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20d3c6d-5b55-4f37-86b0-c995a3350e26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:32.607867 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20d3c6d-5b55-4f37-86b0-c995a3350e26 None admin] RBAC: Adding query filter params (role.id=5b702713e40145b49e0b42abd0a5fba9, scope.project.id=6b3777ebebe4457ab532812b585fb939, user.id=23ffc16cf2b64bea933d1570af576027) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:18:32.608172 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20d3c6d-5b55-4f37-86b0-c995a3350e26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:18:32.609593 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20d3c6d-5b55-4f37-86b0-c995a3350e26 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:18:32.615688 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 583/1161] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 05:18:32 2022] GET /identity/v3/role_assignments?user.id=23ffc16cf2b64bea933d1570af576027&scope.project.id=6b3777ebebe4457ab532812b585fb939&role.id=5b702713e40145b49e0b42abd0a5fba9 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:18:34.732595 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29ee5ed-0319-426b-957b-c19232834376 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:34.733175 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29ee5ed-0319-426b-957b-c19232834376 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:34.733175 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29ee5ed-0319-426b-957b-c19232834376 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:34.734481 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 579/1162] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:18:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:18:34.740419 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227760a7-e242-43ec-a298-87bd36c130a0 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:34.740817 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227760a7-e242-43ec-a298-87bd36c130a0 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:34.740961 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227760a7-e242-43ec-a298-87bd36c130a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:34.759642 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-227760a7-e242-43ec-a298-87bd36c130a0 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:18:34.760850 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-227760a7-e242-43ec-a298-87bd36c130a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:18:34.773688 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:18:34.831579 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 584/1163] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:18:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 05:18:35.096670 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29ee5ed-0319-426b-957b-c19232834376 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:18:35.194976 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29ee5ed-0319-426b-957b-c19232834376 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:18:35.227078 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9158ddf2-6ca6-405d-b263-d158d9338ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:18:35.227662 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9158ddf2-6ca6-405d-b263-d158d9338ddc None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:35.227962 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9158ddf2-6ca6-405d-b263-d158d9338ddc None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:35.228227 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9158ddf2-6ca6-405d-b263-d158d9338ddc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:35.260837 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:18:35.292341 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9158ddf2-6ca6-405d-b263-d158d9338ddc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:18:35.293775 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9158ddf2-6ca6-405d-b263-d158d9338ddc None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:18:35.387631 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 580/1164] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 05:18:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 05:18:35.393496 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227760a7-e242-43ec-a298-87bd36c130a0 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:18:35.489341 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227760a7-e242-43ec-a298-87bd36c130a0 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:18:35.522371 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906b57d1-1695-4d40-9ecc-ae464b2c5794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:18:35.522993 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b57d1-1695-4d40-9ecc-ae464b2c5794 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:35.523268 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b57d1-1695-4d40-9ecc-ae464b2c5794 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:35.523540 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b57d1-1695-4d40-9ecc-ae464b2c5794 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:35.530099 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906b57d1-1695-4d40-9ecc-ae464b2c5794 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:18:35.531518 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906b57d1-1695-4d40-9ecc-ae464b2c5794 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:18:35.542576 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-906b57d1-1695-4d40-9ecc-ae464b2c5794 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 11 05:18:35.542576 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:18:35.542576 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 11 05:18:35.542576 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 11 05:18:35.542576 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 05:18:35.542576 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 05:18:35.542576 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 05:18:35.542576 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 05:18:35.542576 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 11 05:18:35.542576 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:18:35.542576 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 05:18:35.542576 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:18:35.542576 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:18:35.542576 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:18:35.542576 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:18:35.542576 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:18:35.542576 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:18:35.543792 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:18:35.543792 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:18:35.543792 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:18:35.543792 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:18:35.543792 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:18:35.543792 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:18:35.543792 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 05:18:35.543792 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 05:18:35.543792 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 05:18:35.543792 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 05:18:35.543792 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:18:35.543792 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:18:35.543792 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:18:35.543792 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:18:35.543792 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:18:35.543792 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:18:35.544651 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:18:35.544651 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:18:35.544651 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:18:35.544651 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:18:35.544651 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:18:35.544651 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:18:35.544651 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:18:35.544651 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:18:35.544651 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:18:35.544651 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:18:35.544651 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 11 05:18:35.544651 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 05:18:35.544651 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 11 05:18:35.544651 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:18:35.544651 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 585/1165] 10.222.0.16 () {56 vars in 1117 bytes} [Sun Sep 11 05:18:35 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:18:35.549379 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9158ddf2-6ca6-405d-b263-d158d9338ddc None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:18:35.612339 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:18:35.646003 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9158ddf2-6ca6-405d-b263-d158d9338ddc None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:18:35.678398 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac38ea8-4638-4057-b5bc-baf897df796b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:18:35.678986 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac38ea8-4638-4057-b5bc-baf897df796b None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:35.679260 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac38ea8-4638-4057-b5bc-baf897df796b None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:35.679527 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac38ea8-4638-4057-b5bc-baf897df796b None admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:35.680189 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac38ea8-4638-4057-b5bc-baf897df796b None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:18:35.680488 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac38ea8-4638-4057-b5bc-baf897df796b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:18:35.681840 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac38ea8-4638-4057-b5bc-baf897df796b None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:18:35.688734 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 581/1166] 10.222.0.16 () {56 vars in 1115 bytes} [Sun Sep 11 05:18:35 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:18:37.783274 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3d243-bd2c-4f0c-97cb-a06a2f4296d3 None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:37.783922 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3d243-bd2c-4f0c-97cb-a06a2f4296d3 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:37.783922 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3d243-bd2c-4f0c-97cb-a06a2f4296d3 None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:37.785787 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 586/1167] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:18:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:18:37.791246 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8294b486-b42c-4376-b9df-0e24d5a8a1fd None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:37.791622 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8294b486-b42c-4376-b9df-0e24d5a8a1fd None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:37.791831 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8294b486-b42c-4376-b9df-0e24d5a8a1fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:37.809515 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-8294b486-b42c-4376-b9df-0e24d5a8a1fd None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:18:37.810686 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-8294b486-b42c-4376-b9df-0e24d5a8a1fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:18:37.876575 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 582/1168] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:18:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 05:18:38.145767 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d3d243-bd2c-4f0c-97cb-a06a2f4296d3 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:18:38.156913 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:18:38.245918 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d3d243-bd2c-4f0c-97cb-a06a2f4296d3 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:18:38.277527 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a953195-452e-482e-a553-4621ae546d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:18:38.278119 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a953195-452e-482e-a553-4621ae546d0b None admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:38.278398 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a953195-452e-482e-a553-4621ae546d0b None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:38.278666 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a953195-452e-482e-a553-4621ae546d0b None admin] PATH_INFO: `/v3/domains` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:38.279318 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a953195-452e-482e-a553-4621ae546d0b None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:18:38.280714 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a953195-452e-482e-a553-4621ae546d0b None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:18:38.296258 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 587/1169] 10.222.0.16 () {60 vars in 1138 bytes} [Sun Sep 11 05:18:38 2022] POST /identity/v3/domains => generated 267 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:18:40.467832 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac67263-e0d1-4094-b764-c213817243c0 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:40.468387 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac67263-e0d1-4094-b764-c213817243c0 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:40.468387 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac67263-e0d1-4094-b764-c213817243c0 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:40.469708 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 583/1170] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:18:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:18:40.474958 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec0ec6-24a1-4659-bef3-c8a206d1a144 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:40.475350 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec0ec6-24a1-4659-bef3-c8a206d1a144 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:40.475508 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec0ec6-24a1-4659-bef3-c8a206d1a144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:40.493470 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-beec0ec6-24a1-4659-bef3-c8a206d1a144 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:18:40.494639 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-beec0ec6-24a1-4659-bef3-c8a206d1a144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:18:40.554571 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:18:40.561466 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 588/1171] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:18:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 05:18:40.826457 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac67263-e0d1-4094-b764-c213817243c0 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:18:40.887588 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:18:40.926426 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac67263-e0d1-4094-b764-c213817243c0 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:18:40.958666 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46331cfc-47e1-4658-a3c9-bae686f5eb73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:18:40.959277 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46331cfc-47e1-4658-a3c9-bae686f5eb73 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:40.959552 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46331cfc-47e1-4658-a3c9-bae686f5eb73 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:40.959851 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46331cfc-47e1-4658-a3c9-bae686f5eb73 None admin] PATH_INFO: `/v3/domains/07243866fdb7440488b2805bd1289ccf` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:40.969705 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46331cfc-47e1-4658-a3c9-bae686f5eb73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=07243866fdb7440488b2805bd1289ccf)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:18:40.971137 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46331cfc-47e1-4658-a3c9-bae686f5eb73 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:18:40.972803 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 584/1172] 10.222.0.16 () {56 vars in 1183 bytes} [Sun Sep 11 05:18:40 2022] GET /identity/v3/domains/07243866fdb7440488b2805bd1289ccf => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:18:40.978712 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beec0ec6-24a1-4659-bef3-c8a206d1a144 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:18:41.073656 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beec0ec6-24a1-4659-bef3-c8a206d1a144 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:18:41.106481 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77cb15f-3c3a-4b4a-b626-99e1533c1f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:18:41.107067 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77cb15f-3c3a-4b4a-b626-99e1533c1f0c None admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:41.107342 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77cb15f-3c3a-4b4a-b626-99e1533c1f0c None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:41.107609 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77cb15f-3c3a-4b4a-b626-99e1533c1f0c None admin] PATH_INFO: `/v3/projects` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:41.108276 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77cb15f-3c3a-4b4a-b626-99e1533c1f0c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:18:41.109688 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77cb15f-3c3a-4b4a-b626-99e1533c1f0c None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:18:41.135250 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 589/1173] 10.222.0.16 () {60 vars in 1141 bytes} [Sun Sep 11 05:18:40 2022] POST /identity/v3/projects => generated 361 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:18:43.314775 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8da13-6a04-4a62-99a7-703d8524fb77 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:43.315335 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8da13-6a04-4a62-99a7-703d8524fb77 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:43.315335 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8da13-6a04-4a62-99a7-703d8524fb77 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:43.317192 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 585/1174] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:18:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:18:43.322487 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b376bcfd-71ad-49b3-a79c-c0f2299fc8af None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:43.322856 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b376bcfd-71ad-49b3-a79c-c0f2299fc8af None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:43.323036 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b376bcfd-71ad-49b3-a79c-c0f2299fc8af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:43.341473 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-b376bcfd-71ad-49b3-a79c-c0f2299fc8af None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:18:43.342659 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-b376bcfd-71ad-49b3-a79c-c0f2299fc8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:18:43.387505 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:18:43.408454 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 590/1175] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:18:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 05:18:43.674990 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a8da13-6a04-4a62-99a7-703d8524fb77 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:18:43.774940 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a8da13-6a04-4a62-99a7-703d8524fb77 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:18:43.797275 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:18:43.809023 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f67284-a397-48a0-8ce6-6a03c5635c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:18:43.809646 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f67284-a397-48a0-8ce6-6a03c5635c09 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:43.809916 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f67284-a397-48a0-8ce6-6a03c5635c09 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:43.810181 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f67284-a397-48a0-8ce6-6a03c5635c09 None admin] PATH_INFO: `/v3/domains/07243866fdb7440488b2805bd1289ccf` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:43.811276 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f67284-a397-48a0-8ce6-6a03c5635c09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=07243866fdb7440488b2805bd1289ccf)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:18:43.812746 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f67284-a397-48a0-8ce6-6a03c5635c09 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:18:43.814571 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 586/1176] 10.222.0.16 () {56 vars in 1183 bytes} [Sun Sep 11 05:18:43 2022] GET /identity/v3/domains/07243866fdb7440488b2805bd1289ccf => generated 267 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:18:43.820211 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b376bcfd-71ad-49b3-a79c-c0f2299fc8af None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:18:43.915699 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b376bcfd-71ad-49b3-a79c-c0f2299fc8af None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:18:43.949679 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8771a9-2a08-4904-bbae-283c590d0833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:18:43.950217 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8771a9-2a08-4904-bbae-283c590d0833 None admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:43.950492 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8771a9-2a08-4904-bbae-283c590d0833 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:43.950763 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8771a9-2a08-4904-bbae-283c590d0833 None admin] PATH_INFO: `/v3/users` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:43.951419 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8771a9-2a08-4904-bbae-283c590d0833 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:18:43.952877 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8771a9-2a08-4904-bbae-283c590d0833 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:18:43.973953 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 591/1177] 10.222.0.16 () {60 vars in 1132 bytes} [Sun Sep 11 05:18:43 2022] POST /identity/v3/users => generated 311 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 05:18:46.136839 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6593fcf-45af-4e8c-8f9a-e6001ad97dad None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:46.137361 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6593fcf-45af-4e8c-8f9a-e6001ad97dad None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:46.137361 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6593fcf-45af-4e8c-8f9a-e6001ad97dad None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:46.138620 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 587/1178] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:18:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:18:46.143836 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a7448c-3402-4d58-993d-f36b3645ad5d None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:46.144205 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a7448c-3402-4d58-993d-f36b3645ad5d None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:46.144385 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a7448c-3402-4d58-993d-f36b3645ad5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:46.162097 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-f4a7448c-3402-4d58-993d-f36b3645ad5d None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:18:46.163276 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-f4a7448c-3402-4d58-993d-f36b3645ad5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:18:46.193473 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:18:46.230589 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 592/1179] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:18:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 05:18:46.498932 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6593fcf-45af-4e8c-8f9a-e6001ad97dad None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:18:46.597080 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6593fcf-45af-4e8c-8f9a-e6001ad97dad None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:18:46.629679 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd592c9-63c1-4975-956e-a0e6630982c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:18:46.630287 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd592c9-63c1-4975-956e-a0e6630982c5 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:46.630563 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd592c9-63c1-4975-956e-a0e6630982c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:46.630835 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd592c9-63c1-4975-956e-a0e6630982c5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:46.640513 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd592c9-63c1-4975-956e-a0e6630982c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:18:46.645322 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-2fd592c9-63c1-4975-956e-a0e6630982c5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 05:18:46.645322 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:18:46.645322 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:18:46.645322 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:18:46.645322 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:18:46.645322 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:18:46.645322 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:18:46.645322 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:18:46.645322 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:18:46.645322 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:18:46.645322 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:18:46.645322 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:18:46.645322 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:18:46.645322 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:18:46.645322 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:18:46.645322 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:18:46.646405 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:18:46.646405 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:18:46.646405 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:18:46.646405 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:18:46.646405 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:18:46.646405 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:18:46.646405 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:18:46.646405 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:18:46.646405 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:18:46.646405 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:18:46.646405 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:18:46.646405 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:18:46.646405 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:18:46.646405 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:18:46.646405 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:18:46.646405 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:18:46.647588 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:18:46.647588 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:18:46.647588 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:18:46.647588 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:18:46.647588 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:18:46.647588 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:18:46.647588 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:18:46.647588 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:18:46.647588 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:18:46.647588 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:18:46.647588 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 05:18:46.647588 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:18:46.647588 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 588/1180] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 05:18:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:18:46.652264 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a7448c-3402-4d58-993d-f36b3645ad5d None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:18:46.748002 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a7448c-3402-4d58-993d-f36b3645ad5d None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:18:46.780804 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b141fa-8b71-408c-8629-835be14ad2d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:18:46.781349 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b141fa-8b71-408c-8629-835be14ad2d5 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:46.781626 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b141fa-8b71-408c-8629-835be14ad2d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:46.781894 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b141fa-8b71-408c-8629-835be14ad2d5 None admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:46.782551 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b141fa-8b71-408c-8629-835be14ad2d5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:18:46.782853 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b141fa-8b71-408c-8629-835be14ad2d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:18:46.784808 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b141fa-8b71-408c-8629-835be14ad2d5 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:18:46.792731 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 593/1181] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 05:18:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:18:46.798489 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd592c9-63c1-4975-956e-a0e6630982c5 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:18:46.847607 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:18:46.895318 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd592c9-63c1-4975-956e-a0e6630982c5 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:18:46.928069 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f706f29-e07f-4869-a68e-ad327dc1745a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:18:46.928680 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f706f29-e07f-4869-a68e-ad327dc1745a None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:46.928956 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f706f29-e07f-4869-a68e-ad327dc1745a None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:46.929228 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f706f29-e07f-4869-a68e-ad327dc1745a None admin] PATH_INFO: `/v3/users/18826fa448b046d784e5095a3314148c` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:46.942158 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f706f29-e07f-4869-a68e-ad327dc1745a None admin] RBAC: Authorizing `identity:get_user(user_id=18826fa448b046d784e5095a3314148c)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:18:46.943599 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f706f29-e07f-4869-a68e-ad327dc1745a None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:18:46.945572 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 589/1182] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 05:18:46 2022] GET /identity/v3/users/18826fa448b046d784e5095a3314148c => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:18:46.950805 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b141fa-8b71-408c-8629-835be14ad2d5 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:18:46.978399 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:18:47.049008 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b141fa-8b71-408c-8629-835be14ad2d5 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:18:47.081443 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7529dd47-ae2b-49a6-affc-6ce788eca31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:18:47.082037 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7529dd47-ae2b-49a6-affc-6ce788eca31c None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:47.082315 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7529dd47-ae2b-49a6-affc-6ce788eca31c None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:47.082583 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7529dd47-ae2b-49a6-affc-6ce788eca31c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:47.148149 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7529dd47-ae2b-49a6-affc-6ce788eca31c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:18:47.149591 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7529dd47-ae2b-49a6-affc-6ce788eca31c None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:18:47.176802 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:18:47.245301 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 594/1183] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 05:18:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 05:18:47.251243 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f706f29-e07f-4869-a68e-ad327dc1745a None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:18:47.352660 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f706f29-e07f-4869-a68e-ad327dc1745a None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:18:47.361855 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:18:47.387501 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d169d5bf-5c89-4f72-a29d-0d20b490c207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:18:47.388153 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d169d5bf-5c89-4f72-a29d-0d20b490c207 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:47.388433 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d169d5bf-5c89-4f72-a29d-0d20b490c207 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:47.388705 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d169d5bf-5c89-4f72-a29d-0d20b490c207 None admin] PATH_INFO: `/v3/projects/912530535ce942338513c8bccc089866` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:47.389809 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d169d5bf-5c89-4f72-a29d-0d20b490c207 None admin] RBAC: Authorizing `identity:get_project(project_id=912530535ce942338513c8bccc089866)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:18:47.391244 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d169d5bf-5c89-4f72-a29d-0d20b490c207 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:18:47.392963 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 590/1184] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 05:18:47 2022] GET /identity/v3/projects/912530535ce942338513c8bccc089866 => generated 361 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:18:47.399730 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7529dd47-ae2b-49a6-affc-6ce788eca31c None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:18:47.494523 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7529dd47-ae2b-49a6-affc-6ce788eca31c None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:18:47.520028 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:18:47.528325 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcbcf86-406b-495c-9ce3-5c2ab80f3f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:18:47.528924 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcbcf86-406b-495c-9ce3-5c2ab80f3f45 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:47.529199 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcbcf86-406b-495c-9ce3-5c2ab80f3f45 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:47.529468 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcbcf86-406b-495c-9ce3-5c2ab80f3f45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:47.530187 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcbcf86-406b-495c-9ce3-5c2ab80f3f45 None admin] RBAC: Adding query filter params (role.id=5b702713e40145b49e0b42abd0a5fba9, scope.project.id=912530535ce942338513c8bccc089866, user.id=18826fa448b046d784e5095a3314148c) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:18:47.530494 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcbcf86-406b-495c-9ce3-5c2ab80f3f45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:18:47.531939 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcbcf86-406b-495c-9ce3-5c2ab80f3f45 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:18:47.538266 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 595/1185] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 05:18:47 2022] GET /identity/v3/role_assignments?user.id=18826fa448b046d784e5095a3314148c&scope.project.id=912530535ce942338513c8bccc089866&role.id=5b702713e40145b49e0b42abd0a5fba9 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:18:49.668334 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb5a341-e773-4e12-904f-ea0694a4fef8 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:49.668864 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb5a341-e773-4e12-904f-ea0694a4fef8 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:49.668864 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb5a341-e773-4e12-904f-ea0694a4fef8 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:49.670227 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 591/1186] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:18:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:18:49.676180 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c0e600-9177-47db-9b8d-360cfd47d38d None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:49.676572 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c0e600-9177-47db-9b8d-360cfd47d38d None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:49.676718 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c0e600-9177-47db-9b8d-360cfd47d38d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:49.694354 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-f5c0e600-9177-47db-9b8d-360cfd47d38d None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:18:49.695516 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-f5c0e600-9177-47db-9b8d-360cfd47d38d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:18:49.759352 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 596/1187] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:18:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 05:18:50.023336 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb5a341-e773-4e12-904f-ea0694a4fef8 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:18:50.122140 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb5a341-e773-4e12-904f-ea0694a4fef8 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:18:50.153943 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5d6b07-3dc3-4f51-8ef7-ab907b494bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:18:50.154554 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d6b07-3dc3-4f51-8ef7-ab907b494bfb None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:50.154832 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d6b07-3dc3-4f51-8ef7-ab907b494bfb None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:50.155104 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d6b07-3dc3-4f51-8ef7-ab907b494bfb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:50.165352 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5d6b07-3dc3-4f51-8ef7-ab907b494bfb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:18:50.170075 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-8b5d6b07-3dc3-4f51-8ef7-ab907b494bfb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 05:18:50.170075 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:18:50.170075 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:18:50.170075 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:18:50.170075 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:18:50.170075 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:18:50.170075 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:18:50.170075 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:18:50.170075 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:18:50.170075 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:18:50.170075 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:18:50.170075 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:18:50.170075 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:18:50.170075 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:18:50.170075 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:18:50.170075 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:18:50.171267 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:18:50.171267 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:18:50.171267 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:18:50.171267 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:18:50.171267 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:18:50.171267 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:18:50.171267 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:18:50.171267 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:18:50.171267 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:18:50.171267 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:18:50.171267 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:18:50.171267 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:18:50.171267 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:18:50.171267 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:18:50.171267 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:18:50.171267 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:18:50.172383 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:18:50.172383 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:18:50.172383 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:18:50.172383 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:18:50.172383 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:18:50.172383 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:18:50.172383 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:18:50.172383 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:18:50.172383 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:18:50.172383 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:18:50.172383 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 05:18:50.172383 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:18:50.172383 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 592/1188] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 05:18:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:18:50.177705 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c0e600-9177-47db-9b8d-360cfd47d38d None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:18:50.271812 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c0e600-9177-47db-9b8d-360cfd47d38d None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:18:50.293582 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:18:50.305896 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b45e79-9253-4fbc-8364-7816d24f4b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:18:50.306501 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b45e79-9253-4fbc-8364-7816d24f4b09 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:50.306785 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b45e79-9253-4fbc-8364-7816d24f4b09 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:50.307057 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b45e79-9253-4fbc-8364-7816d24f4b09 None admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:50.307743 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b45e79-9253-4fbc-8364-7816d24f4b09 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:18:50.308051 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b45e79-9253-4fbc-8364-7816d24f4b09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:18:50.309415 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b45e79-9253-4fbc-8364-7816d24f4b09 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:18:50.317241 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 597/1189] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 05:18:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:18:50.323050 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5d6b07-3dc3-4f51-8ef7-ab907b494bfb None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:18:50.358118 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:18:50.420643 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5d6b07-3dc3-4f51-8ef7-ab907b494bfb None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:18:50.453403 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb50cfa-64b2-4774-ac43-8d137ec7caf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:18:50.454009 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb50cfa-64b2-4774-ac43-8d137ec7caf6 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:50.454286 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb50cfa-64b2-4774-ac43-8d137ec7caf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:50.454557 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb50cfa-64b2-4774-ac43-8d137ec7caf6 None admin] PATH_INFO: `/v3/users/18826fa448b046d784e5095a3314148c` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:50.455659 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb50cfa-64b2-4774-ac43-8d137ec7caf6 None admin] RBAC: Authorizing `identity:get_user(user_id=18826fa448b046d784e5095a3314148c)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:18:50.457641 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb50cfa-64b2-4774-ac43-8d137ec7caf6 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:18:50.459177 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 593/1190] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 05:18:50 2022] GET /identity/v3/users/18826fa448b046d784e5095a3314148c => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:18:50.464840 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b45e79-9253-4fbc-8364-7816d24f4b09 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:18:50.562219 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b45e79-9253-4fbc-8364-7816d24f4b09 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:18:50.594796 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eab5e4b-037f-48ef-8078-2f8334c78319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:18:50.595408 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab5e4b-037f-48ef-8078-2f8334c78319 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:50.595703 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab5e4b-037f-48ef-8078-2f8334c78319 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:50.595988 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab5e4b-037f-48ef-8078-2f8334c78319 None admin] PATH_INFO: `/v3/projects/912530535ce942338513c8bccc089866` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:50.597159 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eab5e4b-037f-48ef-8078-2f8334c78319 None admin] RBAC: Authorizing `identity:get_project(project_id=912530535ce942338513c8bccc089866)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:18:50.598578 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eab5e4b-037f-48ef-8078-2f8334c78319 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:18:50.600219 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 598/1191] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 05:18:50 2022] GET /identity/v3/projects/912530535ce942338513c8bccc089866 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:18:50.605847 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb50cfa-64b2-4774-ac43-8d137ec7caf6 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:18:50.704075 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb50cfa-64b2-4774-ac43-8d137ec7caf6 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:18:50.706859 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:18:50.737526 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27460ff8-6ce1-41d8-b685-426cf003e91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:18:50.738177 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27460ff8-6ce1-41d8-b685-426cf003e91e None admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:50.738454 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27460ff8-6ce1-41d8-b685-426cf003e91e None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:50.738726 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27460ff8-6ce1-41d8-b685-426cf003e91e None admin] PATH_INFO: `/v3/projects/912530535ce942338513c8bccc089866/users/18826fa448b046d784e5095a3314148c/roles/5b702713e40145b49e0b42abd0a5fba9` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:50.740762 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27460ff8-6ce1-41d8-b685-426cf003e91e None admin] RBAC: Authorizing `identity:create_grant(project_id=912530535ce942338513c8bccc089866, user_id=18826fa448b046d784e5095a3314148c, role_id=5b702713e40145b49e0b42abd0a5fba9)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:18:50.742250 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27460ff8-6ce1-41d8-b685-426cf003e91e None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:18:50.755669 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 594/1192] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 11 05:18:50 2022] PUT /identity/v3/projects/912530535ce942338513c8bccc089866/users/18826fa448b046d784e5095a3314148c/roles/5b702713e40145b49e0b42abd0a5fba9 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:18:52.852890 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a8b26-8a77-4c82-8e72-cc1036e58e54 None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:52.853363 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a8b26-8a77-4c82-8e72-cc1036e58e54 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:52.853481 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a8b26-8a77-4c82-8e72-cc1036e58e54 None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:52.854768 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 599/1193] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:18:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:18:52.860037 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df6638a-2c3a-485b-8115-9fd3a50ef400 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:52.860433 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df6638a-2c3a-485b-8115-9fd3a50ef400 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:52.860593 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df6638a-2c3a-485b-8115-9fd3a50ef400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:52.879555 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-1df6638a-2c3a-485b-8115-9fd3a50ef400 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:18:52.880756 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-1df6638a-2c3a-485b-8115-9fd3a50ef400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:18:52.943496 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 595/1194] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:18:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 05:18:53.212655 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991a8b26-8a77-4c82-8e72-cc1036e58e54 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:18:53.265428 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:18:53.312321 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991a8b26-8a77-4c82-8e72-cc1036e58e54 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:18:53.343489 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e204eff9-81b6-45aa-a48b-3515f6658c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:18:53.344133 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e204eff9-81b6-45aa-a48b-3515f6658c8c None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:53.344409 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e204eff9-81b6-45aa-a48b-3515f6658c8c None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:53.344679 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e204eff9-81b6-45aa-a48b-3515f6658c8c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:53.355875 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e204eff9-81b6-45aa-a48b-3515f6658c8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:18:53.360571 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-e204eff9-81b6-45aa-a48b-3515f6658c8c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 05:18:53.360571 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:18:53.360571 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:18:53.360571 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:18:53.360571 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:18:53.360571 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:18:53.360571 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:18:53.360571 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:18:53.360571 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:18:53.360571 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:18:53.360571 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:18:53.360571 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:18:53.360571 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:18:53.360571 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:18:53.360571 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:18:53.360571 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:18:53.361631 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:18:53.361631 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:18:53.361631 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:18:53.361631 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:18:53.361631 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:18:53.361631 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:18:53.361631 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:18:53.361631 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:18:53.361631 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:18:53.361631 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:18:53.361631 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:18:53.361631 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:18:53.361631 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:18:53.361631 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:18:53.361631 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:18:53.361631 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:18:53.363261 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:18:53.363261 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:18:53.363261 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:18:53.363261 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:18:53.363261 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:18:53.363261 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:18:53.363261 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:18:53.363261 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:18:53.363261 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:18:53.363261 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:18:53.363261 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 05:18:53.363261 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:18:53.363261 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 600/1195] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 05:18:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:18:53.368493 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df6638a-2c3a-485b-8115-9fd3a50ef400 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:18:53.457315 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:18:53.464747 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df6638a-2c3a-485b-8115-9fd3a50ef400 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:18:53.497774 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd8af9b-a768-4d7d-82fe-0aa753a682ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:18:53.498363 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd8af9b-a768-4d7d-82fe-0aa753a682ff None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:53.498640 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd8af9b-a768-4d7d-82fe-0aa753a682ff None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:53.498910 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd8af9b-a768-4d7d-82fe-0aa753a682ff None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:53.499563 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd8af9b-a768-4d7d-82fe-0aa753a682ff None admin] RBAC: Adding query filter params (name=admin) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:18:53.499892 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd8af9b-a768-4d7d-82fe-0aa753a682ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:18:53.501261 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd8af9b-a768-4d7d-82fe-0aa753a682ff None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:18:53.509006 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 596/1196] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 05:18:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:18:53.514739 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e204eff9-81b6-45aa-a48b-3515f6658c8c None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:18:53.610900 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e204eff9-81b6-45aa-a48b-3515f6658c8c None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:18:53.623263 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:18:53.644213 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1568724d-4f2c-4a48-a6f4-01fb74537ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:18:53.644835 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1568724d-4f2c-4a48-a6f4-01fb74537ee8 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:53.645106 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1568724d-4f2c-4a48-a6f4-01fb74537ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:53.645371 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1568724d-4f2c-4a48-a6f4-01fb74537ee8 None admin] PATH_INFO: `/v3/users/18826fa448b046d784e5095a3314148c` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:53.646467 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1568724d-4f2c-4a48-a6f4-01fb74537ee8 None admin] RBAC: Authorizing `identity:get_user(user_id=18826fa448b046d784e5095a3314148c)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:18:53.647918 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1568724d-4f2c-4a48-a6f4-01fb74537ee8 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:18:53.649473 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 601/1197] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 05:18:53 2022] GET /identity/v3/users/18826fa448b046d784e5095a3314148c => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:18:53.655246 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd8af9b-a768-4d7d-82fe-0aa753a682ff None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:18:53.751492 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd8af9b-a768-4d7d-82fe-0aa753a682ff None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:18:53.784640 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df5111b-5b1c-4b73-a62d-78e2da99c0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:18:53.785237 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df5111b-5b1c-4b73-a62d-78e2da99c0c9 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:53.785511 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df5111b-5b1c-4b73-a62d-78e2da99c0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:53.785781 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df5111b-5b1c-4b73-a62d-78e2da99c0c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:53.809224 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:18:53.850733 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df5111b-5b1c-4b73-a62d-78e2da99c0c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:18:53.852210 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df5111b-5b1c-4b73-a62d-78e2da99c0c9 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:18:53.946844 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 597/1198] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 05:18:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 05:18:53.952900 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1568724d-4f2c-4a48-a6f4-01fb74537ee8 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:18:54.048265 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1568724d-4f2c-4a48-a6f4-01fb74537ee8 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:18:54.079864 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693436ea-bf17-4e7c-9560-1c1c2f682b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:18:54.080475 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693436ea-bf17-4e7c-9560-1c1c2f682b0b None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:54.081334 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693436ea-bf17-4e7c-9560-1c1c2f682b0b None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:54.081602 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693436ea-bf17-4e7c-9560-1c1c2f682b0b None admin] PATH_INFO: `/v3/projects/912530535ce942338513c8bccc089866` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:54.082762 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693436ea-bf17-4e7c-9560-1c1c2f682b0b None admin] RBAC: Authorizing `identity:get_project(project_id=912530535ce942338513c8bccc089866)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:18:54.084210 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693436ea-bf17-4e7c-9560-1c1c2f682b0b None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:18:54.085814 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 602/1199] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 05:18:53 2022] GET /identity/v3/projects/912530535ce942338513c8bccc089866 => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:18:54.091821 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df5111b-5b1c-4b73-a62d-78e2da99c0c9 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:18:54.146060 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:18:54.188433 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df5111b-5b1c-4b73-a62d-78e2da99c0c9 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:18:54.221277 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a23bc1-cdf4-4e65-b75b-736599d09d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:18:54.221865 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a23bc1-cdf4-4e65-b75b-736599d09d4f None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:18:54.222142 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a23bc1-cdf4-4e65-b75b-736599d09d4f None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:18:54.222413 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a23bc1-cdf4-4e65-b75b-736599d09d4f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:18:54.223129 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a23bc1-cdf4-4e65-b75b-736599d09d4f None admin] RBAC: Adding query filter params (role.id=5b702713e40145b49e0b42abd0a5fba9, scope.project.id=912530535ce942338513c8bccc089866, user.id=18826fa448b046d784e5095a3314148c) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:18:54.223438 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a23bc1-cdf4-4e65-b75b-736599d09d4f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:18:54.224903 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a23bc1-cdf4-4e65-b75b-736599d09d4f None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:18:54.230449 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 598/1200] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 05:18:54 2022] GET /identity/v3/role_assignments?user.id=18826fa448b046d784e5095a3314148c&scope.project.id=912530535ce942338513c8bccc089866&role.id=5b702713e40145b49e0b42abd0a5fba9 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:19:04.075980 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=76 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:19:04.227938 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=40 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:19:50.080469 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff6e99-f163-4637-a537-eef2de460d7c None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:19:50.080469 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff6e99-f163-4637-a537-eef2de460d7c None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:19:50.080469 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff6e99-f163-4637-a537-eef2de460d7c None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:19:50.080469 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 603/1201] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:19:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:19:50.088042 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a40915b-f905-4e97-af04-e4b1b1e62191 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:19:50.088929 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a40915b-f905-4e97-af04-e4b1b1e62191 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:19:50.088929 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a40915b-f905-4e97-af04-e4b1b1e62191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:19:50.115873 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-0a40915b-f905-4e97-af04-e4b1b1e62191 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:19:50.117611 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-0a40915b-f905-4e97-af04-e4b1b1e62191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:19:50.218247 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 599/1202] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:19:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 05:19:50.502135 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ff6e99-f163-4637-a537-eef2de460d7c None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:19:50.630400 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ff6e99-f163-4637-a537-eef2de460d7c None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:19:50.673861 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b5391f-8f0f-450f-8786-a4431e9d5873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:19:50.674556 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b5391f-8f0f-450f-8786-a4431e9d5873 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:19:50.674839 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b5391f-8f0f-450f-8786-a4431e9d5873 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:19:50.675114 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b5391f-8f0f-450f-8786-a4431e9d5873 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:19:50.690359 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b5391f-8f0f-450f-8786-a4431e9d5873 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:19:50.691869 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b5391f-8f0f-450f-8786-a4431e9d5873 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:19:50.710034 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-70b5391f-8f0f-450f-8786-a4431e9d5873 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:19:50.710034 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:19:50.710034 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:19:50.710034 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:19:50.710034 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:19:50.710034 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:19:50.710034 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:19:50.710034 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:19:50.710034 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:19:50.710034 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:19:50.710034 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:19:50.710034 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:19:50.710034 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 05:19:50.710034 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 05:19:50.710034 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 05:19:50.710034 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 05:19:50.711105 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:19:50.711105 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:19:50.711105 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:19:50.711105 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:19:50.711105 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:19:50.711105 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:19:50.711105 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:19:50.711105 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:19:50.711105 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:19:50.711105 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:19:50.711105 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:19:50.711105 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:19:50.711105 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:19:50.711105 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:19:50.711105 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:19:50.711105 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:19:50.711105 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 05:19:50.712908 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 05:19:50.712908 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:19:50.712908 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:19:50.712908 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 604/1203] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:19:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:19:50.718205 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a40915b-f905-4e97-af04-e4b1b1e62191 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:19:50.863038 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a40915b-f905-4e97-af04-e4b1b1e62191 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:19:50.908647 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:19:50.915921 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787a44ff-cab3-4c63-b225-c490ef46211f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:19:50.916652 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a44ff-cab3-4c63-b225-c490ef46211f None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:19:50.916931 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a44ff-cab3-4c63-b225-c490ef46211f None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:19:50.917206 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a44ff-cab3-4c63-b225-c490ef46211f None admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:19:50.917851 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787a44ff-cab3-4c63-b225-c490ef46211f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:19:50.918195 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787a44ff-cab3-4c63-b225-c490ef46211f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:19:50.919669 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787a44ff-cab3-4c63-b225-c490ef46211f None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:19:50.937971 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 600/1204] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 05:19:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:19:50.939575 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b5391f-8f0f-450f-8786-a4431e9d5873 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:19:51.006126 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:19:51.067344 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b5391f-8f0f-450f-8786-a4431e9d5873 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:19:51.108131 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720fbb92-e152-417a-baaf-d90461d7de89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:19:51.110012 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720fbb92-e152-417a-baaf-d90461d7de89 None admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:19:51.110298 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720fbb92-e152-417a-baaf-d90461d7de89 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:19:51.110560 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720fbb92-e152-417a-baaf-d90461d7de89 None admin] PATH_INFO: `/v3/users` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:19:51.111207 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720fbb92-e152-417a-baaf-d90461d7de89 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:19:51.112667 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720fbb92-e152-417a-baaf-d90461d7de89 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:19:51.135072 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 605/1205] 10.222.0.16 () {60 vars in 1132 bytes} [Sun Sep 11 05:19:50 2022] POST /identity/v3/users => generated 251 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:19:53.570023 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a9c94-31d3-40aa-bc93-3f37615c389a None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:19:53.570596 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a9c94-31d3-40aa-bc93-3f37615c389a None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:19:53.570596 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a9c94-31d3-40aa-bc93-3f37615c389a None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:19:53.572182 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 601/1206] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:19:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:19:53.577665 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f8f6f-de05-4d8f-b4d4-603f714da97d None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:19:53.578166 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f8f6f-de05-4d8f-b4d4-603f714da97d None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:19:53.578248 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f8f6f-de05-4d8f-b4d4-603f714da97d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:19:53.599315 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-407f8f6f-de05-4d8f-b4d4-603f714da97d None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:19:53.600712 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-407f8f6f-de05-4d8f-b4d4-603f714da97d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:19:53.683935 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 606/1207] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:19:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 05:19:53.993015 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6a9c94-31d3-40aa-bc93-3f37615c389a None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:19:54.124282 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6a9c94-31d3-40aa-bc93-3f37615c389a None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:19:54.167794 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c7c11b-c510-4fb1-8b4a-843e3d47b9e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:19:54.169002 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c7c11b-c510-4fb1-8b4a-843e3d47b9e4 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:19:54.169456 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c7c11b-c510-4fb1-8b4a-843e3d47b9e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:19:54.169696 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c7c11b-c510-4fb1-8b4a-843e3d47b9e4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:19:54.182543 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c7c11b-c510-4fb1-8b4a-843e3d47b9e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:19:54.188652 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-44c7c11b-c510-4fb1-8b4a-843e3d47b9e4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 05:19:54.188652 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:19:54.188652 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:19:54.188652 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:19:54.188652 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:19:54.188652 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:19:54.188652 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:19:54.188652 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:19:54.188652 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:19:54.188652 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:19:54.188652 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:19:54.188652 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:19:54.188652 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:19:54.188652 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:19:54.188652 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:19:54.188652 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:19:54.189734 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:19:54.189734 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:19:54.189734 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:19:54.189734 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:19:54.189734 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:19:54.189734 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:19:54.189734 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:19:54.189734 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:19:54.189734 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:19:54.189734 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:19:54.189734 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:19:54.189734 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:19:54.189734 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:19:54.189734 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:19:54.189734 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:19:54.189734 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:19:54.192827 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:19:54.192827 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:19:54.192827 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:19:54.192827 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:19:54.192827 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:19:54.192827 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:19:54.192827 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:19:54.192827 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:19:54.192827 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:19:54.192827 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:19:54.192827 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 05:19:54.192827 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:19:54.192827 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 602/1208] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 11 05:19:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:19:54.196574 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407f8f6f-de05-4d8f-b4d4-603f714da97d None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:19:54.247585 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:19:54.322738 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407f8f6f-de05-4d8f-b4d4-603f714da97d None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:19:54.365858 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906442de-62d3-4578-a370-c15df886b780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:19:54.366501 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906442de-62d3-4578-a370-c15df886b780 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:19:54.366920 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906442de-62d3-4578-a370-c15df886b780 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:19:54.367482 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906442de-62d3-4578-a370-c15df886b780 None admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:19:54.368203 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906442de-62d3-4578-a370-c15df886b780 None admin] RBAC: Adding query filter params (name=service) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:19:54.368511 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906442de-62d3-4578-a370-c15df886b780 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:19:54.370221 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906442de-62d3-4578-a370-c15df886b780 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:19:54.380226 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 607/1209] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 11 05:19:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:19:54.386494 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c7c11b-c510-4fb1-8b4a-843e3d47b9e4 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:19:54.446977 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:19:54.507394 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c7c11b-c510-4fb1-8b4a-843e3d47b9e4 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:19:54.569254 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9631a077-4bba-4951-b1d1-e1073f4d1425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:19:54.569880 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9631a077-4bba-4951-b1d1-e1073f4d1425 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:19:54.570153 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9631a077-4bba-4951-b1d1-e1073f4d1425 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:19:54.570702 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9631a077-4bba-4951-b1d1-e1073f4d1425 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:19:54.582264 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9631a077-4bba-4951-b1d1-e1073f4d1425 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:19:54.584001 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9631a077-4bba-4951-b1d1-e1073f4d1425 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:19:54.599319 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-9631a077-4bba-4951-b1d1-e1073f4d1425 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:19:54.599319 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:19:54.599319 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:19:54.599319 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:19:54.599319 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:19:54.599319 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:19:54.599319 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:19:54.599319 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:19:54.599319 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:19:54.599319 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:19:54.599319 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:19:54.599319 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:19:54.599319 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 05:19:54.599319 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 05:19:54.599319 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 05:19:54.599319 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 05:19:54.600402 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:19:54.600402 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:19:54.600402 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:19:54.600402 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:19:54.600402 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:19:54.600402 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:19:54.600402 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:19:54.600402 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:19:54.600402 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:19:54.600402 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:19:54.600402 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:19:54.600402 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:19:54.600402 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:19:54.600402 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:19:54.600402 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:19:54.600402 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:19:54.600402 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 05:19:54.608617 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 05:19:54.608617 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:19:54.608617 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:19:54.608617 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 603/1210] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:19:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:19:54.608911 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906442de-62d3-4578-a370-c15df886b780 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:19:54.727348 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:19:54.735637 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906442de-62d3-4578-a370-c15df886b780 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:19:54.794024 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b52a0a-0409-4dcb-9a6e-86f377e709b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:19:54.795333 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b52a0a-0409-4dcb-9a6e-86f377e709b1 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:19:54.795333 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b52a0a-0409-4dcb-9a6e-86f377e709b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:19:54.795333 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b52a0a-0409-4dcb-9a6e-86f377e709b1 None admin] PATH_INFO: `/v3/domains` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:19:54.795813 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b52a0a-0409-4dcb-9a6e-86f377e709b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:19:54.796117 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b52a0a-0409-4dcb-9a6e-86f377e709b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:19:54.797525 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b52a0a-0409-4dcb-9a6e-86f377e709b1 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:19:54.811498 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 608/1211] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 05:19:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:19:54.817740 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9631a077-4bba-4951-b1d1-e1073f4d1425 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:19:54.934348 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9631a077-4bba-4951-b1d1-e1073f4d1425 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:19:54.936141 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:19:54.973101 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51675a12-6083-47db-95d8-f64841fcbfa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:19:54.973737 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51675a12-6083-47db-95d8-f64841fcbfa1 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:19:54.974020 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51675a12-6083-47db-95d8-f64841fcbfa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:19:54.974294 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51675a12-6083-47db-95d8-f64841fcbfa1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:19:54.981926 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51675a12-6083-47db-95d8-f64841fcbfa1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:19:54.983389 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51675a12-6083-47db-95d8-f64841fcbfa1 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:19:54.995161 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-51675a12-6083-47db-95d8-f64841fcbfa1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 11 05:19:54.995161 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:19:54.995161 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:19:54.995161 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:19:54.995161 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:19:54.995161 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:19:54.995161 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:19:54.995161 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:19:54.995161 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:19:54.995161 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:19:54.995161 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:19:54.995161 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:19:54.995161 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 05:19:54.995161 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 05:19:54.995161 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 05:19:54.995161 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 05:19:54.996352 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:19:54.996352 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:19:54.996352 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 05:19:54.996352 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 05:19:54.996352 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 05:19:54.996352 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 05:19:54.996352 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:19:54.996352 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:19:54.996352 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:19:54.996352 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:19:54.996352 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:19:54.996352 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:19:54.996352 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:19:54.996352 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:19:54.996352 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:19:54.996352 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:19:54.996352 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:19:54.996352 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:19:54.997342 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:19:54.997342 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:19:54.997342 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 05:19:54.997342 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 05:19:54.997342 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 05:19:54.997342 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 05:19:54.997342 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 05:19:54.997342 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 05:19:54.997342 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 11 05:19:54.997342 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:19:55.003714 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 604/1212] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:19:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 05:19:55.003873 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b52a0a-0409-4dcb-9a6e-86f377e709b1 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:19:55.124940 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b52a0a-0409-4dcb-9a6e-86f377e709b1 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:19:55.169204 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200802a7-48dd-4530-8f0a-87a5c9343b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:19:55.169957 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200802a7-48dd-4530-8f0a-87a5c9343b05 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:19:55.170242 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200802a7-48dd-4530-8f0a-87a5c9343b05 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:19:55.170532 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200802a7-48dd-4530-8f0a-87a5c9343b05 None admin] PATH_INFO: `/v3/users` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:19:55.171374 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200802a7-48dd-4530-8f0a-87a5c9343b05 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:19:55.172123 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200802a7-48dd-4530-8f0a-87a5c9343b05 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:19:55.174303 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200802a7-48dd-4530-8f0a-87a5c9343b05 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:19:55.204741 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 609/1213] 10.222.0.16 () {56 vars in 1143 bytes} [Sun Sep 11 05:19:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:19:55.210211 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51675a12-6083-47db-95d8-f64841fcbfa1 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:19:55.336708 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51675a12-6083-47db-95d8-f64841fcbfa1 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:19:55.376885 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1a1b5b-6a0c-4676-9757-0ad939a23783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:19:55.377422 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a1b5b-6a0c-4676-9757-0ad939a23783 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:19:55.377720 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a1b5b-6a0c-4676-9757-0ad939a23783 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:19:55.377975 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a1b5b-6a0c-4676-9757-0ad939a23783 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:19:55.410812 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:19:55.459101 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1a1b5b-6a0c-4676-9757-0ad939a23783 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:19:55.461154 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1a1b5b-6a0c-4676-9757-0ad939a23783 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:19:55.585622 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 605/1214] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 05:19:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 05:19:55.587793 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200802a7-48dd-4530-8f0a-87a5c9343b05 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:19:55.610927 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:19:55.708985 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200802a7-48dd-4530-8f0a-87a5c9343b05 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:19:55.748308 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6434ef47-bc53-48d2-8b59-8abf29b770dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:19:55.748948 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6434ef47-bc53-48d2-8b59-8abf29b770dc None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:19:55.749282 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6434ef47-bc53-48d2-8b59-8abf29b770dc None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:19:55.749552 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6434ef47-bc53-48d2-8b59-8abf29b770dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:19:55.763611 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6434ef47-bc53-48d2-8b59-8abf29b770dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:19:55.765106 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6434ef47-bc53-48d2-8b59-8abf29b770dc None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:19:55.780259 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-6434ef47-bc53-48d2-8b59-8abf29b770dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:19:55.780259 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:19:55.780259 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:19:55.780259 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:19:55.780259 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:19:55.780259 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:19:55.780259 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:19:55.780259 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:19:55.780259 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:19:55.780259 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:19:55.780259 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:19:55.780259 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:19:55.780259 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 05:19:55.780259 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 05:19:55.780259 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 05:19:55.780259 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 05:19:55.781705 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:19:55.781705 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:19:55.781705 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:19:55.781705 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:19:55.781705 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:19:55.781705 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:19:55.781705 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:19:55.781705 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:19:55.781705 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:19:55.781705 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:19:55.781705 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:19:55.781705 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:19:55.781705 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:19:55.781705 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:19:55.781705 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:19:55.781705 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:19:55.781705 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 05:19:55.782989 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 05:19:55.782989 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:19:55.782989 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:19:55.782989 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 610/1215] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:19:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:19:55.790457 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1a1b5b-6a0c-4676-9757-0ad939a23783 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:19:55.879858 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:19:55.930249 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1a1b5b-6a0c-4676-9757-0ad939a23783 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:19:55.968276 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2dbcce-875c-4e6c-b45b-8cd1e185f973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:19:55.968865 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2dbcce-875c-4e6c-b45b-8cd1e185f973 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:19:55.969190 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2dbcce-875c-4e6c-b45b-8cd1e185f973 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:19:55.970021 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2dbcce-875c-4e6c-b45b-8cd1e185f973 None admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:19:55.970682 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2dbcce-875c-4e6c-b45b-8cd1e185f973 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:19:55.970986 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2dbcce-875c-4e6c-b45b-8cd1e185f973 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:19:55.972404 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2dbcce-875c-4e6c-b45b-8cd1e185f973 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:19:55.984132 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 606/1216] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 05:19:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:19:55.990453 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6434ef47-bc53-48d2-8b59-8abf29b770dc None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:19:56.065840 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:19:56.104244 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6434ef47-bc53-48d2-8b59-8abf29b770dc None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:19:56.148148 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6913ba-2bde-4758-b2da-116053517884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:19:56.148783 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6913ba-2bde-4758-b2da-116053517884 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:19:56.149065 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6913ba-2bde-4758-b2da-116053517884 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:19:56.149339 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6913ba-2bde-4758-b2da-116053517884 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:19:56.156983 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6913ba-2bde-4758-b2da-116053517884 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:19:56.159042 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6913ba-2bde-4758-b2da-116053517884 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:19:56.172891 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-ce6913ba-2bde-4758-b2da-116053517884 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 05:19:56.172891 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:19:56.172891 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:19:56.172891 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:19:56.172891 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:19:56.172891 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:19:56.172891 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:19:56.172891 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:19:56.172891 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:19:56.172891 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:19:56.172891 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:19:56.172891 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:19:56.172891 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 05:19:56.172891 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 05:19:56.172891 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 05:19:56.174032 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 05:19:56.174032 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:19:56.174032 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:19:56.174032 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:19:56.174032 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:19:56.174032 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:19:56.174032 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:19:56.174032 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:19:56.174032 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:19:56.174032 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:19:56.174032 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:19:56.174032 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:19:56.174032 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:19:56.174032 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:19:56.174032 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:19:56.174032 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:19:56.174032 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:19:56.175058 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 05:19:56.175058 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 05:19:56.175058 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 05:19:56.175058 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 05:19:56.175058 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 05:19:56.175058 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 05:19:56.175058 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 05:19:56.175058 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:19:56.175058 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 611/1217] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 05:19:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:19:56.180973 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2dbcce-875c-4e6c-b45b-8cd1e185f973 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:19:56.296198 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2dbcce-875c-4e6c-b45b-8cd1e185f973 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:19:56.321750 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:19:56.334534 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dd5a36-430b-47e2-bba8-3061ea6d4e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:19:56.335150 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dd5a36-430b-47e2-bba8-3061ea6d4e41 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:19:56.335428 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dd5a36-430b-47e2-bba8-3061ea6d4e41 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:19:56.335726 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dd5a36-430b-47e2-bba8-3061ea6d4e41 None admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:19:56.336413 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dd5a36-430b-47e2-bba8-3061ea6d4e41 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:19:56.336722 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dd5a36-430b-47e2-bba8-3061ea6d4e41 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:19:56.338166 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dd5a36-430b-47e2-bba8-3061ea6d4e41 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:19:56.350916 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 607/1218] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 05:19:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:19:56.357944 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6913ba-2bde-4758-b2da-116053517884 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:19:56.462995 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6913ba-2bde-4758-b2da-116053517884 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:19:56.492917 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:19:56.499744 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc126ba-c6bd-4733-a42e-a0dedc5e57a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:19:56.500355 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc126ba-c6bd-4733-a42e-a0dedc5e57a6 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:19:56.500630 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc126ba-c6bd-4733-a42e-a0dedc5e57a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:19:56.500896 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc126ba-c6bd-4733-a42e-a0dedc5e57a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:19:56.501853 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc126ba-c6bd-4733-a42e-a0dedc5e57a6 None admin] RBAC: Adding query filter params (role.id=82bd224e8afc480782a85b833a2aa03e, scope.project.id=61ffb079d9e1437084945554bcc0747b, user.id=72e1d7dd79ff43e7b585b5090762465f) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:19:56.502157 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc126ba-c6bd-4733-a42e-a0dedc5e57a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:19:56.503619 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc126ba-c6bd-4733-a42e-a0dedc5e57a6 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:19:56.510059 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 612/1219] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 05:19:56 2022] GET /identity/v3/role_assignments?user.id=72e1d7dd79ff43e7b585b5090762465f&scope.project.id=61ffb079d9e1437084945554bcc0747b&role.id=82bd224e8afc480782a85b833a2aa03e => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:19:58.637739 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9828bc3d-a3e6-4245-ab39-42e05d2899e3 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:19:58.638540 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9828bc3d-a3e6-4245-ab39-42e05d2899e3 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:19:58.638540 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9828bc3d-a3e6-4245-ab39-42e05d2899e3 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:19:58.639620 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 608/1220] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:19:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:19:58.646041 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64053a5-9d3f-4873-90ee-92a11d99a93c None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:19:58.646497 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64053a5-9d3f-4873-90ee-92a11d99a93c None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:19:58.646857 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64053a5-9d3f-4873-90ee-92a11d99a93c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:19:58.668524 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-f64053a5-9d3f-4873-90ee-92a11d99a93c None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:19:58.669753 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-f64053a5-9d3f-4873-90ee-92a11d99a93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:19:58.742421 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 613/1221] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:19:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 05:19:59.013355 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9828bc3d-a3e6-4245-ab39-42e05d2899e3 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:19:59.131511 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9828bc3d-a3e6-4245-ab39-42e05d2899e3 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:19:59.174736 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8062aa4-bf8d-4576-beb1-f12095672e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:19:59.175611 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8062aa4-bf8d-4576-beb1-f12095672e2f None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:19:59.175986 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8062aa4-bf8d-4576-beb1-f12095672e2f None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:19:59.176451 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8062aa4-bf8d-4576-beb1-f12095672e2f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:19:59.189290 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8062aa4-bf8d-4576-beb1-f12095672e2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:19:59.194424 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-e8062aa4-bf8d-4576-beb1-f12095672e2f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 05:19:59.194424 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:19:59.194424 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:19:59.194424 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:19:59.194424 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:19:59.194424 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:19:59.194424 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:19:59.194424 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:19:59.194424 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:19:59.194424 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:19:59.194424 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:19:59.194424 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:19:59.194424 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:19:59.194424 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:19:59.194424 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:19:59.194424 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:19:59.195849 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:19:59.195849 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:19:59.195849 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:19:59.195849 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:19:59.195849 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:19:59.195849 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:19:59.195849 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:19:59.195849 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:19:59.195849 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:19:59.195849 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:19:59.195849 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:19:59.195849 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:19:59.195849 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:19:59.195849 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:19:59.195849 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:19:59.195849 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:19:59.197242 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:19:59.197242 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:19:59.197242 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:19:59.197242 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:19:59.197242 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:19:59.197242 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:19:59.197242 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:19:59.197242 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:19:59.197242 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:19:59.197242 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:19:59.197242 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 05:19:59.197242 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:19:59.197242 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 609/1222] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 11 05:19:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:19:59.202287 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64053a5-9d3f-4873-90ee-92a11d99a93c None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:19:59.319277 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64053a5-9d3f-4873-90ee-92a11d99a93c None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:19:59.346465 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:19:59.358197 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74f2a9f-c5fe-4e34-bda2-b16926b6bcf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:19:59.358810 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f2a9f-c5fe-4e34-bda2-b16926b6bcf4 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:19:59.359742 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f2a9f-c5fe-4e34-bda2-b16926b6bcf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:19:59.359951 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f2a9f-c5fe-4e34-bda2-b16926b6bcf4 None admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:19:59.360674 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74f2a9f-c5fe-4e34-bda2-b16926b6bcf4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:19:59.360941 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74f2a9f-c5fe-4e34-bda2-b16926b6bcf4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:19:59.362316 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74f2a9f-c5fe-4e34-bda2-b16926b6bcf4 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:19:59.370868 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 614/1223] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 11 05:19:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:19:59.376709 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8062aa4-bf8d-4576-beb1-f12095672e2f None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:19:59.425377 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:19:59.482934 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8062aa4-bf8d-4576-beb1-f12095672e2f None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:19:59.523042 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682b70fe-a4db-4784-9389-021e579ac497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:19:59.523789 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682b70fe-a4db-4784-9389-021e579ac497 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:19:59.524110 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682b70fe-a4db-4784-9389-021e579ac497 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:19:59.524434 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682b70fe-a4db-4784-9389-021e579ac497 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:19:59.537432 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682b70fe-a4db-4784-9389-021e579ac497 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:19:59.539071 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682b70fe-a4db-4784-9389-021e579ac497 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:19:59.555322 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-682b70fe-a4db-4784-9389-021e579ac497 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:19:59.555322 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:19:59.555322 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:19:59.555322 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:19:59.555322 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:19:59.555322 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:19:59.555322 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:19:59.555322 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:19:59.555322 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:19:59.555322 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:19:59.555322 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:19:59.555322 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:19:59.555322 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 05:19:59.555322 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 05:19:59.555322 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 05:19:59.555322 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 05:19:59.556986 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:19:59.556986 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:19:59.556986 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:19:59.556986 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:19:59.556986 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:19:59.556986 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:19:59.556986 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:19:59.556986 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:19:59.556986 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:19:59.556986 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:19:59.556986 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:19:59.556986 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:19:59.556986 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:19:59.556986 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:19:59.556986 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:19:59.556986 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:19:59.556986 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 05:19:59.558232 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 05:19:59.558232 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:19:59.558232 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:19:59.558232 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 610/1224] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:19:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:19:59.562776 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74f2a9f-c5fe-4e34-bda2-b16926b6bcf4 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:19:59.676189 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74f2a9f-c5fe-4e34-bda2-b16926b6bcf4 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:19:59.713066 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfecb148-6228-4b46-8d28-56d0dd5d64a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:19:59.713662 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfecb148-6228-4b46-8d28-56d0dd5d64a9 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:19:59.713940 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfecb148-6228-4b46-8d28-56d0dd5d64a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:19:59.714522 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfecb148-6228-4b46-8d28-56d0dd5d64a9 None admin] PATH_INFO: `/v3/domains` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:19:59.715196 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfecb148-6228-4b46-8d28-56d0dd5d64a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:19:59.715501 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfecb148-6228-4b46-8d28-56d0dd5d64a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:19:59.716899 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfecb148-6228-4b46-8d28-56d0dd5d64a9 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:19:59.730225 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 615/1225] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 05:19:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:19:59.737660 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682b70fe-a4db-4784-9389-021e579ac497 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:19:59.840408 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:19:59.850611 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682b70fe-a4db-4784-9389-021e579ac497 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:19:59.891342 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6370db6e-e9c2-40d3-8d9a-32f2e70575a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:19:59.892074 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6370db6e-e9c2-40d3-8d9a-32f2e70575a2 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:19:59.892414 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6370db6e-e9c2-40d3-8d9a-32f2e70575a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:19:59.892762 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6370db6e-e9c2-40d3-8d9a-32f2e70575a2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:19:59.900733 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6370db6e-e9c2-40d3-8d9a-32f2e70575a2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:19:59.902173 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6370db6e-e9c2-40d3-8d9a-32f2e70575a2 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:19:59.914638 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-6370db6e-e9c2-40d3-8d9a-32f2e70575a2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 11 05:19:59.914638 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:19:59.914638 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:19:59.914638 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:19:59.914638 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:19:59.914638 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:19:59.914638 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:19:59.914638 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:19:59.914638 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:19:59.914638 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:19:59.914638 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:19:59.914638 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:19:59.914638 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 05:19:59.914638 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 05:19:59.914638 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 05:19:59.914638 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 05:19:59.915761 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:19:59.915761 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:19:59.915761 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 05:19:59.915761 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 05:19:59.915761 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 05:19:59.915761 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 05:19:59.915761 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:19:59.915761 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:19:59.915761 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:19:59.915761 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:19:59.915761 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:19:59.915761 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:19:59.915761 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:19:59.915761 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:19:59.915761 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:19:59.915761 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:19:59.915761 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:19:59.915761 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:19:59.920738 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:19:59.920738 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:19:59.920738 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 05:19:59.920738 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 05:19:59.920738 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 05:19:59.920738 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 05:19:59.920738 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 05:19:59.920738 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 05:19:59.920738 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 11 05:19:59.920738 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:19:59.920738 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 611/1226] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:19:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:19:59.923803 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfecb148-6228-4b46-8d28-56d0dd5d64a9 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:19:59.967262 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:20:00.032235 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfecb148-6228-4b46-8d28-56d0dd5d64a9 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:20:00.070973 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350bc116-5ca1-4e39-9f47-49f4b8259302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:20:00.071669 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350bc116-5ca1-4e39-9f47-49f4b8259302 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:20:00.071983 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350bc116-5ca1-4e39-9f47-49f4b8259302 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:20:00.072249 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350bc116-5ca1-4e39-9f47-49f4b8259302 None admin] PATH_INFO: `/v3/users` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:20:00.073182 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350bc116-5ca1-4e39-9f47-49f4b8259302 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:20:00.073585 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350bc116-5ca1-4e39-9f47-49f4b8259302 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:20:00.075195 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350bc116-5ca1-4e39-9f47-49f4b8259302 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:20:00.094658 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 616/1227] 10.222.0.16 () {56 vars in 1143 bytes} [Sun Sep 11 05:19:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:20:00.101041 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6370db6e-e9c2-40d3-8d9a-32f2e70575a2 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:20:00.216109 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6370db6e-e9c2-40d3-8d9a-32f2e70575a2 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:20:00.257863 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f2dd8a-1932-4581-96da-984e61f82ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:20:00.258499 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2dd8a-1932-4581-96da-984e61f82ec5 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:20:00.258775 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2dd8a-1932-4581-96da-984e61f82ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:20:00.259049 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2dd8a-1932-4581-96da-984e61f82ec5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:20:00.272492 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f2dd8a-1932-4581-96da-984e61f82ec5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:20:00.274062 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f2dd8a-1932-4581-96da-984e61f82ec5 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:20:00.291016 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-c5f2dd8a-1932-4581-96da-984e61f82ec5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:20:00.291016 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:20:00.291016 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:20:00.291016 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:20:00.291016 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:20:00.291016 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:20:00.291016 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:20:00.291016 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:20:00.291016 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:20:00.291016 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:20:00.291016 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:20:00.291016 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:20:00.291016 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 05:20:00.291016 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 05:20:00.291016 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 05:20:00.291016 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 05:20:00.292510 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:20:00.292510 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:20:00.292510 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:20:00.292510 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:20:00.292510 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:20:00.292510 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:20:00.292510 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:20:00.292510 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:20:00.292510 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:20:00.292510 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:20:00.292510 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:20:00.292510 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:20:00.292510 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:20:00.292510 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:20:00.292510 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:20:00.292510 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:20:00.292510 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 05:20:00.293497 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 05:20:00.293497 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:20:00.293497 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:20:00.293497 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 612/1228] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:20:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:20:00.298592 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350bc116-5ca1-4e39-9f47-49f4b8259302 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:20:00.406489 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350bc116-5ca1-4e39-9f47-49f4b8259302 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:20:00.409260 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:20:00.444021 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59acdfe-7b48-49ab-b764-57eef7eb2f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:20:00.444727 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59acdfe-7b48-49ab-b764-57eef7eb2f10 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:20:00.445000 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59acdfe-7b48-49ab-b764-57eef7eb2f10 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:20:00.445324 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59acdfe-7b48-49ab-b764-57eef7eb2f10 None admin] PATH_INFO: `/v3/domains` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:20:00.445962 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59acdfe-7b48-49ab-b764-57eef7eb2f10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:20:00.446336 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59acdfe-7b48-49ab-b764-57eef7eb2f10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:20:00.447856 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59acdfe-7b48-49ab-b764-57eef7eb2f10 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:20:00.467920 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 617/1229] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 05:20:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:20:00.469699 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f2dd8a-1932-4581-96da-984e61f82ec5 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:20:00.479885 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:20:00.584785 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f2dd8a-1932-4581-96da-984e61f82ec5 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:20:00.618837 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb3a217-befb-44bd-87d1-580afbf60687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:20:00.619468 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb3a217-befb-44bd-87d1-580afbf60687 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:20:00.619774 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb3a217-befb-44bd-87d1-580afbf60687 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:20:00.620049 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb3a217-befb-44bd-87d1-580afbf60687 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:20:00.627314 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb3a217-befb-44bd-87d1-580afbf60687 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:20:00.628950 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb3a217-befb-44bd-87d1-580afbf60687 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:20:00.641880 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-8bb3a217-befb-44bd-87d1-580afbf60687 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 05:20:00.641880 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:20:00.641880 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:20:00.641880 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:20:00.641880 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:20:00.641880 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:20:00.641880 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:20:00.641880 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:20:00.641880 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:20:00.641880 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:20:00.641880 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:20:00.641880 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:20:00.641880 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 05:20:00.641880 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 05:20:00.641880 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 05:20:00.642986 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 05:20:00.642986 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:20:00.642986 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:20:00.642986 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:20:00.642986 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:20:00.642986 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:20:00.642986 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:20:00.642986 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:20:00.642986 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:20:00.642986 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:20:00.642986 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:20:00.642986 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:20:00.642986 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:20:00.642986 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:20:00.642986 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:20:00.642986 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:20:00.642986 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:20:00.644067 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 05:20:00.644067 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 05:20:00.644067 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 05:20:00.644067 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 05:20:00.644067 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 05:20:00.644067 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 05:20:00.644067 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 05:20:00.644067 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:20:00.644067 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 613/1230] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 05:20:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:20:00.648923 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59acdfe-7b48-49ab-b764-57eef7eb2f10 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:20:00.765835 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59acdfe-7b48-49ab-b764-57eef7eb2f10 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:20:00.803501 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1db521-fafb-4bfd-83fa-0b71bbf4c203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:20:00.804307 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1db521-fafb-4bfd-83fa-0b71bbf4c203 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:20:00.804652 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1db521-fafb-4bfd-83fa-0b71bbf4c203 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:20:00.805086 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1db521-fafb-4bfd-83fa-0b71bbf4c203 None admin] PATH_INFO: `/v3/projects` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:20:00.806260 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1db521-fafb-4bfd-83fa-0b71bbf4c203 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:20:00.806571 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1db521-fafb-4bfd-83fa-0b71bbf4c203 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:20:00.808058 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1db521-fafb-4bfd-83fa-0b71bbf4c203 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:20:00.820993 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 618/1231] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 05:20:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:20:00.826997 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb3a217-befb-44bd-87d1-580afbf60687 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:20:00.899834 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:20:00.938944 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb3a217-befb-44bd-87d1-580afbf60687 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:20:00.975267 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aa1353-4440-4f74-9f81-44c2e3df7a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:20:00.976221 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa1353-4440-4f74-9f81-44c2e3df7a9c None admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:20:00.976500 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa1353-4440-4f74-9f81-44c2e3df7a9c None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:20:00.976769 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa1353-4440-4f74-9f81-44c2e3df7a9c None admin] PATH_INFO: `/v3/projects/61ffb079d9e1437084945554bcc0747b/users/72e1d7dd79ff43e7b585b5090762465f/roles/82bd224e8afc480782a85b833a2aa03e` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:20:00.991536 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aa1353-4440-4f74-9f81-44c2e3df7a9c None admin] RBAC: Authorizing `identity:create_grant(project_id=61ffb079d9e1437084945554bcc0747b, user_id=72e1d7dd79ff43e7b585b5090762465f, role_id=82bd224e8afc480782a85b833a2aa03e)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:20:00.993314 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aa1353-4440-4f74-9f81-44c2e3df7a9c None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:20:01.006881 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 614/1232] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 11 05:20:00 2022] PUT /identity/v3/projects/61ffb079d9e1437084945554bcc0747b/users/72e1d7dd79ff43e7b585b5090762465f/roles/82bd224e8afc480782a85b833a2aa03e => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:20:03.295391 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be5527-46ea-40fb-b98e-11f55edcc3b6 None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:20:03.296009 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be5527-46ea-40fb-b98e-11f55edcc3b6 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:20:03.296009 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be5527-46ea-40fb-b98e-11f55edcc3b6 None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:20:03.297311 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 619/1233] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:20:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:20:03.302904 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518cfc6f-a1bc-4b63-b6b1-bd2673e88f1f None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:20:03.303342 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518cfc6f-a1bc-4b63-b6b1-bd2673e88f1f None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:20:03.303449 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518cfc6f-a1bc-4b63-b6b1-bd2673e88f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:20:03.323099 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-518cfc6f-a1bc-4b63-b6b1-bd2673e88f1f None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:20:03.324719 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-518cfc6f-a1bc-4b63-b6b1-bd2673e88f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:20:03.407819 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 615/1234] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:20:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 05:20:03.703952 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74be5527-46ea-40fb-b98e-11f55edcc3b6 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:20:03.736239 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:20:03.818159 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74be5527-46ea-40fb-b98e-11f55edcc3b6 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:20:03.854171 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47fc39d-f5dd-41cd-afcc-116b32831a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:20:03.854820 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47fc39d-f5dd-41cd-afcc-116b32831a67 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:20:03.855097 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47fc39d-f5dd-41cd-afcc-116b32831a67 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:20:03.855367 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47fc39d-f5dd-41cd-afcc-116b32831a67 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:20:03.868160 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47fc39d-f5dd-41cd-afcc-116b32831a67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:20:03.873297 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-e47fc39d-f5dd-41cd-afcc-116b32831a67 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 05:20:03.873297 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:20:03.873297 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:20:03.873297 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:20:03.873297 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:20:03.873297 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:20:03.873297 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:20:03.873297 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:20:03.873297 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:20:03.873297 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:20:03.873297 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:20:03.873297 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:20:03.873297 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:20:03.873297 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:20:03.873297 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:20:03.873297 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:20:03.875060 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:20:03.875060 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:20:03.875060 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:20:03.875060 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:20:03.875060 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:20:03.875060 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:20:03.875060 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:20:03.875060 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:20:03.875060 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:20:03.875060 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:20:03.875060 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:20:03.875060 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:20:03.875060 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:20:03.875060 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:20:03.875060 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:20:03.875060 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:20:03.876431 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:20:03.876431 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:20:03.876431 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:20:03.876431 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:20:03.876431 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:20:03.876431 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:20:03.876431 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:20:03.876431 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:20:03.876431 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:20:03.876431 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:20:03.876431 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 05:20:03.876431 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:20:03.876431 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 620/1235] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 11 05:20:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:20:03.881356 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518cfc6f-a1bc-4b63-b6b1-bd2673e88f1f None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:20:03.932235 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:20:03.994623 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518cfc6f-a1bc-4b63-b6b1-bd2673e88f1f None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:20:04.033318 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd935e10-33d0-4609-aa84-bbd751257ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:20:04.033959 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd935e10-33d0-4609-aa84-bbd751257ddb None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:20:04.034245 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd935e10-33d0-4609-aa84-bbd751257ddb None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:20:04.034510 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd935e10-33d0-4609-aa84-bbd751257ddb None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:20:04.035171 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd935e10-33d0-4609-aa84-bbd751257ddb None admin] RBAC: Adding query filter params (name=service) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:20:04.035474 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd935e10-33d0-4609-aa84-bbd751257ddb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:20:04.036964 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd935e10-33d0-4609-aa84-bbd751257ddb None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:20:04.045780 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 616/1236] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 11 05:20:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:20:04.051917 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47fc39d-f5dd-41cd-afcc-116b32831a67 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:20:04.147463 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:20:04.167033 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47fc39d-f5dd-41cd-afcc-116b32831a67 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:20:04.210411 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace9deb-b64f-44c0-9c0e-32bd6cf354d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:20:04.211044 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace9deb-b64f-44c0-9c0e-32bd6cf354d9 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:20:04.211337 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace9deb-b64f-44c0-9c0e-32bd6cf354d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:20:04.211646 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace9deb-b64f-44c0-9c0e-32bd6cf354d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:20:04.227589 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ace9deb-b64f-44c0-9c0e-32bd6cf354d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:20:04.229655 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ace9deb-b64f-44c0-9c0e-32bd6cf354d9 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:20:04.247486 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-9ace9deb-b64f-44c0-9c0e-32bd6cf354d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:20:04.247486 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:20:04.247486 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:20:04.247486 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:20:04.247486 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:20:04.247486 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:20:04.247486 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:20:04.247486 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:20:04.247486 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:20:04.247486 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:20:04.247486 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:20:04.247486 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:20:04.247486 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 05:20:04.247486 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 05:20:04.247486 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 05:20:04.247486 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 05:20:04.248597 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:20:04.248597 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:20:04.248597 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:20:04.248597 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:20:04.248597 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:20:04.248597 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:20:04.248597 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:20:04.248597 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:20:04.248597 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:20:04.248597 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:20:04.248597 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:20:04.248597 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:20:04.248597 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:20:04.248597 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:20:04.248597 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:20:04.248597 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:20:04.248597 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 05:20:04.250045 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 05:20:04.250045 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:20:04.250045 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:20:04.250045 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 621/1237] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:20:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:20:04.255108 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd935e10-33d0-4609-aa84-bbd751257ddb None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:20:04.377425 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd935e10-33d0-4609-aa84-bbd751257ddb None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:20:04.387149 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:20:04.415410 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e44d8a6-ecb7-4951-940c-cacd3fc6b633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:20:04.416050 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e44d8a6-ecb7-4951-940c-cacd3fc6b633 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:20:04.416327 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e44d8a6-ecb7-4951-940c-cacd3fc6b633 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:20:04.416597 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e44d8a6-ecb7-4951-940c-cacd3fc6b633 None admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:20:04.417262 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e44d8a6-ecb7-4951-940c-cacd3fc6b633 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:20:04.417565 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e44d8a6-ecb7-4951-940c-cacd3fc6b633 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:20:04.418973 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e44d8a6-ecb7-4951-940c-cacd3fc6b633 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:20:04.433111 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 617/1238] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 05:20:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:20:04.440142 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace9deb-b64f-44c0-9c0e-32bd6cf354d9 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:20:04.557450 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace9deb-b64f-44c0-9c0e-32bd6cf354d9 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:20:04.597033 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bab4706-e2a8-4711-a2dc-5e74eb8267db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:20:04.597670 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab4706-e2a8-4711-a2dc-5e74eb8267db None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:20:04.597951 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab4706-e2a8-4711-a2dc-5e74eb8267db None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:20:04.598221 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab4706-e2a8-4711-a2dc-5e74eb8267db None admin] PATH_INFO: `/v3/users/placement` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:20:04.601153 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:20:04.606676 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bab4706-e2a8-4711-a2dc-5e74eb8267db None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:20:04.608459 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bab4706-e2a8-4711-a2dc-5e74eb8267db None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:20:04.621063 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-4bab4706-e2a8-4711-a2dc-5e74eb8267db None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 11 05:20:04.621063 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:20:04.621063 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:20:04.621063 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:20:04.621063 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:20:04.621063 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:20:04.621063 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:20:04.621063 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:20:04.621063 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:20:04.621063 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:20:04.621063 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:20:04.621063 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:20:04.621063 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 05:20:04.621063 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 05:20:04.621063 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 05:20:04.621063 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 05:20:04.622417 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:20:04.622417 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:20:04.622417 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 05:20:04.622417 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 05:20:04.622417 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 05:20:04.622417 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 05:20:04.622417 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:20:04.622417 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:20:04.622417 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:20:04.622417 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:20:04.622417 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:20:04.622417 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:20:04.622417 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:20:04.622417 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:20:04.622417 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:20:04.622417 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:20:04.622417 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:20:04.622417 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:20:04.623576 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:20:04.623576 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:20:04.623576 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 05:20:04.623576 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 05:20:04.623576 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 05:20:04.623576 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 05:20:04.623576 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 05:20:04.623576 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 05:20:04.623576 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 11 05:20:04.623576 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:20:04.623576 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 622/1239] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:20:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:20:04.628512 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e44d8a6-ecb7-4951-940c-cacd3fc6b633 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:20:04.746243 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e44d8a6-ecb7-4951-940c-cacd3fc6b633 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:20:04.784294 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7808340e-4351-440d-9efc-956151a9c564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:20:04.785114 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7808340e-4351-440d-9efc-956151a9c564 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:20:04.785458 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7808340e-4351-440d-9efc-956151a9c564 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:20:04.785821 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7808340e-4351-440d-9efc-956151a9c564 None admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:20:04.786905 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7808340e-4351-440d-9efc-956151a9c564 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:20:04.787476 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7808340e-4351-440d-9efc-956151a9c564 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:20:04.789526 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7808340e-4351-440d-9efc-956151a9c564 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:20:04.811210 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 618/1240] 10.222.0.16 () {56 vars in 1143 bytes} [Sun Sep 11 05:20:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:20:04.817594 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bab4706-e2a8-4711-a2dc-5e74eb8267db None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:20:04.937265 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bab4706-e2a8-4711-a2dc-5e74eb8267db None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:20:04.976634 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62995c60-d804-46f4-b4eb-6d46815f09e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:20:04.977352 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62995c60-d804-46f4-b4eb-6d46815f09e1 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:20:04.977751 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62995c60-d804-46f4-b4eb-6d46815f09e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:20:04.978203 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62995c60-d804-46f4-b4eb-6d46815f09e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:20:05.054955 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:20:05.065360 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62995c60-d804-46f4-b4eb-6d46815f09e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:20:05.066989 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62995c60-d804-46f4-b4eb-6d46815f09e1 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:20:05.180071 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 623/1241] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 05:20:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 05:20:05.186419 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7808340e-4351-440d-9efc-956151a9c564 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:20:05.238602 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:20:05.326095 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7808340e-4351-440d-9efc-956151a9c564 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:20:05.363848 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c64e53e-e4e5-4d6e-bc60-d570d8e57785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:20:05.364650 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c64e53e-e4e5-4d6e-bc60-d570d8e57785 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:20:05.365013 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c64e53e-e4e5-4d6e-bc60-d570d8e57785 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:20:05.365381 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c64e53e-e4e5-4d6e-bc60-d570d8e57785 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:20:05.377178 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c64e53e-e4e5-4d6e-bc60-d570d8e57785 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:20:05.378689 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c64e53e-e4e5-4d6e-bc60-d570d8e57785 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:20:05.398404 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-9c64e53e-e4e5-4d6e-bc60-d570d8e57785 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:20:05.398404 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:20:05.398404 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:20:05.398404 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:20:05.398404 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:20:05.398404 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:20:05.398404 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:20:05.398404 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:20:05.398404 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:20:05.398404 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:20:05.398404 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:20:05.398404 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:20:05.398404 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 05:20:05.398404 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 05:20:05.398404 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 05:20:05.398404 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 05:20:05.399505 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:20:05.399505 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:20:05.399505 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:20:05.399505 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:20:05.399505 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:20:05.399505 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:20:05.399505 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:20:05.399505 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:20:05.399505 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:20:05.399505 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:20:05.399505 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:20:05.399505 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:20:05.399505 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:20:05.399505 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:20:05.399505 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:20:05.399505 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:20:05.399505 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 05:20:05.400571 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 05:20:05.400571 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:20:05.400571 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:20:05.400571 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 619/1242] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:20:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:20:05.406676 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62995c60-d804-46f4-b4eb-6d46815f09e1 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:20:05.516280 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:20:05.522792 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62995c60-d804-46f4-b4eb-6d46815f09e1 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:20:05.570385 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be625fd3-56b8-4f72-9d47-6def399bfc82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:20:05.571003 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be625fd3-56b8-4f72-9d47-6def399bfc82 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:20:05.571282 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be625fd3-56b8-4f72-9d47-6def399bfc82 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:20:05.571552 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be625fd3-56b8-4f72-9d47-6def399bfc82 None admin] PATH_INFO: `/v3/domains` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:20:05.572228 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be625fd3-56b8-4f72-9d47-6def399bfc82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:20:05.572531 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be625fd3-56b8-4f72-9d47-6def399bfc82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:20:05.573895 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be625fd3-56b8-4f72-9d47-6def399bfc82 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:20:05.587540 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 624/1243] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 05:20:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:20:05.593134 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c64e53e-e4e5-4d6e-bc60-d570d8e57785 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:20:05.686242 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:20:05.711920 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c64e53e-e4e5-4d6e-bc60-d570d8e57785 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:20:05.748660 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cdcdd8-3041-451e-8946-bddf4cbaa202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:20:05.749809 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cdcdd8-3041-451e-8946-bddf4cbaa202 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:20:05.750087 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cdcdd8-3041-451e-8946-bddf4cbaa202 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:20:05.750363 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cdcdd8-3041-451e-8946-bddf4cbaa202 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:20:05.757294 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cdcdd8-3041-451e-8946-bddf4cbaa202 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:20:05.758836 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cdcdd8-3041-451e-8946-bddf4cbaa202 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:20:05.770955 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-e1cdcdd8-3041-451e-8946-bddf4cbaa202 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 05:20:05.770955 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:20:05.770955 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:20:05.770955 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:20:05.770955 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:20:05.770955 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:20:05.770955 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:20:05.770955 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:20:05.770955 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:20:05.770955 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:20:05.770955 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:20:05.770955 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:20:05.770955 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 05:20:05.770955 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 05:20:05.770955 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 05:20:05.772201 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 05:20:05.772201 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:20:05.772201 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:20:05.772201 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:20:05.772201 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:20:05.772201 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:20:05.772201 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:20:05.772201 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:20:05.772201 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:20:05.772201 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:20:05.772201 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:20:05.772201 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:20:05.772201 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:20:05.772201 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:20:05.772201 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:20:05.772201 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:20:05.772201 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:20:05.773350 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 05:20:05.773350 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 05:20:05.773350 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 05:20:05.773350 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 05:20:05.773350 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 05:20:05.773350 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 05:20:05.773350 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 05:20:05.773350 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:20:05.773350 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 620/1244] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 05:20:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:20:05.778640 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be625fd3-56b8-4f72-9d47-6def399bfc82 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:20:05.898256 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be625fd3-56b8-4f72-9d47-6def399bfc82 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:20:05.937805 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a67c22-6498-4c05-b5eb-dcc856b85f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:20:05.938461 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a67c22-6498-4c05-b5eb-dcc856b85f45 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:20:05.938790 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a67c22-6498-4c05-b5eb-dcc856b85f45 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:20:05.939065 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a67c22-6498-4c05-b5eb-dcc856b85f45 None admin] PATH_INFO: `/v3/projects` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:20:05.939791 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a67c22-6498-4c05-b5eb-dcc856b85f45 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:20:05.940100 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a67c22-6498-4c05-b5eb-dcc856b85f45 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:20:05.941536 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a67c22-6498-4c05-b5eb-dcc856b85f45 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:20:05.960543 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 625/1245] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 05:20:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:20:05.961989 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cdcdd8-3041-451e-8946-bddf4cbaa202 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:20:06.074694 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cdcdd8-3041-451e-8946-bddf4cbaa202 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:20:06.112860 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f42720a-520e-43fd-84db-a9e295e53132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:20:06.113531 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f42720a-520e-43fd-84db-a9e295e53132 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:20:06.113839 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f42720a-520e-43fd-84db-a9e295e53132 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:20:06.114185 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f42720a-520e-43fd-84db-a9e295e53132 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:20:06.115003 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f42720a-520e-43fd-84db-a9e295e53132 None admin] RBAC: Adding query filter params (role.id=82bd224e8afc480782a85b833a2aa03e, scope.project.id=61ffb079d9e1437084945554bcc0747b, user.id=72e1d7dd79ff43e7b585b5090762465f) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:20:06.115399 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f42720a-520e-43fd-84db-a9e295e53132 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:20:06.117383 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f42720a-520e-43fd-84db-a9e295e53132 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:20:06.124197 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 621/1246] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 05:20:05 2022] GET /identity/v3/role_assignments?user.id=72e1d7dd79ff43e7b585b5090762465f&scope.project.id=61ffb079d9e1437084945554bcc0747b&role.id=82bd224e8afc480782a85b833a2aa03e => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:20:08.501788 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b3746-1c79-48a1-8f97-d4378b18e4af None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:20:08.502348 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b3746-1c79-48a1-8f97-d4378b18e4af None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:20:08.502348 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b3746-1c79-48a1-8f97-d4378b18e4af None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:20:08.504043 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 626/1247] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:20:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:20:08.509115 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aa73d0-4446-4d63-84f1-91db9d2da8a4 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:20:08.509612 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aa73d0-4446-4d63-84f1-91db9d2da8a4 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:20:08.509714 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aa73d0-4446-4d63-84f1-91db9d2da8a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:20:08.516561 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:20:08.529232 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-84aa73d0-4446-4d63-84f1-91db9d2da8a4 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:20:08.530734 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-84aa73d0-4446-4d63-84f1-91db9d2da8a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:20:08.602748 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 622/1248] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:20:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 05:20:08.892528 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155b3746-1c79-48a1-8f97-d4378b18e4af None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:20:08.912662 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:20:09.009032 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155b3746-1c79-48a1-8f97-d4378b18e4af None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:20:09.047904 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4466363-a077-44f9-a03e-89b165338d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:20:09.048560 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4466363-a077-44f9-a03e-89b165338d4a None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:20:09.048893 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4466363-a077-44f9-a03e-89b165338d4a None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:20:09.049285 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4466363-a077-44f9-a03e-89b165338d4a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:20:09.060086 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4466363-a077-44f9-a03e-89b165338d4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:20:09.065566 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-b4466363-a077-44f9-a03e-89b165338d4a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 05:20:09.065566 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:20:09.065566 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:20:09.065566 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:20:09.065566 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:20:09.065566 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:20:09.065566 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:20:09.065566 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:20:09.065566 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:20:09.065566 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:20:09.065566 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:20:09.065566 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:20:09.065566 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:20:09.065566 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:20:09.065566 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:20:09.065566 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:20:09.066589 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:20:09.066589 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:20:09.066589 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:20:09.066589 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:20:09.066589 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:20:09.066589 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:20:09.066589 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:20:09.066589 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:20:09.066589 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:20:09.066589 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:20:09.066589 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:20:09.066589 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:20:09.066589 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:20:09.066589 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:20:09.066589 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:20:09.066589 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:20:09.067903 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:20:09.067903 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:20:09.067903 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:20:09.067903 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:20:09.067903 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:20:09.067903 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:20:09.067903 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:20:09.067903 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:20:09.067903 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:20:09.067903 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:20:09.067903 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 05:20:09.067903 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:20:09.067903 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 627/1249] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 05:20:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:20:09.073291 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aa73d0-4446-4d63-84f1-91db9d2da8a4 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:20:09.192151 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aa73d0-4446-4d63-84f1-91db9d2da8a4 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:20:09.231218 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:20:09.238654 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ef0252-f1c1-47d6-94fb-6c314736fc97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:20:09.239472 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef0252-f1c1-47d6-94fb-6c314736fc97 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:20:09.239644 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef0252-f1c1-47d6-94fb-6c314736fc97 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:20:09.239955 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef0252-f1c1-47d6-94fb-6c314736fc97 None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:20:09.240636 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ef0252-f1c1-47d6-94fb-6c314736fc97 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:20:09.240941 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ef0252-f1c1-47d6-94fb-6c314736fc97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:20:09.242620 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ef0252-f1c1-47d6-94fb-6c314736fc97 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:20:09.251706 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 623/1250] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 05:20:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:20:09.257853 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4466363-a077-44f9-a03e-89b165338d4a None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:20:09.344195 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:20:09.370570 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4466363-a077-44f9-a03e-89b165338d4a None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:20:09.407935 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727cd58e-9201-4ef5-83c4-b2ea310e588d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:20:09.408661 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727cd58e-9201-4ef5-83c4-b2ea310e588d None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:20:09.408961 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727cd58e-9201-4ef5-83c4-b2ea310e588d None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:20:09.409260 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727cd58e-9201-4ef5-83c4-b2ea310e588d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:20:09.421974 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727cd58e-9201-4ef5-83c4-b2ea310e588d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:20:09.423568 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727cd58e-9201-4ef5-83c4-b2ea310e588d None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:20:09.440007 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-727cd58e-9201-4ef5-83c4-b2ea310e588d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:20:09.440007 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:20:09.440007 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:20:09.440007 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:20:09.440007 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:20:09.440007 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:20:09.440007 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:20:09.440007 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:20:09.440007 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:20:09.440007 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:20:09.440007 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:20:09.440007 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:20:09.440007 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 05:20:09.440007 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 05:20:09.440007 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 05:20:09.440007 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 05:20:09.441217 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:20:09.441217 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:20:09.441217 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:20:09.441217 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:20:09.441217 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:20:09.441217 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:20:09.441217 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:20:09.441217 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:20:09.441217 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:20:09.441217 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:20:09.441217 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:20:09.441217 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:20:09.441217 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:20:09.441217 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:20:09.441217 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:20:09.441217 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:20:09.441217 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 05:20:09.447423 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 05:20:09.447423 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:20:09.447423 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:20:09.447423 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 628/1251] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:20:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:20:09.447750 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ef0252-f1c1-47d6-94fb-6c314736fc97 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:20:09.558891 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ef0252-f1c1-47d6-94fb-6c314736fc97 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:20:09.593470 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fc97f2-2807-4e99-811c-23a41125bc3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:20:09.594078 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc97f2-2807-4e99-811c-23a41125bc3e None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:20:09.594409 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc97f2-2807-4e99-811c-23a41125bc3e None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:20:09.594622 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc97f2-2807-4e99-811c-23a41125bc3e None admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:20:09.595256 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fc97f2-2807-4e99-811c-23a41125bc3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:20:09.595555 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fc97f2-2807-4e99-811c-23a41125bc3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:20:09.596972 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fc97f2-2807-4e99-811c-23a41125bc3e None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:20:09.609133 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 624/1252] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 05:20:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:20:09.614863 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727cd58e-9201-4ef5-83c4-b2ea310e588d None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:20:09.716221 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727cd58e-9201-4ef5-83c4-b2ea310e588d None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:20:09.743001 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:20:09.751401 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee3183a-da1a-418d-a30c-766795ea3f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:20:09.752158 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee3183a-da1a-418d-a30c-766795ea3f9a None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:20:09.752441 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee3183a-da1a-418d-a30c-766795ea3f9a None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:20:09.752714 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee3183a-da1a-418d-a30c-766795ea3f9a None admin] PATH_INFO: `/v3/users/placement` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:20:09.760668 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee3183a-da1a-418d-a30c-766795ea3f9a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:20:09.762108 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee3183a-da1a-418d-a30c-766795ea3f9a None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:20:09.773888 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-0ee3183a-da1a-418d-a30c-766795ea3f9a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 11 05:20:09.773888 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:20:09.773888 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:20:09.773888 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:20:09.773888 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:20:09.773888 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:20:09.773888 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:20:09.773888 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:20:09.773888 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:20:09.773888 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:20:09.773888 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:20:09.773888 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:20:09.773888 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 05:20:09.773888 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 05:20:09.773888 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 05:20:09.773888 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 05:20:09.775026 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:20:09.775026 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:20:09.775026 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 05:20:09.775026 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 05:20:09.775026 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 05:20:09.775026 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 05:20:09.775026 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:20:09.775026 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:20:09.775026 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:20:09.775026 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:20:09.775026 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:20:09.775026 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:20:09.775026 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:20:09.775026 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:20:09.775026 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:20:09.775026 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:20:09.775026 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:20:09.775026 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:20:09.776348 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:20:09.776348 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:20:09.776348 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 05:20:09.776348 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 05:20:09.776348 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 05:20:09.776348 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 05:20:09.776348 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 05:20:09.776348 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 05:20:09.776348 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 11 05:20:09.776348 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:20:09.776348 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 629/1253] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:20:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:20:09.782243 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fc97f2-2807-4e99-811c-23a41125bc3e None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:20:09.841302 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:20:09.885046 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fc97f2-2807-4e99-811c-23a41125bc3e None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:20:09.918050 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe73ff2e-9690-43d1-982c-e38463083db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:20:09.918648 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe73ff2e-9690-43d1-982c-e38463083db2 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:20:09.918923 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe73ff2e-9690-43d1-982c-e38463083db2 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:20:09.919190 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe73ff2e-9690-43d1-982c-e38463083db2 None admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:20:09.919925 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe73ff2e-9690-43d1-982c-e38463083db2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:20:09.920223 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe73ff2e-9690-43d1-982c-e38463083db2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:20:09.921671 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe73ff2e-9690-43d1-982c-e38463083db2 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:20:09.937774 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 625/1254] 10.222.0.16 () {56 vars in 1143 bytes} [Sun Sep 11 05:20:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:20:09.943582 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee3183a-da1a-418d-a30c-766795ea3f9a None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:20:10.046144 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee3183a-da1a-418d-a30c-766795ea3f9a None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:20:10.080704 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c80de15-e7a2-4268-9f0b-0c54317d9169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:20:10.081347 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c80de15-e7a2-4268-9f0b-0c54317d9169 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:20:10.081645 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c80de15-e7a2-4268-9f0b-0c54317d9169 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:20:10.081944 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c80de15-e7a2-4268-9f0b-0c54317d9169 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:20:10.136530 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:20:10.149481 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c80de15-e7a2-4268-9f0b-0c54317d9169 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:20:10.151007 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c80de15-e7a2-4268-9f0b-0c54317d9169 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:20:10.255780 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 630/1255] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 05:20:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 05:20:10.261597 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe73ff2e-9690-43d1-982c-e38463083db2 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:20:10.358718 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe73ff2e-9690-43d1-982c-e38463083db2 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:20:10.371557 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:20:10.392628 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef2bcac-7338-4537-a409-21cf7b984b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:20:10.393245 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef2bcac-7338-4537-a409-21cf7b984b35 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:20:10.393523 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef2bcac-7338-4537-a409-21cf7b984b35 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:20:10.393791 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef2bcac-7338-4537-a409-21cf7b984b35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:20:10.403424 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef2bcac-7338-4537-a409-21cf7b984b35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:20:10.404894 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef2bcac-7338-4537-a409-21cf7b984b35 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:20:10.419407 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-aef2bcac-7338-4537-a409-21cf7b984b35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:20:10.419407 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:20:10.419407 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:20:10.419407 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:20:10.419407 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:20:10.419407 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:20:10.419407 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:20:10.419407 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:20:10.419407 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:20:10.419407 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:20:10.419407 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:20:10.419407 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:20:10.419407 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 05:20:10.419407 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 05:20:10.419407 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 05:20:10.419407 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 05:20:10.420543 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:20:10.420543 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:20:10.420543 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:20:10.420543 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:20:10.420543 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:20:10.420543 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:20:10.420543 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:20:10.420543 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:20:10.420543 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:20:10.420543 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:20:10.420543 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:20:10.420543 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:20:10.420543 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:20:10.420543 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:20:10.420543 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:20:10.420543 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:20:10.420543 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 05:20:10.421466 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 05:20:10.421466 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:20:10.421466 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:20:10.421466 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 626/1256] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:20:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:20:10.426219 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c80de15-e7a2-4268-9f0b-0c54317d9169 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:20:10.509151 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:20:10.521638 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c80de15-e7a2-4268-9f0b-0c54317d9169 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:20:10.554107 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afddc244-20fd-462b-ab5f-ca0558236b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:20:10.554703 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afddc244-20fd-462b-ab5f-ca0558236b89 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:20:10.554978 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afddc244-20fd-462b-ab5f-ca0558236b89 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:20:10.555246 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afddc244-20fd-462b-ab5f-ca0558236b89 None admin] PATH_INFO: `/v3/domains` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:20:10.555910 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afddc244-20fd-462b-ab5f-ca0558236b89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:20:10.556209 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afddc244-20fd-462b-ab5f-ca0558236b89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:20:10.557559 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afddc244-20fd-462b-ab5f-ca0558236b89 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:20:10.568402 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 631/1257] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 05:20:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:20:10.573982 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef2bcac-7338-4537-a409-21cf7b984b35 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:20:10.676875 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef2bcac-7338-4537-a409-21cf7b984b35 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:20:10.709204 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689c1a5c-5a5d-498b-a249-84e241691d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:20:10.709815 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689c1a5c-5a5d-498b-a249-84e241691d8c None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:20:10.710092 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689c1a5c-5a5d-498b-a249-84e241691d8c None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:20:10.710363 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689c1a5c-5a5d-498b-a249-84e241691d8c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:20:10.716763 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689c1a5c-5a5d-498b-a249-84e241691d8c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:20:10.718857 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689c1a5c-5a5d-498b-a249-84e241691d8c None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:20:10.729808 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-689c1a5c-5a5d-498b-a249-84e241691d8c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 05:20:10.729808 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:20:10.729808 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:20:10.729808 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:20:10.729808 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:20:10.729808 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:20:10.729808 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:20:10.729808 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:20:10.729808 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:20:10.729808 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:20:10.729808 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:20:10.729808 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:20:10.729808 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 05:20:10.729808 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 05:20:10.729808 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 05:20:10.730840 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 05:20:10.730840 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:20:10.730840 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:20:10.730840 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:20:10.730840 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:20:10.730840 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:20:10.730840 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:20:10.730840 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:20:10.730840 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:20:10.730840 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:20:10.730840 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:20:10.730840 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:20:10.730840 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:20:10.730840 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:20:10.730840 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:20:10.730840 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:20:10.730840 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:20:10.731997 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 05:20:10.731997 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 05:20:10.731997 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 05:20:10.731997 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 05:20:10.731997 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 05:20:10.731997 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 05:20:10.731997 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 05:20:10.731997 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:20:10.731997 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 627/1258] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 05:20:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:20:10.736837 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afddc244-20fd-462b-ab5f-ca0558236b89 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:20:10.834409 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afddc244-20fd-462b-ab5f-ca0558236b89 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:20:10.868485 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d37f2ee-d5dd-4094-8dfa-ccadc19e0335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:20:10.869137 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d37f2ee-d5dd-4094-8dfa-ccadc19e0335 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:20:10.869420 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d37f2ee-d5dd-4094-8dfa-ccadc19e0335 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:20:10.869697 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d37f2ee-d5dd-4094-8dfa-ccadc19e0335 None admin] PATH_INFO: `/v3/projects` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:20:10.870428 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d37f2ee-d5dd-4094-8dfa-ccadc19e0335 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:20:10.870754 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d37f2ee-d5dd-4094-8dfa-ccadc19e0335 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:20:10.872271 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d37f2ee-d5dd-4094-8dfa-ccadc19e0335 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:20:10.884943 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 632/1259] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 05:20:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:20:10.891532 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689c1a5c-5a5d-498b-a249-84e241691d8c None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:20:10.915927 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:20:10.988587 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689c1a5c-5a5d-498b-a249-84e241691d8c None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:20:11.021329 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20ae090-da1a-4afe-a213-36d3e80748af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:20:11.021925 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20ae090-da1a-4afe-a213-36d3e80748af None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:20:11.022203 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20ae090-da1a-4afe-a213-36d3e80748af None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:20:11.022476 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20ae090-da1a-4afe-a213-36d3e80748af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:20:11.023191 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20ae090-da1a-4afe-a213-36d3e80748af None admin] RBAC: Adding query filter params (role.id=5b702713e40145b49e0b42abd0a5fba9, scope.project.id=61ffb079d9e1437084945554bcc0747b, user.id=72e1d7dd79ff43e7b585b5090762465f) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:20:11.023500 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20ae090-da1a-4afe-a213-36d3e80748af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:20:11.024966 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20ae090-da1a-4afe-a213-36d3e80748af None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:20:11.030102 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 628/1260] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 05:20:10 2022] GET /identity/v3/role_assignments?user.id=72e1d7dd79ff43e7b585b5090762465f&scope.project.id=61ffb079d9e1437084945554bcc0747b&role.id=5b702713e40145b49e0b42abd0a5fba9 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:20:13.119702 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d849cbc-443c-4de1-8fc5-d66b9abdc101 None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:20:13.120255 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d849cbc-443c-4de1-8fc5-d66b9abdc101 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:20:13.120255 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d849cbc-443c-4de1-8fc5-d66b9abdc101 None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:20:13.121512 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 633/1261] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:20:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 05:20:13.127086 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee26434a-1c0d-4220-880c-914bcd74adf3 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:20:13.127512 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee26434a-1c0d-4220-880c-914bcd74adf3 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:20:13.127648 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee26434a-1c0d-4220-880c-914bcd74adf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:20:13.145887 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-ee26434a-1c0d-4220-880c-914bcd74adf3 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:20:13.147055 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-ee26434a-1c0d-4220-880c-914bcd74adf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:20:13.216738 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 629/1262] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:20:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 05:20:13.488523 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d849cbc-443c-4de1-8fc5-d66b9abdc101 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:20:13.500212 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:20:13.587829 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d849cbc-443c-4de1-8fc5-d66b9abdc101 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:20:13.620720 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad44fd12-b08c-454d-a41d-60fe450c0777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:20:13.621345 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad44fd12-b08c-454d-a41d-60fe450c0777 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:20:13.621623 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad44fd12-b08c-454d-a41d-60fe450c0777 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:20:13.621894 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad44fd12-b08c-454d-a41d-60fe450c0777 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:20:13.632244 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad44fd12-b08c-454d-a41d-60fe450c0777 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:20:13.636994 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-ad44fd12-b08c-454d-a41d-60fe450c0777 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 05:20:13.636994 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:20:13.636994 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:20:13.636994 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:20:13.636994 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:20:13.636994 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:20:13.636994 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:20:13.636994 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:20:13.636994 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:20:13.636994 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:20:13.636994 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:20:13.636994 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:20:13.636994 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:20:13.636994 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:20:13.636994 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:20:13.636994 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:20:13.638069 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:20:13.638069 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:20:13.638069 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:20:13.638069 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:20:13.638069 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:20:13.638069 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:20:13.638069 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:20:13.638069 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:20:13.638069 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:20:13.638069 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:20:13.638069 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:20:13.638069 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:20:13.638069 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:20:13.638069 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:20:13.638069 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:20:13.638069 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:20:13.639102 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:20:13.639102 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:20:13.639102 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:20:13.639102 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:20:13.639102 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:20:13.639102 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:20:13.639102 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:20:13.639102 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:20:13.639102 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:20:13.639102 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:20:13.639102 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 05:20:13.639102 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:20:13.639102 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 634/1263] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 05:20:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:20:13.644115 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee26434a-1c0d-4220-880c-914bcd74adf3 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:20:13.661678 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:20:13.739756 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee26434a-1c0d-4220-880c-914bcd74adf3 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:20:13.774727 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4a36dd-71cc-4386-8912-b0f874155343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:20:13.775326 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a36dd-71cc-4386-8912-b0f874155343 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:20:13.775602 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a36dd-71cc-4386-8912-b0f874155343 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:20:13.775900 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a36dd-71cc-4386-8912-b0f874155343 None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:20:13.776559 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4a36dd-71cc-4386-8912-b0f874155343 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:20:13.776862 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4a36dd-71cc-4386-8912-b0f874155343 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:20:13.778226 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4a36dd-71cc-4386-8912-b0f874155343 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:20:13.786160 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 630/1264] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 05:20:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:20:13.791620 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad44fd12-b08c-454d-a41d-60fe450c0777 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:20:13.857641 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:20:13.890496 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad44fd12-b08c-454d-a41d-60fe450c0777 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:20:13.922191 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30490ed2-da82-4d48-90fb-19ac9b6286ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:20:13.922800 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30490ed2-da82-4d48-90fb-19ac9b6286ee None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:20:13.923075 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30490ed2-da82-4d48-90fb-19ac9b6286ee None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:20:13.923341 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30490ed2-da82-4d48-90fb-19ac9b6286ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:20:13.932885 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30490ed2-da82-4d48-90fb-19ac9b6286ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:20:13.934307 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30490ed2-da82-4d48-90fb-19ac9b6286ee None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:20:13.948645 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-30490ed2-da82-4d48-90fb-19ac9b6286ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:20:13.948645 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:20:13.948645 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:20:13.948645 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:20:13.948645 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:20:13.948645 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:20:13.948645 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:20:13.948645 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:20:13.948645 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:20:13.948645 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:20:13.948645 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:20:13.948645 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:20:13.948645 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 05:20:13.948645 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 05:20:13.948645 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 05:20:13.948645 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 05:20:13.949767 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:20:13.949767 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:20:13.949767 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:20:13.949767 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:20:13.949767 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:20:13.949767 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:20:13.949767 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:20:13.949767 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:20:13.949767 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:20:13.949767 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:20:13.949767 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:20:13.949767 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:20:13.949767 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:20:13.949767 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:20:13.949767 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:20:13.949767 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:20:13.949767 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 05:20:13.950896 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 05:20:13.950896 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:20:13.950896 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:20:13.950896 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 635/1265] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:20:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:20:13.955983 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4a36dd-71cc-4386-8912-b0f874155343 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:20:14.034590 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:20:14.053251 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4a36dd-71cc-4386-8912-b0f874155343 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:20:14.085912 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64240263-f0ea-4616-9757-d12f3b95d06c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:20:14.086511 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64240263-f0ea-4616-9757-d12f3b95d06c None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:20:14.086791 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64240263-f0ea-4616-9757-d12f3b95d06c None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:20:14.087064 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64240263-f0ea-4616-9757-d12f3b95d06c None admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:20:14.087866 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64240263-f0ea-4616-9757-d12f3b95d06c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:20:14.088033 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64240263-f0ea-4616-9757-d12f3b95d06c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:20:14.089402 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64240263-f0ea-4616-9757-d12f3b95d06c None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:20:14.100609 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 631/1266] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 05:20:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:20:14.106240 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30490ed2-da82-4d48-90fb-19ac9b6286ee None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:20:14.205220 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30490ed2-da82-4d48-90fb-19ac9b6286ee None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:20:14.224214 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:20:14.238827 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c23001c-ef02-4a85-970f-06857aecdebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:20:14.239451 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c23001c-ef02-4a85-970f-06857aecdebd None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:20:14.239755 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c23001c-ef02-4a85-970f-06857aecdebd None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:20:14.240024 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c23001c-ef02-4a85-970f-06857aecdebd None admin] PATH_INFO: `/v3/users/placement` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:20:14.247401 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c23001c-ef02-4a85-970f-06857aecdebd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:20:14.249499 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c23001c-ef02-4a85-970f-06857aecdebd None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:20:14.260179 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-5c23001c-ef02-4a85-970f-06857aecdebd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 11 05:20:14.260179 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:20:14.260179 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:20:14.260179 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:20:14.260179 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:20:14.260179 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:20:14.260179 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:20:14.260179 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:20:14.260179 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:20:14.260179 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:20:14.260179 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:20:14.260179 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:20:14.260179 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 05:20:14.260179 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 05:20:14.260179 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 05:20:14.260179 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 05:20:14.261383 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:20:14.261383 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:20:14.261383 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 05:20:14.261383 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 05:20:14.261383 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 05:20:14.261383 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 05:20:14.261383 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:20:14.261383 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:20:14.261383 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:20:14.261383 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:20:14.261383 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:20:14.261383 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:20:14.261383 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:20:14.261383 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:20:14.261383 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:20:14.261383 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:20:14.261383 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:20:14.261383 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:20:14.262344 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:20:14.262344 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:20:14.262344 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 05:20:14.262344 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 05:20:14.262344 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 05:20:14.262344 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 05:20:14.262344 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 05:20:14.262344 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 05:20:14.262344 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 11 05:20:14.262344 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:20:14.262344 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 636/1267] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:20:14 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:20:14.267211 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64240263-f0ea-4616-9757-d12f3b95d06c None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:20:14.367928 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64240263-f0ea-4616-9757-d12f3b95d06c None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:20:14.406108 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a50a536-5396-45f7-b30f-e70c260c3c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:20:14.406757 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a50a536-5396-45f7-b30f-e70c260c3c17 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:20:14.407068 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a50a536-5396-45f7-b30f-e70c260c3c17 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:20:14.407368 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a50a536-5396-45f7-b30f-e70c260c3c17 None admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:20:14.408192 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a50a536-5396-45f7-b30f-e70c260c3c17 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:20:14.408522 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a50a536-5396-45f7-b30f-e70c260c3c17 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:20:14.410013 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a50a536-5396-45f7-b30f-e70c260c3c17 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:20:14.418854 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:20:14.428014 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 632/1268] 10.222.0.16 () {56 vars in 1143 bytes} [Sun Sep 11 05:20:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:20:14.433792 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c23001c-ef02-4a85-970f-06857aecdebd None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:20:14.529049 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c23001c-ef02-4a85-970f-06857aecdebd None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:20:14.561430 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec36b7c-b9dd-4a50-8668-343345566d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:20:14.562034 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec36b7c-b9dd-4a50-8668-343345566d07 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:20:14.562309 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec36b7c-b9dd-4a50-8668-343345566d07 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:20:14.562576 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec36b7c-b9dd-4a50-8668-343345566d07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:20:14.572573 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec36b7c-b9dd-4a50-8668-343345566d07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:20:14.573984 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec36b7c-b9dd-4a50-8668-343345566d07 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:20:14.587470 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-4ec36b7c-b9dd-4a50-8668-343345566d07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:20:14.587470 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:20:14.587470 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:20:14.587470 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:20:14.587470 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:20:14.587470 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:20:14.587470 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:20:14.587470 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:20:14.587470 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:20:14.587470 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:20:14.587470 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:20:14.587470 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:20:14.587470 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 05:20:14.587470 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 05:20:14.587470 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 05:20:14.587470 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 05:20:14.588581 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:20:14.588581 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:20:14.588581 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:20:14.588581 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:20:14.588581 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:20:14.588581 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:20:14.588581 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:20:14.588581 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:20:14.588581 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:20:14.588581 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:20:14.588581 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:20:14.588581 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:20:14.588581 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:20:14.588581 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:20:14.588581 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:20:14.588581 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:20:14.588581 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 05:20:14.589681 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 05:20:14.589681 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:20:14.589681 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:20:14.591825 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 637/1269] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:20:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:20:14.594546 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a50a536-5396-45f7-b30f-e70c260c3c17 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:20:14.691242 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a50a536-5396-45f7-b30f-e70c260c3c17 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:20:14.724017 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af735b6-5380-4b5f-86cb-21fab8993bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:20:14.724611 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af735b6-5380-4b5f-86cb-21fab8993bc9 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:20:14.724893 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af735b6-5380-4b5f-86cb-21fab8993bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:20:14.725169 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af735b6-5380-4b5f-86cb-21fab8993bc9 None admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:20:14.725806 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af735b6-5380-4b5f-86cb-21fab8993bc9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:20:14.726112 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af735b6-5380-4b5f-86cb-21fab8993bc9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:20:14.727486 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af735b6-5380-4b5f-86cb-21fab8993bc9 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:20:14.738832 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 633/1270] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 05:20:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:20:14.744475 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec36b7c-b9dd-4a50-8668-343345566d07 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:20:14.774745 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:20:14.843944 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec36b7c-b9dd-4a50-8668-343345566d07 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:20:14.875535 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc32a95a-2ef8-4f5d-8f86-0cc2ce5f13d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:20:14.876170 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc32a95a-2ef8-4f5d-8f86-0cc2ce5f13d8 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:20:14.876446 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc32a95a-2ef8-4f5d-8f86-0cc2ce5f13d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:20:14.876708 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc32a95a-2ef8-4f5d-8f86-0cc2ce5f13d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:20:14.882994 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc32a95a-2ef8-4f5d-8f86-0cc2ce5f13d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:20:14.884442 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc32a95a-2ef8-4f5d-8f86-0cc2ce5f13d8 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:20:14.895699 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-fc32a95a-2ef8-4f5d-8f86-0cc2ce5f13d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 05:20:14.895699 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:20:14.895699 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:20:14.895699 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:20:14.895699 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:20:14.895699 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:20:14.895699 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:20:14.895699 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:20:14.895699 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:20:14.895699 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:20:14.895699 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:20:14.895699 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:20:14.895699 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 05:20:14.895699 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 05:20:14.895699 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 05:20:14.896729 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 05:20:14.896729 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:20:14.896729 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:20:14.896729 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:20:14.896729 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:20:14.896729 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:20:14.896729 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:20:14.896729 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:20:14.896729 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:20:14.896729 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:20:14.896729 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:20:14.896729 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:20:14.896729 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:20:14.896729 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:20:14.896729 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:20:14.896729 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:20:14.896729 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:20:14.897744 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 05:20:14.897744 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 05:20:14.897744 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 05:20:14.897744 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 05:20:14.897744 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 05:20:14.897744 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 05:20:14.897744 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 05:20:14.897744 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:20:14.897744 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 638/1271] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 05:20:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:20:14.902512 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af735b6-5380-4b5f-86cb-21fab8993bc9 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:20:14.959448 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:20:15.001086 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af735b6-5380-4b5f-86cb-21fab8993bc9 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:20:15.033644 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73af52a-6ceb-429c-8ccd-0c99b7679a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:20:15.034231 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73af52a-6ceb-429c-8ccd-0c99b7679a87 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:20:15.034502 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73af52a-6ceb-429c-8ccd-0c99b7679a87 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:20:15.034765 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73af52a-6ceb-429c-8ccd-0c99b7679a87 None admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:20:15.035440 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73af52a-6ceb-429c-8ccd-0c99b7679a87 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:20:15.035763 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73af52a-6ceb-429c-8ccd-0c99b7679a87 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:20:15.037176 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73af52a-6ceb-429c-8ccd-0c99b7679a87 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:20:15.048527 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 634/1272] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 05:20:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:20:15.054340 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc32a95a-2ef8-4f5d-8f86-0cc2ce5f13d8 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:20:15.142739 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:20:15.151801 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc32a95a-2ef8-4f5d-8f86-0cc2ce5f13d8 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:20:15.185954 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3689a5da-708f-45c8-88fa-50debae8a36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:20:15.186766 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3689a5da-708f-45c8-88fa-50debae8a36c None admin] REQUEST_METHOD: `PUT` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:20:15.187065 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3689a5da-708f-45c8-88fa-50debae8a36c None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:20:15.187372 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3689a5da-708f-45c8-88fa-50debae8a36c None admin] PATH_INFO: `/v3/projects/61ffb079d9e1437084945554bcc0747b/users/72e1d7dd79ff43e7b585b5090762465f/roles/5b702713e40145b49e0b42abd0a5fba9` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:20:15.189650 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3689a5da-708f-45c8-88fa-50debae8a36c None admin] RBAC: Authorizing `identity:create_grant(project_id=61ffb079d9e1437084945554bcc0747b, user_id=72e1d7dd79ff43e7b585b5090762465f, role_id=5b702713e40145b49e0b42abd0a5fba9)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:20:15.191461 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3689a5da-708f-45c8-88fa-50debae8a36c None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:20:15.206321 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 639/1273] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 11 05:20:15 2022] PUT /identity/v3/projects/61ffb079d9e1437084945554bcc0747b/users/72e1d7dd79ff43e7b585b5090762465f/roles/5b702713e40145b49e0b42abd0a5fba9 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:20:17.311046 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e122b2-9e4a-4eae-93cb-af3ff95a5cfa None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:20:17.311588 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e122b2-9e4a-4eae-93cb-af3ff95a5cfa None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:20:17.311812 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e122b2-9e4a-4eae-93cb-af3ff95a5cfa None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:20:17.313526 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 635/1274] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:20:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:20:17.318722 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08143f66-968a-4d53-a980-07e7b1885b98 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:20:17.319142 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08143f66-968a-4d53-a980-07e7b1885b98 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:20:17.319269 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08143f66-968a-4d53-a980-07e7b1885b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:20:17.336875 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-08143f66-968a-4d53-a980-07e7b1885b98 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:20:17.338043 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-08143f66-968a-4d53-a980-07e7b1885b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:20:17.403744 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 640/1275] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:20:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 05:20:17.671651 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e122b2-9e4a-4eae-93cb-af3ff95a5cfa None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:20:17.768692 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e122b2-9e4a-4eae-93cb-af3ff95a5cfa None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:20:17.785828 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:20:17.802790 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea26ecf8-fdf9-473f-b0ac-09a38f7d83c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:20:17.803406 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea26ecf8-fdf9-473f-b0ac-09a38f7d83c4 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:20:17.803699 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea26ecf8-fdf9-473f-b0ac-09a38f7d83c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:20:17.803971 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea26ecf8-fdf9-473f-b0ac-09a38f7d83c4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:20:17.813804 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea26ecf8-fdf9-473f-b0ac-09a38f7d83c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 05:20:17.818567 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-ea26ecf8-fdf9-473f-b0ac-09a38f7d83c4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 05:20:17.818567 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:20:17.818567 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:20:17.818567 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:20:17.818567 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:20:17.818567 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:20:17.818567 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:20:17.818567 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:20:17.818567 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:20:17.818567 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:20:17.818567 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:20:17.818567 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:20:17.818567 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 05:20:17.818567 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 05:20:17.818567 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 05:20:17.818567 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 05:20:17.819671 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 05:20:17.819671 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 05:20:17.819671 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 05:20:17.819671 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 05:20:17.819671 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:20:17.819671 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:20:17.819671 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:20:17.819671 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:20:17.819671 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:20:17.819671 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:20:17.819671 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:20:17.819671 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:20:17.819671 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:20:17.819671 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:20:17.819671 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:20:17.819671 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:20:17.820863 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:20:17.820863 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:20:17.820863 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:20:17.820863 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:20:17.820863 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 05:20:17.820863 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 05:20:17.820863 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 05:20:17.820863 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 05:20:17.820863 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 05:20:17.820863 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 05:20:17.820863 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 05:20:17.820863 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:20:17.820863 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 636/1276] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 05:20:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:20:17.825550 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08143f66-968a-4d53-a980-07e7b1885b98 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:20:17.902517 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:20:17.921514 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08143f66-968a-4d53-a980-07e7b1885b98 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:20:17.953964 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0fb3f9-38bd-4500-b057-029da4430442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:20:17.954501 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0fb3f9-38bd-4500-b057-029da4430442 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:20:17.954780 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0fb3f9-38bd-4500-b057-029da4430442 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:20:17.955049 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0fb3f9-38bd-4500-b057-029da4430442 None admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:20:17.955732 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0fb3f9-38bd-4500-b057-029da4430442 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:20:17.956038 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0fb3f9-38bd-4500-b057-029da4430442 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:20:17.957398 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0fb3f9-38bd-4500-b057-029da4430442 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:20:17.965101 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 641/1277] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 05:20:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:20:17.971293 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea26ecf8-fdf9-473f-b0ac-09a38f7d83c4 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:20:18.066595 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea26ecf8-fdf9-473f-b0ac-09a38f7d83c4 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:20:18.099915 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c3e007-0baf-4856-983e-358c9c4293a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:20:18.100524 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c3e007-0baf-4856-983e-358c9c4293a4 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:20:18.100802 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c3e007-0baf-4856-983e-358c9c4293a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:20:18.101073 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c3e007-0baf-4856-983e-358c9c4293a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:20:18.110704 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c3e007-0baf-4856-983e-358c9c4293a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:20:18.112187 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c3e007-0baf-4856-983e-358c9c4293a4 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:20:18.126412 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-15c3e007-0baf-4856-983e-358c9c4293a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:20:18.126412 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:20:18.126412 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:20:18.126412 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:20:18.126412 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:20:18.126412 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:20:18.126412 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:20:18.126412 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:20:18.126412 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:20:18.126412 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:20:18.126412 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:20:18.126412 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:20:18.126412 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 05:20:18.126412 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 05:20:18.126412 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 05:20:18.126412 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 05:20:18.127539 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:20:18.127539 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:20:18.127539 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:20:18.127539 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:20:18.127539 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:20:18.127539 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:20:18.127539 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:20:18.127539 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:20:18.127539 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:20:18.127539 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:20:18.127539 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:20:18.127539 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:20:18.127539 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:20:18.127539 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:20:18.127539 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:20:18.127539 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:20:18.127539 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 05:20:18.128755 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 05:20:18.128755 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:20:18.128755 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:20:18.128755 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 637/1278] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:20:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:20:18.133227 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0fb3f9-38bd-4500-b057-029da4430442 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:20:18.234416 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0fb3f9-38bd-4500-b057-029da4430442 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:20:18.268480 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7946e19f-a5e4-4444-aa36-de574f447d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:20:18.269107 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7946e19f-a5e4-4444-aa36-de574f447d87 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:20:18.269386 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7946e19f-a5e4-4444-aa36-de574f447d87 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:20:18.269659 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7946e19f-a5e4-4444-aa36-de574f447d87 None admin] PATH_INFO: `/v3/domains` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:20:18.270292 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7946e19f-a5e4-4444-aa36-de574f447d87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:20:18.270594 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7946e19f-a5e4-4444-aa36-de574f447d87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:20:18.271985 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7946e19f-a5e4-4444-aa36-de574f447d87 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:20:18.283304 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 642/1279] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 05:20:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:20:18.291373 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c3e007-0baf-4856-983e-358c9c4293a4 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:20:18.321178 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:20:18.389052 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c3e007-0baf-4856-983e-358c9c4293a4 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:20:18.423635 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c186325-fad8-45bb-a8d5-9d504c18de42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:20:18.424279 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c186325-fad8-45bb-a8d5-9d504c18de42 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:20:18.424553 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c186325-fad8-45bb-a8d5-9d504c18de42 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:20:18.424821 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c186325-fad8-45bb-a8d5-9d504c18de42 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:20:18.431861 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c186325-fad8-45bb-a8d5-9d504c18de42 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:20:18.433294 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c186325-fad8-45bb-a8d5-9d504c18de42 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:20:18.444469 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-8c186325-fad8-45bb-a8d5-9d504c18de42 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 11 05:20:18.444469 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:20:18.444469 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:20:18.444469 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:20:18.444469 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:20:18.444469 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:20:18.444469 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:20:18.444469 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:20:18.444469 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:20:18.444469 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:20:18.444469 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:20:18.444469 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:20:18.444469 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 05:20:18.444469 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 05:20:18.444469 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 05:20:18.444469 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 05:20:18.445626 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:20:18.445626 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:20:18.445626 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 05:20:18.445626 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 05:20:18.445626 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 05:20:18.445626 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 05:20:18.445626 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:20:18.445626 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:20:18.445626 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:20:18.445626 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:20:18.445626 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:20:18.445626 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:20:18.445626 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:20:18.445626 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:20:18.445626 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:20:18.445626 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:20:18.445626 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:20:18.445626 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:20:18.446979 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:20:18.446979 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:20:18.446979 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 05:20:18.446979 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 05:20:18.446979 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 05:20:18.446979 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 05:20:18.446979 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 05:20:18.446979 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 05:20:18.446979 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 11 05:20:18.446979 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:20:18.446979 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 638/1280] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:20:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:20:18.451458 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7946e19f-a5e4-4444-aa36-de574f447d87 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:20:18.455820 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:20:18.546469 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7946e19f-a5e4-4444-aa36-de574f447d87 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:20:18.579389 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcf0391-2d05-4e5e-b00f-fdb7182a5fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:20:18.580018 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcf0391-2d05-4e5e-b00f-fdb7182a5fc6 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:20:18.580298 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcf0391-2d05-4e5e-b00f-fdb7182a5fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:20:18.580568 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcf0391-2d05-4e5e-b00f-fdb7182a5fc6 None admin] PATH_INFO: `/v3/users` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:20:18.581285 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcf0391-2d05-4e5e-b00f-fdb7182a5fc6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:20:18.581591 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcf0391-2d05-4e5e-b00f-fdb7182a5fc6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:20:18.583007 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcf0391-2d05-4e5e-b00f-fdb7182a5fc6 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:20:18.599468 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 643/1281] 10.222.0.16 () {56 vars in 1143 bytes} [Sun Sep 11 05:20:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:20:18.605108 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c186325-fad8-45bb-a8d5-9d504c18de42 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:20:18.694569 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:20:18.704343 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c186325-fad8-45bb-a8d5-9d504c18de42 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:20:18.736690 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9e24cd-cee2-471b-a28f-c7e64a9c032a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:20:18.737290 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e24cd-cee2-471b-a28f-c7e64a9c032a None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:20:18.737569 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e24cd-cee2-471b-a28f-c7e64a9c032a None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:20:18.737842 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e24cd-cee2-471b-a28f-c7e64a9c032a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:20:18.803136 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9e24cd-cee2-471b-a28f-c7e64a9c032a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:20:18.804582 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9e24cd-cee2-471b-a28f-c7e64a9c032a None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:20:18.890022 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:20:18.900340 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 639/1282] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 05:20:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 05:20:18.906137 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcf0391-2d05-4e5e-b00f-fdb7182a5fc6 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:20:18.974643 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:20:19.022585 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcf0391-2d05-4e5e-b00f-fdb7182a5fc6 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:20:19.055938 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aca9c2-21ee-4295-a51e-0bfb901a9b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:20:19.056501 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aca9c2-21ee-4295-a51e-0bfb901a9b8b None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:20:19.056780 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aca9c2-21ee-4295-a51e-0bfb901a9b8b None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:20:19.057058 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aca9c2-21ee-4295-a51e-0bfb901a9b8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:20:19.066726 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aca9c2-21ee-4295-a51e-0bfb901a9b8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:20:19.068199 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aca9c2-21ee-4295-a51e-0bfb901a9b8b None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:20:19.082366 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-81aca9c2-21ee-4295-a51e-0bfb901a9b8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:20:19.082366 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:20:19.082366 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:20:19.082366 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:20:19.082366 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:20:19.082366 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:20:19.082366 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:20:19.082366 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:20:19.082366 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:20:19.082366 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:20:19.082366 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:20:19.082366 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:20:19.082366 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 05:20:19.082366 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 05:20:19.082366 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 05:20:19.082366 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 05:20:19.083462 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:20:19.083462 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:20:19.083462 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:20:19.083462 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:20:19.083462 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:20:19.083462 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:20:19.083462 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:20:19.083462 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:20:19.083462 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:20:19.083462 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:20:19.083462 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:20:19.083462 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:20:19.083462 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:20:19.083462 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:20:19.083462 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:20:19.083462 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:20:19.083462 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 05:20:19.084440 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 05:20:19.084440 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 05:20:19.084440 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:20:19.084440 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 644/1283] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:20:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:20:19.089241 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9e24cd-cee2-471b-a28f-c7e64a9c032a None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:20:19.185801 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9e24cd-cee2-471b-a28f-c7e64a9c032a None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:20:19.219561 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7066c098-f974-4617-a720-7d0bb6c78dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:20:19.220190 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7066c098-f974-4617-a720-7d0bb6c78dea None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:20:19.220469 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7066c098-f974-4617-a720-7d0bb6c78dea None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:20:19.220735 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7066c098-f974-4617-a720-7d0bb6c78dea None admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:20:19.221367 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7066c098-f974-4617-a720-7d0bb6c78dea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:20:19.221671 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7066c098-f974-4617-a720-7d0bb6c78dea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:20:19.223030 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7066c098-f974-4617-a720-7d0bb6c78dea None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:20:19.234482 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 640/1284] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 05:20:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:20:19.240096 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aca9c2-21ee-4295-a51e-0bfb901a9b8b None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:20:19.340208 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aca9c2-21ee-4295-a51e-0bfb901a9b8b None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:20:19.355107 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:20:19.376142 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baeacc2-7bd9-489d-b4ac-eca774adf42f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:20:19.376771 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baeacc2-7bd9-489d-b4ac-eca774adf42f None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:20:19.377050 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baeacc2-7bd9-489d-b4ac-eca774adf42f None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:20:19.377325 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baeacc2-7bd9-489d-b4ac-eca774adf42f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:20:19.383740 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baeacc2-7bd9-489d-b4ac-eca774adf42f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:20:19.385177 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baeacc2-7bd9-489d-b4ac-eca774adf42f None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:20:19.396773 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application [None req-1baeacc2-7bd9-489d-b4ac-eca774adf42f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 05:20:19.396773 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:20:19.396773 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:20:19.396773 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:20:19.396773 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:20:19.396773 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:20:19.396773 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:20:19.396773 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:20:19.396773 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:20:19.396773 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:20:19.396773 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:20:19.396773 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:20:19.396773 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 05:20:19.396773 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 05:20:19.396773 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 05:20:19.397850 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 05:20:19.397850 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:20:19.397850 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:20:19.397850 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:20:19.397850 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:20:19.397850 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:20:19.397850 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:20:19.397850 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:20:19.397850 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application with Lock( Sep 11 05:20:19.397850 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:20:19.397850 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:20:19.397850 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:20:19.397850 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:20:19.397850 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:20:19.397850 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:20:19.397850 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:20:19.397850 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:20:19.398905 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 05:20:19.398905 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 05:20:19.398905 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 05:20:19.398905 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 05:20:19.398905 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 05:20:19.398905 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 05:20:19.398905 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 05:20:19.398905 dv-cinder-856921-1-smb devstack@keystone.service[81383]: ERROR keystone.server.flask.application Sep 11 05:20:19.398905 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 645/1285] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 05:20:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:20:19.403783 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7066c098-f974-4617-a720-7d0bb6c78dea None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:20:19.451481 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:20:19.500386 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7066c098-f974-4617-a720-7d0bb6c78dea None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:20:19.532630 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e0c031-c716-4785-9b42-b34222b20319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:20:19.533215 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0c031-c716-4785-9b42-b34222b20319 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:20:19.533492 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0c031-c716-4785-9b42-b34222b20319 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:20:19.533758 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0c031-c716-4785-9b42-b34222b20319 None admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:20:19.534433 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e0c031-c716-4785-9b42-b34222b20319 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:20:19.534733 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e0c031-c716-4785-9b42-b34222b20319 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:20:19.536180 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e0c031-c716-4785-9b42-b34222b20319 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:20:19.547455 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 641/1286] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 05:20:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:20:19.553350 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baeacc2-7bd9-489d-b4ac-eca774adf42f None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:20:19.649779 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baeacc2-7bd9-489d-b4ac-eca774adf42f None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:20:19.682209 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c882672-3551-4870-a4f6-0aab997c3f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:20:19.682794 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c882672-3551-4870-a4f6-0aab997c3f34 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:20:19.683069 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c882672-3551-4870-a4f6-0aab997c3f34 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:20:19.683336 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c882672-3551-4870-a4f6-0aab997c3f34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:20:19.684076 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c882672-3551-4870-a4f6-0aab997c3f34 None admin] RBAC: Adding query filter params (role.id=5b702713e40145b49e0b42abd0a5fba9, scope.project.id=61ffb079d9e1437084945554bcc0747b, user.id=72e1d7dd79ff43e7b585b5090762465f) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:20:19.684429 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c882672-3551-4870-a4f6-0aab997c3f34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:20:19.685836 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c882672-3551-4870-a4f6-0aab997c3f34 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:20:19.691388 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 646/1287] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 05:20:19 2022] GET /identity/v3/role_assignments?user.id=72e1d7dd79ff43e7b585b5090762465f&scope.project.id=61ffb079d9e1437084945554bcc0747b&role.id=5b702713e40145b49e0b42abd0a5fba9 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:20:21.810896 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4799945-481c-47ba-ad6d-f5b79d4095aa None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:20:21.811307 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4799945-481c-47ba-ad6d-f5b79d4095aa None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:20:21.811448 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4799945-481c-47ba-ad6d-f5b79d4095aa None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:20:21.812821 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 642/1288] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:20:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:20:21.817897 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a434332-f233-467b-baa1-fb6b58eb6c1e None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:20:21.818270 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a434332-f233-467b-baa1-fb6b58eb6c1e None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:20:21.818437 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a434332-f233-467b-baa1-fb6b58eb6c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:20:21.836608 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-4a434332-f233-467b-baa1-fb6b58eb6c1e None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:20:21.837772 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-4a434332-f233-467b-baa1-fb6b58eb6c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:20:21.866153 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:20:21.901835 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 647/1289] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:20:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 05:20:22.169123 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4799945-481c-47ba-ad6d-f5b79d4095aa None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:20:22.277480 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4799945-481c-47ba-ad6d-f5b79d4095aa None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:20:22.287858 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:20:22.310337 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8f4ad1-c3e6-4c28-84fc-03c86a7f293b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:20:22.311464 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f4ad1-c3e6-4c28-84fc-03c86a7f293b None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:20:22.311768 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f4ad1-c3e6-4c28-84fc-03c86a7f293b None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:20:22.312043 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f4ad1-c3e6-4c28-84fc-03c86a7f293b None admin] PATH_INFO: `/v3/services/placement` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:20:22.312626 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8f4ad1-c3e6-4c28-84fc-03c86a7f293b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:20:22.314001 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8f4ad1-c3e6-4c28-84fc-03c86a7f293b None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:20:22.322482 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-da8f4ad1-c3e6-4c28-84fc-03c86a7f293b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 11 05:20:22.322482 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:20:22.322482 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 05:20:22.322482 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 05:20:22.322482 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 05:20:22.322482 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 05:20:22.322482 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 05:20:22.322482 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 05:20:22.322482 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 11 05:20:22.322482 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:20:22.322482 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 05:20:22.322482 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:20:22.322482 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:20:22.322482 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:20:22.322482 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:20:22.322482 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:20:22.322482 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:20:22.323739 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:20:22.323739 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:20:22.323739 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:20:22.323739 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:20:22.323739 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:20:22.323739 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:20:22.323739 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 05:20:22.323739 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 05:20:22.323739 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 05:20:22.323739 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 05:20:22.323739 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:20:22.323739 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:20:22.323739 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:20:22.323739 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:20:22.323739 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:20:22.323739 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:20:22.324825 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:20:22.324825 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:20:22.324825 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:20:22.324825 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:20:22.324825 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:20:22.324825 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:20:22.324825 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:20:22.324825 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:20:22.324825 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:20:22.324825 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:20:22.324825 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 05:20:22.324825 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 05:20:22.324825 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 11 05:20:22.324825 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:20:22.324825 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 643/1290] 10.222.0.16 () {56 vars in 1117 bytes} [Sun Sep 11 05:20:22 2022] GET /identity/v3/services/placement => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:20:22.330141 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a434332-f233-467b-baa1-fb6b58eb6c1e None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:20:22.431066 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a434332-f233-467b-baa1-fb6b58eb6c1e None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:20:22.465083 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6157540-adbd-454c-8c8a-0b28a6db400f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:20:22.465688 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6157540-adbd-454c-8c8a-0b28a6db400f None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:20:22.465965 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6157540-adbd-454c-8c8a-0b28a6db400f None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:20:22.466238 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6157540-adbd-454c-8c8a-0b28a6db400f None admin] PATH_INFO: `/v3/services` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:20:22.466866 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6157540-adbd-454c-8c8a-0b28a6db400f None admin] RBAC: Adding query filter params (name=placement) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:20:22.467198 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6157540-adbd-454c-8c8a-0b28a6db400f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:20:22.468598 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6157540-adbd-454c-8c8a-0b28a6db400f None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:20:22.473277 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 648/1291] 10.222.0.16 () {56 vars in 1116 bytes} [Sun Sep 11 05:20:22 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:20:22.478940 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8f4ad1-c3e6-4c28-84fc-03c86a7f293b None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:20:22.576302 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8f4ad1-c3e6-4c28-84fc-03c86a7f293b None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:20:22.607578 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e2928b-864b-491f-979d-b96e29f006fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:20:22.608730 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2928b-864b-491f-979d-b96e29f006fb None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:20:22.609001 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2928b-864b-491f-979d-b96e29f006fb None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:20:22.609267 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2928b-864b-491f-979d-b96e29f006fb None admin] PATH_INFO: `/v3/services` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:20:22.609883 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e2928b-864b-491f-979d-b96e29f006fb None admin] RBAC: Adding query filter params (type=placement) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:20:22.610183 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e2928b-864b-491f-979d-b96e29f006fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:20:22.611546 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e2928b-864b-491f-979d-b96e29f006fb None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:20:22.615734 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 644/1292] 10.222.0.16 () {56 vars in 1116 bytes} [Sun Sep 11 05:20:22 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:20:24.940699 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5361e482-2e5f-4953-a127-22d5873c0b09 None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:20:24.941247 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5361e482-2e5f-4953-a127-22d5873c0b09 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:20:24.941247 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5361e482-2e5f-4953-a127-22d5873c0b09 None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:20:24.942563 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 649/1293] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:20:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:20:24.947802 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20345520-74a7-4808-ae4d-a0d2c333971d None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:20:24.948178 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20345520-74a7-4808-ae4d-a0d2c333971d None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:20:24.948353 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20345520-74a7-4808-ae4d-a0d2c333971d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:20:24.976890 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-20345520-74a7-4808-ae4d-a0d2c333971d None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:20:24.978085 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-20345520-74a7-4808-ae4d-a0d2c333971d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:20:25.012502 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:20:25.054582 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 645/1294] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:20:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 05:20:25.466879 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5361e482-2e5f-4953-a127-22d5873c0b09 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:20:25.499601 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:20:25.570479 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5361e482-2e5f-4953-a127-22d5873c0b09 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:20:25.607395 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d753db39-e230-41e5-9f12-89cd88658102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:20:25.608256 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d753db39-e230-41e5-9f12-89cd88658102 None admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:20:25.608615 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d753db39-e230-41e5-9f12-89cd88658102 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:20:25.608908 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d753db39-e230-41e5-9f12-89cd88658102 None admin] PATH_INFO: `/v3/services` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:20:25.609572 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d753db39-e230-41e5-9f12-89cd88658102 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:20:25.610936 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d753db39-e230-41e5-9f12-89cd88658102 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:20:25.625021 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 650/1295] 10.222.0.16 () {60 vars in 1141 bytes} [Sun Sep 11 05:20:25 2022] POST /identity/v3/services => generated 246 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:20:27.809702 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360174ae-d9dd-4457-b673-7a0d9db03dbe None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:20:27.810112 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360174ae-d9dd-4457-b673-7a0d9db03dbe None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:20:27.810253 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360174ae-d9dd-4457-b673-7a0d9db03dbe None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:20:27.811614 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 646/1296] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:20:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:20:27.816847 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa6550-72a3-4c86-8e48-f03a3c580a66 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:20:27.817261 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa6550-72a3-4c86-8e48-f03a3c580a66 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:20:27.817389 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa6550-72a3-4c86-8e48-f03a3c580a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:20:27.835500 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-fefa6550-72a3-4c86-8e48-f03a3c580a66 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:20:27.836704 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-fefa6550-72a3-4c86-8e48-f03a3c580a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:20:27.907239 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 651/1297] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:20:27 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 05:20:28.172839 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360174ae-d9dd-4457-b673-7a0d9db03dbe None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:20:28.280280 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360174ae-d9dd-4457-b673-7a0d9db03dbe None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:20:28.319021 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dda0d7-7ba0-491d-b580-ad71da0672d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:20:28.319647 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dda0d7-7ba0-491d-b580-ad71da0672d3 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:20:28.319953 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dda0d7-7ba0-491d-b580-ad71da0672d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:20:28.320225 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dda0d7-7ba0-491d-b580-ad71da0672d3 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:20:28.321256 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dda0d7-7ba0-491d-b580-ad71da0672d3 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:20:28.323162 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dda0d7-7ba0-491d-b580-ad71da0672d3 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:20:28.332460 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-35dda0d7-7ba0-491d-b580-ad71da0672d3 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 11 05:20:28.332460 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:20:28.332460 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 05:20:28.332460 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 05:20:28.332460 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 05:20:28.332460 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 05:20:28.332460 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 05:20:28.332460 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 05:20:28.332460 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 11 05:20:28.332460 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:20:28.332460 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 05:20:28.332460 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:20:28.332460 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:20:28.332460 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:20:28.332460 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:20:28.332460 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:20:28.332460 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:20:28.333641 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:20:28.333641 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:20:28.333641 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:20:28.333641 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:20:28.333641 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:20:28.333641 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:20:28.333641 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 05:20:28.333641 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 05:20:28.333641 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 05:20:28.333641 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 05:20:28.333641 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:20:28.333641 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:20:28.333641 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:20:28.333641 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:20:28.333641 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:20:28.333641 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:20:28.334698 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:20:28.334698 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:20:28.334698 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:20:28.334698 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:20:28.334698 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:20:28.334698 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:20:28.334698 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:20:28.334698 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:20:28.334698 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:20:28.334698 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:20:28.334698 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 05:20:28.334698 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 05:20:28.334698 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 11 05:20:28.334698 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:20:28.334698 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 647/1298] 10.222.0.16 () {56 vars in 1117 bytes} [Sun Sep 11 05:20:28 2022] GET /identity/v3/services/placement => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:20:28.341844 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefa6550-72a3-4c86-8e48-f03a3c580a66 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:20:28.359871 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:20:28.438112 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefa6550-72a3-4c86-8e48-f03a3c580a66 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:20:28.469548 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a6b524-85b1-4514-a3ca-8c03b795a8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:20:28.470145 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a6b524-85b1-4514-a3ca-8c03b795a8e5 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:20:28.470420 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a6b524-85b1-4514-a3ca-8c03b795a8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:20:28.470689 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a6b524-85b1-4514-a3ca-8c03b795a8e5 None admin] PATH_INFO: `/v3/services` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:20:28.471305 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a6b524-85b1-4514-a3ca-8c03b795a8e5 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:20:28.471601 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a6b524-85b1-4514-a3ca-8c03b795a8e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:20:28.472984 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a6b524-85b1-4514-a3ca-8c03b795a8e5 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:20:28.478471 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 652/1299] 10.222.0.16 () {56 vars in 1116 bytes} [Sun Sep 11 05:20:28 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:20:28.484807 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dda0d7-7ba0-491d-b580-ad71da0672d3 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:20:28.516047 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:20:28.584401 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dda0d7-7ba0-491d-b580-ad71da0672d3 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:20:28.617090 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb306d3-7c42-4d9c-b646-6f5f81203690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:20:28.617687 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb306d3-7c42-4d9c-b646-6f5f81203690 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:20:28.617963 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb306d3-7c42-4d9c-b646-6f5f81203690 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:20:28.618233 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb306d3-7c42-4d9c-b646-6f5f81203690 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:20:28.618923 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb306d3-7c42-4d9c-b646-6f5f81203690 None admin] RBAC: Adding query filter params (interface=public, service_id=8aec474e3d47497aaa08dc78a6cdff33, region_id=RegionOne) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:20:28.619229 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb306d3-7c42-4d9c-b646-6f5f81203690 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:20:28.620623 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb306d3-7c42-4d9c-b646-6f5f81203690 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:20:28.625555 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 648/1300] 10.222.0.16 () {56 vars in 1251 bytes} [Sun Sep 11 05:20:28 2022] GET /identity/v3/endpoints?service_id=8aec474e3d47497aaa08dc78a6cdff33&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:20:28.631127 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a6b524-85b1-4514-a3ca-8c03b795a8e5 None admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:20:28.716181 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:20:28.734402 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a6b524-85b1-4514-a3ca-8c03b795a8e5 None admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:20:28.767705 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9162f1-3ce9-4be7-b855-c05af76f1f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:20:28.768309 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9162f1-3ce9-4be7-b855-c05af76f1f5e None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:20:28.768584 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9162f1-3ce9-4be7-b855-c05af76f1f5e None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:20:28.768849 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9162f1-3ce9-4be7-b855-c05af76f1f5e None admin] PATH_INFO: `/v3/services` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:20:28.769442 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9162f1-3ce9-4be7-b855-c05af76f1f5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:20:28.770783 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9162f1-3ce9-4be7-b855-c05af76f1f5e None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:20:28.777462 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 653/1301] 10.222.0.16 () {56 vars in 1087 bytes} [Sun Sep 11 05:20:28 2022] GET /identity/v3/services => generated 2191 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:20:30.881188 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e6ee04-77e1-4957-a467-2984e7d0fe4e None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:20:30.881691 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e6ee04-77e1-4957-a467-2984e7d0fe4e None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:20:30.881802 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e6ee04-77e1-4957-a467-2984e7d0fe4e None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:20:30.883050 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 649/1302] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:20:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:20:30.888168 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac19e03-4c7a-434b-864e-52bf08aa4baa None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:20:30.889050 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac19e03-4c7a-434b-864e-52bf08aa4baa None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:20:30.889258 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac19e03-4c7a-434b-864e-52bf08aa4baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:20:30.906821 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-fac19e03-4c7a-434b-864e-52bf08aa4baa None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:20:30.908011 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-fac19e03-4c7a-434b-864e-52bf08aa4baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:20:30.971427 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 654/1303] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:20:30 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 05:20:31.245220 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e6ee04-77e1-4957-a467-2984e7d0fe4e None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:20:31.335903 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:20:31.343154 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e6ee04-77e1-4957-a467-2984e7d0fe4e None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:20:31.377067 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a48751-c67e-493f-b8f2-260f077470cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:20:31.377684 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a48751-c67e-493f-b8f2-260f077470cd None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:20:31.377958 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a48751-c67e-493f-b8f2-260f077470cd None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:20:31.378226 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a48751-c67e-493f-b8f2-260f077470cd None admin] PATH_INFO: `/v3/services/placement` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:20:31.378806 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a48751-c67e-493f-b8f2-260f077470cd None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:20:31.380209 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a48751-c67e-493f-b8f2-260f077470cd None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:20:31.389237 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-96a48751-c67e-493f-b8f2-260f077470cd None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 11 05:20:31.389237 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:20:31.389237 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 05:20:31.389237 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 05:20:31.389237 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 05:20:31.389237 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 05:20:31.389237 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 05:20:31.389237 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 05:20:31.389237 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 11 05:20:31.389237 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:20:31.389237 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 05:20:31.389237 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:20:31.389237 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 05:20:31.389237 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 05:20:31.389237 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 05:20:31.389237 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 05:20:31.389237 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 05:20:31.390408 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 05:20:31.390408 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 05:20:31.390408 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 05:20:31.390408 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 05:20:31.390408 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 05:20:31.390408 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 05:20:31.390408 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 05:20:31.390408 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 05:20:31.390408 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 05:20:31.390408 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 05:20:31.390408 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 05:20:31.390408 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 05:20:31.390408 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 05:20:31.390408 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 05:20:31.390408 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 05:20:31.390408 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 05:20:31.391560 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 05:20:31.391560 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 11 05:20:31.391560 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 05:20:31.391560 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 11 05:20:31.391560 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 05:20:31.391560 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 05:20:31.391560 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 05:20:31.391560 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 11 05:20:31.391560 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 05:20:31.391560 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 11 05:20:31.391560 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 05:20:31.391560 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 05:20:31.391560 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 11 05:20:31.391560 dv-cinder-856921-1-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 11 05:20:31.391560 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 650/1304] 10.222.0.16 () {56 vars in 1117 bytes} [Sun Sep 11 05:20:31 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 05:20:31.396345 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac19e03-4c7a-434b-864e-52bf08aa4baa None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:20:31.469178 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:20:31.490917 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac19e03-4c7a-434b-864e-52bf08aa4baa None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:20:31.523435 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a1f631-8463-4799-b446-454e18959692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:20:31.524002 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a1f631-8463-4799-b446-454e18959692 None admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:20:31.524279 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a1f631-8463-4799-b446-454e18959692 None admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:20:31.524547 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a1f631-8463-4799-b446-454e18959692 None admin] PATH_INFO: `/v3/services` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:20:31.525163 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a1f631-8463-4799-b446-454e18959692 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:20:31.525459 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a1f631-8463-4799-b446-454e18959692 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:20:31.526801 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a1f631-8463-4799-b446-454e18959692 None admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:20:31.532273 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 655/1305] 10.222.0.16 () {56 vars in 1116 bytes} [Sun Sep 11 05:20:31 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:20:31.538036 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a48751-c67e-493f-b8f2-260f077470cd None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:20:31.634013 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a48751-c67e-493f-b8f2-260f077470cd None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:20:31.670312 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a62dcd-1152-4f48-ab5c-390f7629a68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:20:31.670906 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a62dcd-1152-4f48-ab5c-390f7629a68a None admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:20:31.671181 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a62dcd-1152-4f48-ab5c-390f7629a68a None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:20:31.671454 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a62dcd-1152-4f48-ab5c-390f7629a68a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:20:31.672146 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a62dcd-1152-4f48-ab5c-390f7629a68a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:20:31.673510 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a62dcd-1152-4f48-ab5c-390f7629a68a None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:20:31.691911 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 651/1306] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:20:31 2022] POST /identity/v3/endpoints => generated 331 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 05:20:41.529476 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=30 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:20:41.687769 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:21:35.293899 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c048d7f-7231-4fac-8c16-30189db98bd7 None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:21:35.294361 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c048d7f-7231-4fac-8c16-30189db98bd7 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:21:35.294361 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c048d7f-7231-4fac-8c16-30189db98bd7 None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:21:35.301195 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fca96be-54bc-4c92-962a-1e683770d0d0 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:21:35.301635 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fca96be-54bc-4c92-962a-1e683770d0d0 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:21:35.301718 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fca96be-54bc-4c92-962a-1e683770d0d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:21:35.306509 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 656/1307] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:21:35 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:21:35.435509 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-7fca96be-54bc-4c92-962a-1e683770d0d0 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:21:35.436956 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-7fca96be-54bc-4c92-962a-1e683770d0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:21:35.552777 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 652/1308] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:21:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:21:35.860261 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eefd21-e012-4b87-88c4-8afcd4fbb6de None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:21:35.860854 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eefd21-e012-4b87-88c4-8afcd4fbb6de None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:21:35.861322 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eefd21-e012-4b87-88c4-8afcd4fbb6de None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:21:35.863251 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 657/1309] 10.222.0.16 () {54 vars in 965 bytes} [Sun Sep 11 05:21:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:21:35.870251 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf6d9a4-50b0-437b-98d9-b38570d87b0a None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:21:35.870575 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf6d9a4-50b0-437b-98d9-b38570d87b0a None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:21:35.870809 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf6d9a4-50b0-437b-98d9-b38570d87b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:21:35.954911 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-2bf6d9a4-50b0-437b-98d9-b38570d87b0a None None] MFA Rules not processed for user `72086abb4e0547dc96d76a44886805ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:21:35.956348 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-2bf6d9a4-50b0-437b-98d9-b38570d87b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:21:35.984015 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:21:36.046629 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 653/1310] 10.222.0.16 () {58 vars in 1062 bytes} [Sun Sep 11 05:21:35 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 05:21:36.055319 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eefd21-e012-4b87-88c4-8afcd4fbb6de None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:21:36.057308 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-66eefd21-e012-4b87-88c4-8afcd4fbb6de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:21:36.180629 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eefd21-e012-4b87-88c4-8afcd4fbb6de None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:21:36.263616 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad0f8ec-66ec-47ef-ab21-85709abba2ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:21:36.264277 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad0f8ec-66ec-47ef-ab21-85709abba2ba service neutron] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:21:36.264556 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad0f8ec-66ec-47ef-ab21-85709abba2ba service neutron] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:21:36.264829 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad0f8ec-66ec-47ef-ab21-85709abba2ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:21:36.266459 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-aad0f8ec-66ec-47ef-ab21-85709abba2ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:21:36.332407 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:21:36.413719 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad0f8ec-66ec-47ef-ab21-85709abba2ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:21:36.415364 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad0f8ec-66ec-47ef-ab21-85709abba2ba service neutron] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:21:36.452883 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 658/1311] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:21:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:21:38.911533 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd73f6-fc4a-494b-b419-2d173cf5dc6e None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:21:38.912110 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd73f6-fc4a-494b-b419-2d173cf5dc6e None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:21:38.912110 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd73f6-fc4a-494b-b419-2d173cf5dc6e None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:21:38.913457 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 654/1312] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:21:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:21:38.919866 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56707c2-3c88-401b-9c3a-ad91c105c0ab None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:21:38.920274 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56707c2-3c88-401b-9c3a-ad91c105c0ab None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:21:38.920449 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56707c2-3c88-401b-9c3a-ad91c105c0ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:21:39.001806 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-d56707c2-3c88-401b-9c3a-ad91c105c0ab None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:21:39.003647 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-d56707c2-3c88-401b-9c3a-ad91c105c0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:21:39.101314 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 659/1313] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:21:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:21:39.382221 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdd73f6-fc4a-494b-b419-2d173cf5dc6e None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:21:39.383791 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-5fdd73f6-fc4a-494b-b419-2d173cf5dc6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:21:39.483696 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdd73f6-fc4a-494b-b419-2d173cf5dc6e None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:21:39.556654 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:21:39.559123 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81b9f31-a5ee-41db-94cf-f5ffbb386922 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:21:39.559924 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b9f31-a5ee-41db-94cf-f5ffbb386922 service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:21:39.560397 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b9f31-a5ee-41db-94cf-f5ffbb386922 service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:21:39.560859 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b9f31-a5ee-41db-94cf-f5ffbb386922 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:21:39.562496 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-c81b9f31-a5ee-41db-94cf-f5ffbb386922 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:21:39.668408 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81b9f31-a5ee-41db-94cf-f5ffbb386922 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:21:39.669856 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81b9f31-a5ee-41db-94cf-f5ffbb386922 service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:21:39.687697 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 655/1314] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:21:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:21:42.114856 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f844d4c0-e889-4537-8d62-f55e063e1207 None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:21:42.115625 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f844d4c0-e889-4537-8d62-f55e063e1207 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:21:42.115625 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f844d4c0-e889-4537-8d62-f55e063e1207 None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:21:42.116944 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 660/1315] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:21:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:21:42.122817 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e98fdf-1525-43dd-8553-84948617dc19 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:21:42.123255 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e98fdf-1525-43dd-8553-84948617dc19 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:21:42.123349 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e98fdf-1525-43dd-8553-84948617dc19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:21:42.187801 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-13e98fdf-1525-43dd-8553-84948617dc19 None None] MFA Rules not processed for user `12f73b160732426b867094e731e1a1f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:21:42.189023 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-13e98fdf-1525-43dd-8553-84948617dc19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:21:42.242205 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:21:42.286264 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 656/1316] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:21:42 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:21:42.571968 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f844d4c0-e889-4537-8d62-f55e063e1207 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:21:42.574058 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-f844d4c0-e889-4537-8d62-f55e063e1207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:21:42.583753 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:21:42.676645 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f844d4c0-e889-4537-8d62-f55e063e1207 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:21:42.750036 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d9b4fa-8563-4825-92b8-a8b8c7cf4581 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:21:42.751102 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9b4fa-8563-4825-92b8-a8b8c7cf4581 service neutron] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:21:42.751627 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9b4fa-8563-4825-92b8-a8b8c7cf4581 service neutron] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:21:42.752252 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9b4fa-8563-4825-92b8-a8b8c7cf4581 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:21:42.754282 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-42d9b4fa-8563-4825-92b8-a8b8c7cf4581 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:21:42.817885 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:21:42.865773 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d9b4fa-8563-4825-92b8-a8b8c7cf4581 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:21:42.867211 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d9b4fa-8563-4825-92b8-a8b8c7cf4581 service neutron] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:21:42.886637 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 661/1317] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:21:42 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:21:45.586136 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fb6c84-4e82-48b7-96bf-51d093cff749 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:21:45.586709 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fb6c84-4e82-48b7-96bf-51d093cff749 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:21:45.586709 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fb6c84-4e82-48b7-96bf-51d093cff749 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:21:45.588716 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 657/1318] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:21:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:21:45.593789 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d56272-bc98-4aa9-9315-34c642ed4d8b None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:21:45.594201 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d56272-bc98-4aa9-9315-34c642ed4d8b None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:21:45.594336 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d56272-bc98-4aa9-9315-34c642ed4d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:21:45.664588 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-d8d56272-bc98-4aa9-9315-34c642ed4d8b None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:21:45.665822 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-d8d56272-bc98-4aa9-9315-34c642ed4d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:21:45.760620 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 662/1319] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:21:45 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:21:46.046702 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fb6c84-4e82-48b7-96bf-51d093cff749 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:21:46.048312 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-88fb6c84-4e82-48b7-96bf-51d093cff749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:21:46.150213 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fb6c84-4e82-48b7-96bf-51d093cff749 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:21:46.223899 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6881f9-e5d7-45ab-a28b-92927e938606 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:21:46.224499 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6881f9-e5d7-45ab-a28b-92927e938606 service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:21:46.224773 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6881f9-e5d7-45ab-a28b-92927e938606 service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:21:46.225038 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6881f9-e5d7-45ab-a28b-92927e938606 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:21:46.226633 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-af6881f9-e5d7-45ab-a28b-92927e938606 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:21:46.234026 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:21:46.332484 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6881f9-e5d7-45ab-a28b-92927e938606 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:21:46.333851 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6881f9-e5d7-45ab-a28b-92927e938606 service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:21:46.352189 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 658/1320] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:21:46 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:21:49.129850 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c9b70e-628e-4175-9fb4-7786042d4c2d None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:21:49.130417 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c9b70e-628e-4175-9fb4-7786042d4c2d None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:21:49.130417 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c9b70e-628e-4175-9fb4-7786042d4c2d None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:21:49.131769 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 663/1321] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:21:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:21:49.137519 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455905e4-8915-450e-b620-6dd246fb12f7 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:21:49.137934 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455905e4-8915-450e-b620-6dd246fb12f7 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:21:49.138070 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455905e4-8915-450e-b620-6dd246fb12f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:21:49.212280 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-455905e4-8915-450e-b620-6dd246fb12f7 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:21:49.213548 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-455905e4-8915-450e-b620-6dd246fb12f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:21:49.275772 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:21:49.318638 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 659/1322] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:21:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:21:49.598093 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c9b70e-628e-4175-9fb4-7786042d4c2d None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:21:49.599651 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-f0c9b70e-628e-4175-9fb4-7786042d4c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:21:49.620536 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:21:49.706478 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c9b70e-628e-4175-9fb4-7786042d4c2d None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:21:49.781795 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee714494-c954-43f9-9bee-05d89401e277 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:21:49.782430 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee714494-c954-43f9-9bee-05d89401e277 service neutron] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:21:49.782705 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee714494-c954-43f9-9bee-05d89401e277 service neutron] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:21:49.782989 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee714494-c954-43f9-9bee-05d89401e277 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:21:49.784637 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-ee714494-c954-43f9-9bee-05d89401e277 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:21:49.856736 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:21:49.895658 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee714494-c954-43f9-9bee-05d89401e277 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:21:49.897108 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee714494-c954-43f9-9bee-05d89401e277 service neutron] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:21:49.915651 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 664/1323] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:21:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:21:52.127216 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd08411-8e49-4e39-8b79-02b9036fe3c0 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:21:52.127798 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd08411-8e49-4e39-8b79-02b9036fe3c0 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:21:52.127798 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd08411-8e49-4e39-8b79-02b9036fe3c0 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:21:52.129045 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 660/1324] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:21:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:21:52.134342 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22675107-f94f-48ae-ae33-51f09f42dd2a None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:21:52.134750 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22675107-f94f-48ae-ae33-51f09f42dd2a None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:21:52.134890 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22675107-f94f-48ae-ae33-51f09f42dd2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:21:52.202345 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-22675107-f94f-48ae-ae33-51f09f42dd2a None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:21:52.203544 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-22675107-f94f-48ae-ae33-51f09f42dd2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:21:52.313494 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 665/1325] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:21:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:21:52.609257 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd08411-8e49-4e39-8b79-02b9036fe3c0 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:21:52.610865 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-dfd08411-8e49-4e39-8b79-02b9036fe3c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:21:52.714019 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd08411-8e49-4e39-8b79-02b9036fe3c0 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:21:52.787432 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff78c25-cfd0-4c7a-8889-05578b491998 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:21:52.788070 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff78c25-cfd0-4c7a-8889-05578b491998 service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:21:52.788861 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff78c25-cfd0-4c7a-8889-05578b491998 service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:21:52.788861 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff78c25-cfd0-4c7a-8889-05578b491998 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:21:52.790289 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-bff78c25-cfd0-4c7a-8889-05578b491998 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:21:52.808677 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:21:52.900159 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff78c25-cfd0-4c7a-8889-05578b491998 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:21:52.901616 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff78c25-cfd0-4c7a-8889-05578b491998 service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:21:52.919248 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 661/1326] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:21:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:21:55.131394 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d55c3a-1ef9-41d1-9bbe-8886d09ee58e None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:21:55.131929 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d55c3a-1ef9-41d1-9bbe-8886d09ee58e None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:21:55.131929 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d55c3a-1ef9-41d1-9bbe-8886d09ee58e None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:21:55.133224 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 666/1327] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:21:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:21:55.138494 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db45ac2-21fc-4265-b6d0-08f108b8b2a8 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:21:55.138922 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db45ac2-21fc-4265-b6d0-08f108b8b2a8 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:21:55.139053 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db45ac2-21fc-4265-b6d0-08f108b8b2a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:21:55.205617 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-4db45ac2-21fc-4265-b6d0-08f108b8b2a8 None None] MFA Rules not processed for user `12f73b160732426b867094e731e1a1f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:21:55.206818 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-4db45ac2-21fc-4265-b6d0-08f108b8b2a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:21:55.271186 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:21:55.303378 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 662/1328] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:21:55 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:21:55.592591 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d55c3a-1ef9-41d1-9bbe-8886d09ee58e None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:21:55.594147 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-91d55c3a-1ef9-41d1-9bbe-8886d09ee58e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:21:55.626909 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:21:55.701078 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d55c3a-1ef9-41d1-9bbe-8886d09ee58e None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:21:55.776336 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1b7b72-ef3b-4c7e-9ea0-e27cc9a588c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:21:55.776946 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b7b72-ef3b-4c7e-9ea0-e27cc9a588c0 service neutron] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:21:55.777222 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b7b72-ef3b-4c7e-9ea0-e27cc9a588c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:21:55.777487 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b7b72-ef3b-4c7e-9ea0-e27cc9a588c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:21:55.779097 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-7d1b7b72-ef3b-4c7e-9ea0-e27cc9a588c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:21:55.855931 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:21:55.888610 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1b7b72-ef3b-4c7e-9ea0-e27cc9a588c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:21:55.890040 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1b7b72-ef3b-4c7e-9ea0-e27cc9a588c0 service neutron] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:21:55.908928 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 667/1329] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:21:55 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:21:58.268515 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddc5022-4042-445a-ae7f-e92044b25641 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:21:58.269061 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddc5022-4042-445a-ae7f-e92044b25641 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:21:58.269061 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddc5022-4042-445a-ae7f-e92044b25641 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:21:58.274729 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 663/1330] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:21:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:21:58.276685 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24179a5-8f93-46e0-98dc-e1a692652612 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:21:58.277149 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24179a5-8f93-46e0-98dc-e1a692652612 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:21:58.277518 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24179a5-8f93-46e0-98dc-e1a692652612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:21:58.342416 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-f24179a5-8f93-46e0-98dc-e1a692652612 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:21:58.343618 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-f24179a5-8f93-46e0-98dc-e1a692652612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:21:58.437487 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 668/1331] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:21:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:21:58.717430 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddc5022-4042-445a-ae7f-e92044b25641 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:21:58.719021 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-8ddc5022-4042-445a-ae7f-e92044b25641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:21:58.823809 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddc5022-4042-445a-ae7f-e92044b25641 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:21:58.895423 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6345e56f-5d3b-48ce-a19c-9cfc5e8131c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:21:58.896047 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6345e56f-5d3b-48ce-a19c-9cfc5e8131c1 service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:21:58.896325 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6345e56f-5d3b-48ce-a19c-9cfc5e8131c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:21:58.896594 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6345e56f-5d3b-48ce-a19c-9cfc5e8131c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:21:58.898188 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-6345e56f-5d3b-48ce-a19c-9cfc5e8131c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:21:58.925437 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:21:59.005810 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6345e56f-5d3b-48ce-a19c-9cfc5e8131c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:21:59.007257 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6345e56f-5d3b-48ce-a19c-9cfc5e8131c1 service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:21:59.025208 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 664/1332] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:21:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:22:01.217470 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf9211-b91d-4820-afd8-53e41744ad3a None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:22:01.218028 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf9211-b91d-4820-afd8-53e41744ad3a None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:22:01.218028 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf9211-b91d-4820-afd8-53e41744ad3a None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:22:01.219363 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 669/1333] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:22:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:22:01.224584 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8565d07c-88cd-41f4-8eb7-6138bd24f575 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:22:01.225007 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8565d07c-88cd-41f4-8eb7-6138bd24f575 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:22:01.225125 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8565d07c-88cd-41f4-8eb7-6138bd24f575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:22:01.289711 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-8565d07c-88cd-41f4-8eb7-6138bd24f575 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:22:01.291477 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-8565d07c-88cd-41f4-8eb7-6138bd24f575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:22:01.363694 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:22:01.386235 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 665/1334] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:22:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:22:01.667761 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cf9211-b91d-4820-afd8-53e41744ad3a None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:22:01.669324 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-e9cf9211-b91d-4820-afd8-53e41744ad3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:22:01.709420 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:22:01.773962 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cf9211-b91d-4820-afd8-53e41744ad3a None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:22:01.851762 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d55b328-69f9-4272-9f4d-89fcc415985c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:22:01.853004 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d55b328-69f9-4272-9f4d-89fcc415985c service neutron] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:22:01.853283 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d55b328-69f9-4272-9f4d-89fcc415985c service neutron] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:22:01.853549 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d55b328-69f9-4272-9f4d-89fcc415985c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:22:01.855159 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-3d55b328-69f9-4272-9f4d-89fcc415985c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:22:01.938757 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:22:01.964831 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d55b328-69f9-4272-9f4d-89fcc415985c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:22:01.966280 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d55b328-69f9-4272-9f4d-89fcc415985c service neutron] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:22:01.984799 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 670/1335] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:22:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:22:04.453283 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfc6a54-a109-4299-91d1-a5142e7ac59a None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:22:04.453847 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfc6a54-a109-4299-91d1-a5142e7ac59a None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:22:04.453847 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfc6a54-a109-4299-91d1-a5142e7ac59a None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:22:04.455168 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 666/1336] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:22:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:22:04.460397 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f268875e-7fa2-4453-86ff-6930a099cbe4 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:22:04.460835 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f268875e-7fa2-4453-86ff-6930a099cbe4 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:22:04.460949 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f268875e-7fa2-4453-86ff-6930a099cbe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:22:04.525873 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-f268875e-7fa2-4453-86ff-6930a099cbe4 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:22:04.527061 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-f268875e-7fa2-4453-86ff-6930a099cbe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:22:04.623176 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 671/1337] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:22:04 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 05:22:04.920043 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95396225-1bf4-4061-a61c-bc4e0bb07297 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:22:04.920374 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95396225-1bf4-4061-a61c-bc4e0bb07297 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:22:04.920580 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95396225-1bf4-4061-a61c-bc4e0bb07297 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:22:04.921932 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 667/1338] 10.222.0.16 () {54 vars in 965 bytes} [Sun Sep 11 05:22:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:22:04.927627 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b47289e-733d-4e5f-9f2e-b7757eef5b11 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:22:04.927936 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b47289e-733d-4e5f-9f2e-b7757eef5b11 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:22:04.928233 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b47289e-733d-4e5f-9f2e-b7757eef5b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:22:04.981695 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:22:05.005073 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-3b47289e-733d-4e5f-9f2e-b7757eef5b11 None None] MFA Rules not processed for user `72086abb4e0547dc96d76a44886805ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:22:05.006276 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-3b47289e-733d-4e5f-9f2e-b7757eef5b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:22:05.082426 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 672/1339] 10.222.0.16 () {58 vars in 1062 bytes} [Sun Sep 11 05:22:04 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:22:05.092367 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95396225-1bf4-4061-a61c-bc4e0bb07297 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:22:05.094260 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-95396225-1bf4-4061-a61c-bc4e0bb07297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:22:05.194933 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95396225-1bf4-4061-a61c-bc4e0bb07297 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:22:05.266930 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35709b7d-2861-411b-9e44-afc88c9b16f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:22:05.267551 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35709b7d-2861-411b-9e44-afc88c9b16f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:22:05.267857 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35709b7d-2861-411b-9e44-afc88c9b16f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:22:05.268127 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35709b7d-2861-411b-9e44-afc88c9b16f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:22:05.269730 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-35709b7d-2861-411b-9e44-afc88c9b16f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:22:05.304048 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:22:05.379803 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35709b7d-2861-411b-9e44-afc88c9b16f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:22:05.381253 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35709b7d-2861-411b-9e44-afc88c9b16f0 service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:22:05.400735 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 668/1340] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:22:05 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:22:10.026295 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fabbc4-4552-4b45-95bc-1251a0853972 None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:22:10.026803 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fabbc4-4552-4b45-95bc-1251a0853972 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:22:10.026803 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fabbc4-4552-4b45-95bc-1251a0853972 None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:22:10.028142 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 673/1341] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:22:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 05:22:10.033504 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df3ff8c-4795-4bf2-8cff-064f2540e4b7 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:22:10.033941 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df3ff8c-4795-4bf2-8cff-064f2540e4b7 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:22:10.034048 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df3ff8c-4795-4bf2-8cff-064f2540e4b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:22:10.099249 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-9df3ff8c-4795-4bf2-8cff-064f2540e4b7 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:22:10.100409 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-9df3ff8c-4795-4bf2-8cff-064f2540e4b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:22:10.185177 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:22:10.197904 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 669/1342] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:22:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:22:10.483145 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fabbc4-4552-4b45-95bc-1251a0853972 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:22:10.484776 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-94fabbc4-4552-4b45-95bc-1251a0853972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:22:10.589955 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fabbc4-4552-4b45-95bc-1251a0853972 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:22:10.628806 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:22:10.664921 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a234cfbd-3e04-4a06-8c1a-2ed27d34a151 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:22:10.665533 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234cfbd-3e04-4a06-8c1a-2ed27d34a151 service neutron] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:22:10.665811 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234cfbd-3e04-4a06-8c1a-2ed27d34a151 service neutron] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:22:10.666081 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234cfbd-3e04-4a06-8c1a-2ed27d34a151 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:22:10.667744 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-a234cfbd-3e04-4a06-8c1a-2ed27d34a151 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:22:10.776788 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a234cfbd-3e04-4a06-8c1a-2ed27d34a151 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:22:10.778149 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a234cfbd-3e04-4a06-8c1a-2ed27d34a151 service neutron] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:22:10.797190 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 674/1343] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:22:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:22:13.573696 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c1dc33-ef0e-422e-89ab-22b9c8153f7c None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:22:13.574273 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c1dc33-ef0e-422e-89ab-22b9c8153f7c None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:22:13.574273 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c1dc33-ef0e-422e-89ab-22b9c8153f7c None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:22:13.575630 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 670/1344] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:22:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:22:13.581015 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710a5e4b-da68-4a2a-8daf-c2112f08d808 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:22:13.581428 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710a5e4b-da68-4a2a-8daf-c2112f08d808 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:22:13.581565 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710a5e4b-da68-4a2a-8daf-c2112f08d808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:22:13.647081 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-710a5e4b-da68-4a2a-8daf-c2112f08d808 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:22:13.648944 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-710a5e4b-da68-4a2a-8daf-c2112f08d808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:22:13.666719 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:22:13.749498 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 675/1345] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:22:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:22:14.035222 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c1dc33-ef0e-422e-89ab-22b9c8153f7c None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:22:14.036792 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-14c1dc33-ef0e-422e-89ab-22b9c8153f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:22:14.143922 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c1dc33-ef0e-422e-89ab-22b9c8153f7c None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:22:14.222770 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239d2be7-63bc-4802-8eb2-18d7d0cbc273 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:22:14.223303 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d2be7-63bc-4802-8eb2-18d7d0cbc273 service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:22:14.223578 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d2be7-63bc-4802-8eb2-18d7d0cbc273 service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:22:14.223876 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d2be7-63bc-4802-8eb2-18d7d0cbc273 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:22:14.225490 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-239d2be7-63bc-4802-8eb2-18d7d0cbc273 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:22:14.268935 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:22:14.337376 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239d2be7-63bc-4802-8eb2-18d7d0cbc273 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:22:14.338834 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239d2be7-63bc-4802-8eb2-18d7d0cbc273 service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:22:14.358196 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 671/1346] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:22:14 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:22:18.455958 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47469a5f-8ea2-4239-b9e6-e5bc1e873a2b None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:22:18.456527 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47469a5f-8ea2-4239-b9e6-e5bc1e873a2b None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:22:18.456527 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47469a5f-8ea2-4239-b9e6-e5bc1e873a2b None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:22:18.457871 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 676/1347] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:22:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:22:18.463183 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51877047-26f5-4d60-bbbf-be9757b425fe None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:22:18.463654 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51877047-26f5-4d60-bbbf-be9757b425fe None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:22:18.463876 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51877047-26f5-4d60-bbbf-be9757b425fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:22:18.533331 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-51877047-26f5-4d60-bbbf-be9757b425fe None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:22:18.534543 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-51877047-26f5-4d60-bbbf-be9757b425fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:22:18.630756 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:22:18.633898 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 672/1348] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:22:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:22:18.916400 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47469a5f-8ea2-4239-b9e6-e5bc1e873a2b None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:22:18.917968 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-47469a5f-8ea2-4239-b9e6-e5bc1e873a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:22:19.020726 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47469a5f-8ea2-4239-b9e6-e5bc1e873a2b None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:22:19.067700 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:22:19.094032 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f17681d-16f0-4778-90a3-0303ed1da2bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:22:19.094636 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f17681d-16f0-4778-90a3-0303ed1da2bf service neutron] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:22:19.094916 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f17681d-16f0-4778-90a3-0303ed1da2bf service neutron] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:22:19.095189 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f17681d-16f0-4778-90a3-0303ed1da2bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:22:19.096850 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-8f17681d-16f0-4778-90a3-0303ed1da2bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:22:19.210066 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f17681d-16f0-4778-90a3-0303ed1da2bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:22:19.212069 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f17681d-16f0-4778-90a3-0303ed1da2bf service neutron] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:22:19.233691 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 677/1349] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:22:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:22:24.110391 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831abcbf-8531-41d4-a516-d942d89f2bd1 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:22:24.110391 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831abcbf-8531-41d4-a516-d942d89f2bd1 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:22:24.110391 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831abcbf-8531-41d4-a516-d942d89f2bd1 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:22:24.110391 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 673/1350] 10.222.0.16 () {54 vars in 921 bytes} [Sun Sep 11 05:22:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:22:24.111467 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422deb85-298c-4366-ab6b-1857bc82d1e8 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:22:24.111467 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422deb85-298c-4366-ab6b-1857bc82d1e8 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:22:24.111467 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422deb85-298c-4366-ab6b-1857bc82d1e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:22:24.213275 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-422deb85-298c-4366-ab6b-1857bc82d1e8 None None] MFA Rules not processed for user `72e1d7dd79ff43e7b585b5090762465f`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:22:24.216246 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-422deb85-298c-4366-ab6b-1857bc82d1e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:22:24.236480 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:22:24.375739 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 678/1351] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 11 05:22:24 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:22:28.469320 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297359c9-b7ab-4a0d-911a-973794b435f1 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:22:28.469886 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297359c9-b7ab-4a0d-911a-973794b435f1 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:22:28.469886 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297359c9-b7ab-4a0d-911a-973794b435f1 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:22:28.471194 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 674/1352] 10.222.0.16 () {54 vars in 921 bytes} [Sun Sep 11 05:22:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:22:28.479975 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca205d2-3799-4c76-b3b1-6f2ead61daa7 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:22:28.480769 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca205d2-3799-4c76-b3b1-6f2ead61daa7 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:22:28.481052 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca205d2-3799-4c76-b3b1-6f2ead61daa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:22:28.562687 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-0ca205d2-3799-4c76-b3b1-6f2ead61daa7 None None] MFA Rules not processed for user `72e1d7dd79ff43e7b585b5090762465f`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:22:28.564050 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-0ca205d2-3799-4c76-b3b1-6f2ead61daa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:22:28.642098 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:22:28.682079 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 679/1353] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 11 05:22:28 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:22:30.146116 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1719be0a-ac62-4f00-9e6e-aea9030c2889 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:22:30.146671 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1719be0a-ac62-4f00-9e6e-aea9030c2889 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:22:30.146671 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1719be0a-ac62-4f00-9e6e-aea9030c2889 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:22:30.148682 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 675/1354] 10.222.0.16 () {54 vars in 921 bytes} [Sun Sep 11 05:22:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:22:30.153923 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd570f2-9960-498b-bd3d-849af0a69829 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:22:30.154362 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd570f2-9960-498b-bd3d-849af0a69829 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:22:30.154497 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd570f2-9960-498b-bd3d-849af0a69829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:22:30.232055 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-4cd570f2-9960-498b-bd3d-849af0a69829 None None] MFA Rules not processed for user `72e1d7dd79ff43e7b585b5090762465f`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:22:30.233274 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-4cd570f2-9960-498b-bd3d-849af0a69829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:22:30.348377 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 680/1355] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 11 05:22:30 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:22:33.743136 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc2bd34-42f4-4894-b14d-237ea3619a47 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:22:33.744042 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc2bd34-42f4-4894-b14d-237ea3619a47 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:22:33.744318 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc2bd34-42f4-4894-b14d-237ea3619a47 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:22:33.745815 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 676/1356] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:22:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:22:33.751711 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3270f879-d4a4-4d42-955e-1e87f608e888 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:22:33.752873 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3270f879-d4a4-4d42-955e-1e87f608e888 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:22:33.753360 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3270f879-d4a4-4d42-955e-1e87f608e888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:22:33.793800 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:22:33.829706 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-3270f879-d4a4-4d42-955e-1e87f608e888 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:22:33.830915 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-3270f879-d4a4-4d42-955e-1e87f608e888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:22:33.935605 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 681/1357] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:22:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:22:34.246539 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c39613-ee72-435c-b162-62aabb5207ee None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:22:34.247126 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c39613-ee72-435c-b162-62aabb5207ee None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:22:34.247555 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c39613-ee72-435c-b162-62aabb5207ee None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:22:34.249675 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 677/1358] 10.222.0.16 () {54 vars in 962 bytes} [Sun Sep 11 05:22:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:22:34.261511 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b08ad-ee23-424e-bfe3-2f010513642f None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:22:34.262401 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b08ad-ee23-424e-bfe3-2f010513642f None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:22:34.263030 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b08ad-ee23-424e-bfe3-2f010513642f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:22:34.378158 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-3f8b08ad-ee23-424e-bfe3-2f010513642f None None] MFA Rules not processed for user `6cd6136036bd467c946cae90d5c29263`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:22:34.379669 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-3f8b08ad-ee23-424e-bfe3-2f010513642f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:22:34.436649 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:22:34.513780 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 682/1359] 10.222.0.16 () {58 vars in 1059 bytes} [Sun Sep 11 05:22:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 05:22:34.521743 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c39613-ee72-435c-b162-62aabb5207ee None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:22:34.523424 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-e0c39613-ee72-435c-b162-62aabb5207ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:22:34.681195 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c39613-ee72-435c-b162-62aabb5207ee None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:22:34.762572 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:22:34.808713 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6081263c-6fbc-4daa-8cb2-ed1431ae8c9a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cd6136036bd467c946cae90d5c29263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:22:34.809400 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6081263c-6fbc-4daa-8cb2-ed1431ae8c9a service nova] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:22:34.809750 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6081263c-6fbc-4daa-8cb2-ed1431ae8c9a service nova] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:22:34.810088 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6081263c-6fbc-4daa-8cb2-ed1431ae8c9a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:22:34.811775 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-6081263c-6fbc-4daa-8cb2-ed1431ae8c9a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:22:34.914816 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6081263c-6fbc-4daa-8cb2-ed1431ae8c9a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:22:34.916490 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6081263c-6fbc-4daa-8cb2-ed1431ae8c9a service nova] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:22:34.935956 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 678/1360] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:22:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:22:37.330857 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b903944-70a3-43bb-af46-590c73c705e9 None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:22:37.331499 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b903944-70a3-43bb-af46-590c73c705e9 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:22:37.331499 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b903944-70a3-43bb-af46-590c73c705e9 None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:22:37.332740 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 683/1361] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:22:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:22:37.338628 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd5638-3418-4a55-b747-d7cc192e0200 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:22:37.339194 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd5638-3418-4a55-b747-d7cc192e0200 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:22:37.339194 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd5638-3418-4a55-b747-d7cc192e0200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:22:37.417844 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-d8bd5638-3418-4a55-b747-d7cc192e0200 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:22:37.419054 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-d8bd5638-3418-4a55-b747-d7cc192e0200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:22:37.456631 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:22:37.518064 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 679/1362] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:22:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:22:37.807136 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b903944-70a3-43bb-af46-590c73c705e9 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:22:37.808830 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-4b903944-70a3-43bb-af46-590c73c705e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:22:37.997127 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b903944-70a3-43bb-af46-590c73c705e9 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:22:38.009166 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:22:38.139831 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0bae30-b42f-4976-b28e-9c89a1a688e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cd6136036bd467c946cae90d5c29263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:22:38.140372 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0bae30-b42f-4976-b28e-9c89a1a688e5 service nova] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:22:38.140652 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0bae30-b42f-4976-b28e-9c89a1a688e5 service nova] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:22:38.140931 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0bae30-b42f-4976-b28e-9c89a1a688e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:22:38.142552 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-ce0bae30-b42f-4976-b28e-9c89a1a688e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:22:38.236297 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0bae30-b42f-4976-b28e-9c89a1a688e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:22:38.237931 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0bae30-b42f-4976-b28e-9c89a1a688e5 service nova] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:22:38.257150 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 684/1363] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:22:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:22:40.772751 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f86b0-c3fc-4102-874f-660ddf0d6430 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:22:40.773323 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f86b0-c3fc-4102-874f-660ddf0d6430 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:22:40.773323 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f86b0-c3fc-4102-874f-660ddf0d6430 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:22:40.774693 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 680/1364] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:22:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:22:40.779934 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc09d16-f063-4648-8d5a-ca7ad75adc0d None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:22:40.780326 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc09d16-f063-4648-8d5a-ca7ad75adc0d None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:22:40.780504 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc09d16-f063-4648-8d5a-ca7ad75adc0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:22:40.800362 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:22:40.856492 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-abc09d16-f063-4648-8d5a-ca7ad75adc0d None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:22:40.857656 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-abc09d16-f063-4648-8d5a-ca7ad75adc0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:22:40.961564 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 685/1365] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:22:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:22:41.249993 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0546ec-c9bc-48f9-a950-c9c3314b437d None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:22:41.250261 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0546ec-c9bc-48f9-a950-c9c3314b437d None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:22:41.250537 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0546ec-c9bc-48f9-a950-c9c3314b437d None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:22:41.252009 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 681/1366] 10.222.0.16 () {54 vars in 962 bytes} [Sun Sep 11 05:22:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:22:41.258104 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df3af30-f27c-4b49-a6a5-a4a9c1d539d6 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:22:41.258589 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df3af30-f27c-4b49-a6a5-a4a9c1d539d6 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:22:41.258964 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df3af30-f27c-4b49-a6a5-a4a9c1d539d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:22:41.339058 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-0df3af30-f27c-4b49-a6a5-a4a9c1d539d6 None None] MFA Rules not processed for user `6cd6136036bd467c946cae90d5c29263`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:22:41.340458 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-0df3af30-f27c-4b49-a6a5-a4a9c1d539d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:22:41.379983 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:22:41.467976 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 686/1367] 10.222.0.16 () {58 vars in 1059 bytes} [Sun Sep 11 05:22:41 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:22:41.476879 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0546ec-c9bc-48f9-a950-c9c3314b437d None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:22:41.478425 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-db0546ec-c9bc-48f9-a950-c9c3314b437d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:22:41.647202 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0546ec-c9bc-48f9-a950-c9c3314b437d None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:22:41.667902 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:22:41.770268 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8c00ef-c5af-4e46-9bf9-2c85191fbee5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cd6136036bd467c946cae90d5c29263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:22:41.770906 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c00ef-c5af-4e46-9bf9-2c85191fbee5 service nova] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:22:41.771156 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c00ef-c5af-4e46-9bf9-2c85191fbee5 service nova] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:22:41.771424 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c00ef-c5af-4e46-9bf9-2c85191fbee5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:22:41.773168 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-7e8c00ef-c5af-4e46-9bf9-2c85191fbee5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:22:41.879397 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8c00ef-c5af-4e46-9bf9-2c85191fbee5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:22:41.881242 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8c00ef-c5af-4e46-9bf9-2c85191fbee5 service nova] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:22:41.901144 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 682/1368] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:22:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:22:41.909138 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5894560f-b196-44e2-a451-fc53a12a6d75 None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:22:41.909566 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5894560f-b196-44e2-a451-fc53a12a6d75 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:22:41.909674 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5894560f-b196-44e2-a451-fc53a12a6d75 None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:22:41.911146 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 687/1369] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:22:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:22:41.917181 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57e4ba0-ad8f-4695-b373-5832dab4cc4e None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:22:41.917465 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57e4ba0-ad8f-4695-b373-5832dab4cc4e None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:22:41.917733 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57e4ba0-ad8f-4695-b373-5832dab4cc4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:22:41.951226 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:22:42.000893 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-f57e4ba0-ad8f-4695-b373-5832dab4cc4e None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:22:42.002204 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-f57e4ba0-ad8f-4695-b373-5832dab4cc4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:22:42.128191 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 683/1370] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:22:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:22:42.434240 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d57f77e-14af-497d-b393-a5a64e7bd286 None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:22:42.434632 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d57f77e-14af-497d-b393-a5a64e7bd286 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:22:42.435010 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d57f77e-14af-497d-b393-a5a64e7bd286 None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:22:42.436665 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 688/1371] 10.222.0.16 () {54 vars in 964 bytes} [Sun Sep 11 05:22:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:22:42.441566 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e78ea-d541-46e5-b535-5dc4e1bb90bd None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:22:42.441910 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e78ea-d541-46e5-b535-5dc4e1bb90bd None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:22:42.442193 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e78ea-d541-46e5-b535-5dc4e1bb90bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:22:42.528918 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-914e78ea-d541-46e5-b535-5dc4e1bb90bd None None] MFA Rules not processed for user `5a147e14b61d481db1cac02c58ac3500`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:22:42.530637 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-914e78ea-d541-46e5-b535-5dc4e1bb90bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:22:42.590688 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:22:42.622494 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 684/1372] 10.222.0.16 () {58 vars in 1061 bytes} [Sun Sep 11 05:22:42 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:22:42.629799 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d57f77e-14af-497d-b393-a5a64e7bd286 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:22:42.631868 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-8d57f77e-14af-497d-b393-a5a64e7bd286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:22:42.747925 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d57f77e-14af-497d-b393-a5a64e7bd286 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:22:42.796673 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:22:42.841068 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d67bb5-d972-42a6-9237-a315fb4adb19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a147e14b61d481db1cac02c58ac3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:22:42.842301 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d67bb5-d972-42a6-9237-a315fb4adb19 service cinder] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:22:42.842587 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d67bb5-d972-42a6-9237-a315fb4adb19 service cinder] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:22:42.842893 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d67bb5-d972-42a6-9237-a315fb4adb19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:22:42.844631 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-e9d67bb5-d972-42a6-9237-a315fb4adb19 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:22:42.978122 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d67bb5-d972-42a6-9237-a315fb4adb19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:22:42.979550 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d67bb5-d972-42a6-9237-a315fb4adb19 service cinder] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:22:43.010206 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 689/1373] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:22:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:22:44.128524 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f34e37-77e1-42e1-bfad-4f893c79b43d None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:22:44.129091 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f34e37-77e1-42e1-bfad-4f893c79b43d None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:22:44.129179 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f34e37-77e1-42e1-bfad-4f893c79b43d None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:22:44.130470 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 685/1374] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:22:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:22:44.135817 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f5830-574c-48b9-b0b7-4c06d29c6714 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:22:44.136226 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f5830-574c-48b9-b0b7-4c06d29c6714 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:22:44.136491 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f5830-574c-48b9-b0b7-4c06d29c6714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:22:44.204763 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-af1f5830-574c-48b9-b0b7-4c06d29c6714 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:22:44.206089 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-af1f5830-574c-48b9-b0b7-4c06d29c6714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:22:44.226724 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:22:44.302720 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 690/1375] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:22:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 05:22:44.595566 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f34e37-77e1-42e1-bfad-4f893c79b43d None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:22:44.597150 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-42f34e37-77e1-42e1-bfad-4f893c79b43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:22:44.760569 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f34e37-77e1-42e1-bfad-4f893c79b43d None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:22:44.816140 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:22:44.887844 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e09a27e-a131-4bdf-a771-ca794b19218d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cd6136036bd467c946cae90d5c29263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:22:44.888475 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e09a27e-a131-4bdf-a771-ca794b19218d service nova] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:22:44.888734 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e09a27e-a131-4bdf-a771-ca794b19218d service nova] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:22:44.889002 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e09a27e-a131-4bdf-a771-ca794b19218d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:22:44.890602 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-4e09a27e-a131-4bdf-a771-ca794b19218d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:22:44.986523 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e09a27e-a131-4bdf-a771-ca794b19218d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:22:44.988185 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e09a27e-a131-4bdf-a771-ca794b19218d service nova] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:22:45.007856 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 686/1376] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:22:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:22:47.274904 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c4777d-3113-49fe-a87c-9c8545175f5a None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:22:47.275458 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c4777d-3113-49fe-a87c-9c8545175f5a None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:22:47.275458 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c4777d-3113-49fe-a87c-9c8545175f5a None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:22:47.276989 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 691/1377] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:22:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:22:47.282029 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a53e97-bbcf-43b0-95dc-9aa61d7c589b None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:22:47.282453 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a53e97-bbcf-43b0-95dc-9aa61d7c589b None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:22:47.282642 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a53e97-bbcf-43b0-95dc-9aa61d7c589b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:22:47.356407 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-49a53e97-bbcf-43b0-95dc-9aa61d7c589b None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:22:47.357607 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-49a53e97-bbcf-43b0-95dc-9aa61d7c589b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:22:47.365396 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:22:47.461619 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 687/1378] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:22:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:22:47.750042 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c4777d-3113-49fe-a87c-9c8545175f5a None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:22:47.751931 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-27c4777d-3113-49fe-a87c-9c8545175f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:22:47.907791 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c4777d-3113-49fe-a87c-9c8545175f5a None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:22:47.912536 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:22:48.027048 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703adf4c-bfe2-485c-b9cf-1b3a705f6402 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cd6136036bd467c946cae90d5c29263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:22:48.027575 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703adf4c-bfe2-485c-b9cf-1b3a705f6402 service nova] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:22:48.027890 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703adf4c-bfe2-485c-b9cf-1b3a705f6402 service nova] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:22:48.028164 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703adf4c-bfe2-485c-b9cf-1b3a705f6402 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:22:48.029782 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-703adf4c-bfe2-485c-b9cf-1b3a705f6402 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:22:48.127506 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703adf4c-bfe2-485c-b9cf-1b3a705f6402 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:22:48.129145 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703adf4c-bfe2-485c-b9cf-1b3a705f6402 service nova] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:22:48.149029 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 692/1379] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:22:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:22:50.351957 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a882b43d-fe6f-4f6a-98e9-f6a0591bb932 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:22:50.352430 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a882b43d-fe6f-4f6a-98e9-f6a0591bb932 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:22:50.352629 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a882b43d-fe6f-4f6a-98e9-f6a0591bb932 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:22:50.354285 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 688/1380] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:22:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:22:50.359921 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ecd02-cdb3-43a3-840e-001ce0d78819 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:22:50.360306 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ecd02-cdb3-43a3-840e-001ce0d78819 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:22:50.360487 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ecd02-cdb3-43a3-840e-001ce0d78819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:22:50.373469 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:22:50.442506 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-8b1ecd02-cdb3-43a3-840e-001ce0d78819 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:22:50.444571 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-8b1ecd02-cdb3-43a3-840e-001ce0d78819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:22:50.572098 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 693/1381] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:22:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:22:50.898138 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a882b43d-fe6f-4f6a-98e9-f6a0591bb932 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:22:50.899739 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-a882b43d-fe6f-4f6a-98e9-f6a0591bb932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:22:51.039216 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:22:51.050139 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a882b43d-fe6f-4f6a-98e9-f6a0591bb932 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:22:51.173029 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84912326-d6e1-48e1-93e5-cf0ba9dc8362 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cd6136036bd467c946cae90d5c29263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:22:51.173864 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84912326-d6e1-48e1-93e5-cf0ba9dc8362 service nova] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:22:51.174230 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84912326-d6e1-48e1-93e5-cf0ba9dc8362 service nova] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:22:51.174582 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84912326-d6e1-48e1-93e5-cf0ba9dc8362 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:22:51.176701 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-84912326-d6e1-48e1-93e5-cf0ba9dc8362 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:22:51.286330 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84912326-d6e1-48e1-93e5-cf0ba9dc8362 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:22:51.288029 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84912326-d6e1-48e1-93e5-cf0ba9dc8362 service nova] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:22:51.297989 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:22:51.307567 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 689/1382] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:22:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:22:54.388544 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc1b5ed-a088-4b0d-ba63-ce06274db41e None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:22:54.389091 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc1b5ed-a088-4b0d-ba63-ce06274db41e None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:22:54.389182 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc1b5ed-a088-4b0d-ba63-ce06274db41e None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:22:54.390522 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 694/1383] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:22:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:22:54.396453 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b27e18-8fc2-4ae5-b7cb-8d39a7164e45 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:22:54.396876 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b27e18-8fc2-4ae5-b7cb-8d39a7164e45 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:22:54.397110 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b27e18-8fc2-4ae5-b7cb-8d39a7164e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:22:54.464764 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-13b27e18-8fc2-4ae5-b7cb-8d39a7164e45 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:22:54.466002 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-13b27e18-8fc2-4ae5-b7cb-8d39a7164e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:22:54.571793 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 690/1384] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:22:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:22:54.857654 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc1b5ed-a088-4b0d-ba63-ce06274db41e None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:22:54.859208 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-0fc1b5ed-a088-4b0d-ba63-ce06274db41e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:22:54.948400 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:22:55.024256 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc1b5ed-a088-4b0d-ba63-ce06274db41e None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:22:55.142615 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea13eeb7-22fd-42bd-ad39-2cc64680c5a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cd6136036bd467c946cae90d5c29263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:22:55.143428 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13eeb7-22fd-42bd-ad39-2cc64680c5a4 service nova] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:22:55.143942 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13eeb7-22fd-42bd-ad39-2cc64680c5a4 service nova] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:22:55.144277 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13eeb7-22fd-42bd-ad39-2cc64680c5a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:22:55.147228 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-ea13eeb7-22fd-42bd-ad39-2cc64680c5a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:22:55.204511 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:22:55.246624 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea13eeb7-22fd-42bd-ad39-2cc64680c5a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:22:55.248307 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea13eeb7-22fd-42bd-ad39-2cc64680c5a4 service nova] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:22:55.266698 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 695/1385] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:22:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:22:57.440189 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1955dfae-b5b4-499f-a098-49b2547ce7be None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:22:57.440746 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1955dfae-b5b4-499f-a098-49b2547ce7be None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:22:57.440746 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1955dfae-b5b4-499f-a098-49b2547ce7be None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:22:57.442232 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 691/1386] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:22:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:22:57.448023 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb69876-9ed1-46ec-9d23-4f16d6f89fbc None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:22:57.448443 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb69876-9ed1-46ec-9d23-4f16d6f89fbc None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:22:57.448573 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb69876-9ed1-46ec-9d23-4f16d6f89fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:22:57.514347 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-5eb69876-9ed1-46ec-9d23-4f16d6f89fbc None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:22:57.515526 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-5eb69876-9ed1-46ec-9d23-4f16d6f89fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:22:57.610942 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 696/1387] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:22:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:22:57.901836 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1955dfae-b5b4-499f-a098-49b2547ce7be None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:22:57.903348 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-1955dfae-b5b4-499f-a098-49b2547ce7be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:22:57.979167 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:22:58.048038 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1955dfae-b5b4-499f-a098-49b2547ce7be None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:22:58.164047 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c1cd2f-ad6b-4e53-922b-214943b0e9fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cd6136036bd467c946cae90d5c29263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:22:58.164664 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1cd2f-ad6b-4e53-922b-214943b0e9fb service nova] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:22:58.164937 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1cd2f-ad6b-4e53-922b-214943b0e9fb service nova] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:22:58.165203 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1cd2f-ad6b-4e53-922b-214943b0e9fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:22:58.166900 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-f3c1cd2f-ad6b-4e53-922b-214943b0e9fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:22:58.217234 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:22:58.275003 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c1cd2f-ad6b-4e53-922b-214943b0e9fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:22:58.275209 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b9660d-8353-43f2-b7cf-18b245c2d275 None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:22:58.275209 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b9660d-8353-43f2-b7cf-18b245c2d275 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:22:58.275379 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c1cd2f-ad6b-4e53-922b-214943b0e9fb service nova] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:22:58.275478 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b9660d-8353-43f2-b7cf-18b245c2d275 None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:22:58.275478 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 697/1388] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:22:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:22:58.280842 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d55a7-e200-4994-8929-08268caabeb6 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:22:58.281195 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d55a7-e200-4994-8929-08268caabeb6 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:22:58.281539 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d55a7-e200-4994-8929-08268caabeb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:22:58.294647 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 692/1389] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:22:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:22:58.319217 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:22:58.355500 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-834d55a7-e200-4994-8929-08268caabeb6 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:22:58.356751 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-834d55a7-e200-4994-8929-08268caabeb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:22:58.464895 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 698/1390] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:22:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 05:22:58.765012 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50953a49-3ada-4a8e-b738-38be15bd9bec None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:22:58.765494 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50953a49-3ada-4a8e-b738-38be15bd9bec None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:22:58.765595 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50953a49-3ada-4a8e-b738-38be15bd9bec None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:22:58.766893 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 693/1391] 10.222.0.16 () {54 vars in 966 bytes} [Sun Sep 11 05:22:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:22:58.772455 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00eec28-a7af-4929-af72-e64058d81ff7 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:22:58.772746 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00eec28-a7af-4929-af72-e64058d81ff7 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:22:58.773021 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00eec28-a7af-4929-af72-e64058d81ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:22:58.850036 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-e00eec28-a7af-4929-af72-e64058d81ff7 None None] MFA Rules not processed for user `bdd09106382447e9bf8b3a6a9ada89b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:22:58.851252 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-e00eec28-a7af-4929-af72-e64058d81ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:22:58.900147 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:22:58.928401 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 699/1392] 10.222.0.16 () {58 vars in 1063 bytes} [Sun Sep 11 05:22:58 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:22:58.937407 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50953a49-3ada-4a8e-b738-38be15bd9bec None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:22:58.938914 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-50953a49-3ada-4a8e-b738-38be15bd9bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:22:59.043583 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50953a49-3ada-4a8e-b738-38be15bd9bec None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:22:59.104233 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:22:59.119976 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880e3f1c-b876-4365-8775-07b8f8079475 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdd09106382447e9bf8b3a6a9ada89b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:22:59.120584 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880e3f1c-b876-4365-8775-07b8f8079475 service glance] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:22:59.120857 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880e3f1c-b876-4365-8775-07b8f8079475 service glance] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:22:59.121122 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880e3f1c-b876-4365-8775-07b8f8079475 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:22:59.122751 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-880e3f1c-b876-4365-8775-07b8f8079475 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:22:59.234330 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880e3f1c-b876-4365-8775-07b8f8079475 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:22:59.236506 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880e3f1c-b876-4365-8775-07b8f8079475 service glance] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:22:59.258654 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 694/1393] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:22:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:22:59.999548 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df5657a-dce1-47d8-9a10-2970e9bf1bb0 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:23:00.000043 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df5657a-dce1-47d8-9a10-2970e9bf1bb0 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:23:00.000197 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df5657a-dce1-47d8-9a10-2970e9bf1bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:23:00.068134 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-1df5657a-dce1-47d8-9a10-2970e9bf1bb0 None None] MFA Rules not processed for user `62fffbcf330a4bc183d0885c175f5a90`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:23:00.069373 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-1df5657a-dce1-47d8-9a10-2970e9bf1bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:23:00.155144 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 700/1394] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 05:22:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:23:00.198505 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e0511-aec2-4940-b678-893738ce4409 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:23:00.199005 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e0511-aec2-4940-b678-893738ce4409 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:23:00.199161 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e0511-aec2-4940-b678-893738ce4409 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:23:00.200778 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 695/1395] 10.222.0.16 () {54 vars in 943 bytes} [Sun Sep 11 05:23:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:23:00.207158 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602eb7b5-dceb-49bf-b8b1-e2cd1b8d2f5d None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:23:00.207446 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602eb7b5-dceb-49bf-b8b1-e2cd1b8d2f5d None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:23:00.207742 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602eb7b5-dceb-49bf-b8b1-e2cd1b8d2f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:23:00.285570 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-602eb7b5-dceb-49bf-b8b1-e2cd1b8d2f5d None None] MFA Rules not processed for user `2bbe4555380345e485572d2da8b78be1`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:23:00.286864 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-602eb7b5-dceb-49bf-b8b1-e2cd1b8d2f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:23:00.290098 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:23:00.401984 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 701/1396] 10.222.0.16 () {58 vars in 1040 bytes} [Sun Sep 11 05:23:00 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 05:23:00.411342 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592e0511-aec2-4940-b678-893738ce4409 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:23:00.412930 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-592e0511-aec2-4940-b678-893738ce4409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:23:00.473003 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd6cec-7278-42ac-b666-48e407a5fa80 None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:23:00.473301 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd6cec-7278-42ac-b666-48e407a5fa80 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:23:00.473586 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd6cec-7278-42ac-b666-48e407a5fa80 None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:23:00.474944 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 702/1397] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:23:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 05:23:00.480078 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba75c86-0cb7-4e4a-9636-809cbdc34c50 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:23:00.480391 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba75c86-0cb7-4e4a-9636-809cbdc34c50 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:23:00.480669 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba75c86-0cb7-4e4a-9636-809cbdc34c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:23:00.502421 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:23:00.548976 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-dba75c86-0cb7-4e4a-9636-809cbdc34c50 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:23:00.550109 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-dba75c86-0cb7-4e4a-9636-809cbdc34c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:23:00.556108 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592e0511-aec2-4940-b678-893738ce4409 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:23:00.622166 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:23:00.652229 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 703/1398] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:23:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 05:23:00.659053 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e934ce62-1e04-4a9d-aad3-16bb666f6693 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bbe4555380345e485572d2da8b78be1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:23:00.659654 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e934ce62-1e04-4a9d-aad3-16bb666f6693 service swift] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:23:00.659966 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e934ce62-1e04-4a9d-aad3-16bb666f6693 service swift] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:23:00.660234 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e934ce62-1e04-4a9d-aad3-16bb666f6693 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:23:00.662366 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-e934ce62-1e04-4a9d-aad3-16bb666f6693 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:23:00.733508 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:23:00.746559 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e934ce62-1e04-4a9d-aad3-16bb666f6693 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:23:00.748187 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e934ce62-1e04-4a9d-aad3-16bb666f6693 service swift] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:23:00.756398 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 696/1399] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 05:23:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 05:23:00.944714 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba75c86-0cb7-4e4a-9636-809cbdc34c50 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:23:00.946051 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-dba75c86-0cb7-4e4a-9636-809cbdc34c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:23:01.094072 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba75c86-0cb7-4e4a-9636-809cbdc34c50 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:23:01.180807 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:23:01.222188 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d075ac59-216b-4769-ad03-d2226700a266 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cd6136036bd467c946cae90d5c29263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:23:01.222811 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d075ac59-216b-4769-ad03-d2226700a266 service nova] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:23:01.223086 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d075ac59-216b-4769-ad03-d2226700a266 service nova] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:23:01.223352 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d075ac59-216b-4769-ad03-d2226700a266 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:23:01.225119 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-d075ac59-216b-4769-ad03-d2226700a266 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:23:01.333299 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d075ac59-216b-4769-ad03-d2226700a266 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:23:01.335031 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d075ac59-216b-4769-ad03-d2226700a266 service nova] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:23:01.355060 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 704/1400] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:23:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:23:03.578731 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de0d188-f133-4325-935e-be6abfa3211f None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:23:03.579346 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de0d188-f133-4325-935e-be6abfa3211f None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:23:03.579882 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de0d188-f133-4325-935e-be6abfa3211f None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:23:03.584745 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 697/1401] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:23:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:23:03.590383 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef19c47-8026-4a6f-b3d0-c074408344fb None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:23:03.590844 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef19c47-8026-4a6f-b3d0-c074408344fb None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:23:03.590959 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef19c47-8026-4a6f-b3d0-c074408344fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:23:03.663121 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-5ef19c47-8026-4a6f-b3d0-c074408344fb None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:23:03.664375 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-5ef19c47-8026-4a6f-b3d0-c074408344fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:23:03.715229 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:23:03.776904 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 705/1402] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:23:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:23:04.066650 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de0d188-f133-4325-935e-be6abfa3211f None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:23:04.068870 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-3de0d188-f133-4325-935e-be6abfa3211f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:23:04.241370 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de0d188-f133-4325-935e-be6abfa3211f None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:23:04.324335 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:23:04.384077 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62617879-0303-4175-8e06-d9b1f70178b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cd6136036bd467c946cae90d5c29263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:23:04.385297 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62617879-0303-4175-8e06-d9b1f70178b4 service nova] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:23:04.385783 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62617879-0303-4175-8e06-d9b1f70178b4 service nova] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:23:04.386220 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62617879-0303-4175-8e06-d9b1f70178b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:23:04.387899 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-62617879-0303-4175-8e06-d9b1f70178b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:23:04.491365 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62617879-0303-4175-8e06-d9b1f70178b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:23:04.493508 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62617879-0303-4175-8e06-d9b1f70178b4 service nova] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:23:04.512130 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 698/1403] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:23:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:23:06.764851 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce3362b-3a32-43b9-9e7f-99a81b817b86 None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:23:06.765433 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce3362b-3a32-43b9-9e7f-99a81b817b86 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:23:06.765433 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce3362b-3a32-43b9-9e7f-99a81b817b86 None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:23:06.766906 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 706/1404] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:23:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:23:06.772003 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb76d4-f234-4204-908e-bb4c1e4bd076 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:23:06.772426 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb76d4-f234-4204-908e-bb4c1e4bd076 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:23:06.772532 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb76d4-f234-4204-908e-bb4c1e4bd076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:23:06.854875 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-23fb76d4-f234-4204-908e-bb4c1e4bd076 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:23:06.856210 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-23fb76d4-f234-4204-908e-bb4c1e4bd076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:23:06.888437 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:23:06.974151 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 699/1405] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:23:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:23:07.261742 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce3362b-3a32-43b9-9e7f-99a81b817b86 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:23:07.263431 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-0ce3362b-3a32-43b9-9e7f-99a81b817b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:23:07.434575 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce3362b-3a32-43b9-9e7f-99a81b817b86 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:23:07.475317 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:23:07.585882 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f217c48-1aaf-4092-a2dc-9328720c3271 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cd6136036bd467c946cae90d5c29263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:23:07.586411 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f217c48-1aaf-4092-a2dc-9328720c3271 service nova] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:23:07.586690 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f217c48-1aaf-4092-a2dc-9328720c3271 service nova] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:23:07.586960 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f217c48-1aaf-4092-a2dc-9328720c3271 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:23:07.588608 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-4f217c48-1aaf-4092-a2dc-9328720c3271 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:23:07.696817 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f217c48-1aaf-4092-a2dc-9328720c3271 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:23:07.698438 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f217c48-1aaf-4092-a2dc-9328720c3271 service nova] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:23:07.718301 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 707/1406] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:23:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:23:09.937732 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae58f856-7d47-4949-9bd6-a225ecf0c5dd None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:23:09.938297 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae58f856-7d47-4949-9bd6-a225ecf0c5dd None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:23:09.938297 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae58f856-7d47-4949-9bd6-a225ecf0c5dd None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:23:09.939707 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 700/1407] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:23:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:23:09.945552 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc165bc0-066b-4f79-8458-791ea149dab0 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:23:09.945977 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc165bc0-066b-4f79-8458-791ea149dab0 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:23:09.946374 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc165bc0-066b-4f79-8458-791ea149dab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:23:10.039655 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:23:10.086349 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-bc165bc0-066b-4f79-8458-791ea149dab0 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:23:10.086349 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-bc165bc0-066b-4f79-8458-791ea149dab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:23:10.247373 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 708/1408] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:23:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:23:10.629109 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae58f856-7d47-4949-9bd6-a225ecf0c5dd None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:23:10.630881 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-ae58f856-7d47-4949-9bd6-a225ecf0c5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:23:10.795523 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae58f856-7d47-4949-9bd6-a225ecf0c5dd None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:23:10.804942 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:23:10.922926 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c787df-e80a-466a-ae73-d2aa0beb9129 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cd6136036bd467c946cae90d5c29263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:23:10.923537 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c787df-e80a-466a-ae73-d2aa0beb9129 service nova] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:23:10.923850 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c787df-e80a-466a-ae73-d2aa0beb9129 service nova] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:23:10.924121 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c787df-e80a-466a-ae73-d2aa0beb9129 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:23:10.925730 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-b9c787df-e80a-466a-ae73-d2aa0beb9129 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:23:11.024236 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c787df-e80a-466a-ae73-d2aa0beb9129 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:23:11.025872 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c787df-e80a-466a-ae73-d2aa0beb9129 service nova] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:23:11.045142 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 701/1409] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:23:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:23:20.245650 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=50 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:23:21.042781 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=94 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:23:23.413897 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cbbabf-ba82-4c42-a632-a4d23cd98f24 None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:23:23.414540 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cbbabf-ba82-4c42-a632-a4d23cd98f24 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:23:23.414540 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cbbabf-ba82-4c42-a632-a4d23cd98f24 None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:23:23.415819 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 709/1410] 10.222.0.16 () {54 vars in 918 bytes} [Sun Sep 11 05:23:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:23:23.420843 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b4883-939e-4f39-ae34-65cf9a881738 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:23:23.421296 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b4883-939e-4f39-ae34-65cf9a881738 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:23:23.421478 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b4883-939e-4f39-ae34-65cf9a881738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:23:23.496876 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-140b4883-939e-4f39-ae34-65cf9a881738 None None] MFA Rules not processed for user `72e1d7dd79ff43e7b585b5090762465f`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:23:23.498063 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-140b4883-939e-4f39-ae34-65cf9a881738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:23:23.600247 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 702/1411] 10.222.0.16 () {58 vars in 1015 bytes} [Sun Sep 11 05:23:23 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:23:23.614513 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234770c2-2795-4b13-8242-b074df1b7136 None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:23:23.614808 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234770c2-2795-4b13-8242-b074df1b7136 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:23:23.615066 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234770c2-2795-4b13-8242-b074df1b7136 None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:23:23.616430 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 710/1412] 10.222.0.16 () {54 vars in 918 bytes} [Sun Sep 11 05:23:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:23:23.620912 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f492c53-2299-47c9-a04f-ea93285b77c4 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:23:23.621223 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f492c53-2299-47c9-a04f-ea93285b77c4 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:23:23.621495 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f492c53-2299-47c9-a04f-ea93285b77c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:23:23.696316 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:23:23.699232 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-9f492c53-2299-47c9-a04f-ea93285b77c4 None None] MFA Rules not processed for user `6cd6136036bd467c946cae90d5c29263`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:23:23.701237 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-9f492c53-2299-47c9-a04f-ea93285b77c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:23:23.819381 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 703/1413] 10.222.0.16 () {58 vars in 1015 bytes} [Sun Sep 11 05:23:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 05:23:26.389330 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28248cfe-e87c-4cd3-87d5-f341d8cb14e5 None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:23:26.389876 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28248cfe-e87c-4cd3-87d5-f341d8cb14e5 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:23:26.389876 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28248cfe-e87c-4cd3-87d5-f341d8cb14e5 None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:23:26.391211 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 711/1414] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 05:23:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:23:26.396948 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1548a1d5-0126-49c3-82b1-4e8f758b31ef None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:23:26.397375 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1548a1d5-0126-49c3-82b1-4e8f758b31ef None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:23:26.397502 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1548a1d5-0126-49c3-82b1-4e8f758b31ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:23:26.461984 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-1548a1d5-0126-49c3-82b1-4e8f758b31ef None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:23:26.463177 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-1548a1d5-0126-49c3-82b1-4e8f758b31ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:23:26.516324 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:23:26.557428 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 704/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 05:23:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:23:26.844233 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28248cfe-e87c-4cd3-87d5-f341d8cb14e5 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:23:26.845787 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-28248cfe-e87c-4cd3-87d5-f341d8cb14e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:23:26.990315 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28248cfe-e87c-4cd3-87d5-f341d8cb14e5 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:23:27.061631 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:23:27.102211 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8fbe80-9e9f-4c70-b0ac-bcef8dcea94a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cd6136036bd467c946cae90d5c29263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:23:27.102816 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8fbe80-9e9f-4c70-b0ac-bcef8dcea94a service nova] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:23:27.103087 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8fbe80-9e9f-4c70-b0ac-bcef8dcea94a service nova] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:23:27.103348 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8fbe80-9e9f-4c70-b0ac-bcef8dcea94a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:23:27.104969 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-ce8fbe80-9e9f-4c70-b0ac-bcef8dcea94a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:23:27.195788 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8fbe80-9e9f-4c70-b0ac-bcef8dcea94a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:23:27.197472 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8fbe80-9e9f-4c70-b0ac-bcef8dcea94a service nova] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:23:27.215588 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 712/1416] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:23:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:23:28.346143 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a79176-aeaf-453a-9af1-a47387671462 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:23:28.346724 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a79176-aeaf-453a-9af1-a47387671462 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:23:28.346724 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a79176-aeaf-453a-9af1-a47387671462 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:23:28.349220 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 705/1417] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 11 05:23:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:23:28.354995 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c737dfe6-816d-4300-8d9f-ea14ac155886 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:23:28.355456 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c737dfe6-816d-4300-8d9f-ea14ac155886 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:23:28.355572 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c737dfe6-816d-4300-8d9f-ea14ac155886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:23:28.432296 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-c737dfe6-816d-4300-8d9f-ea14ac155886 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:23:28.433579 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-c737dfe6-816d-4300-8d9f-ea14ac155886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:23:28.461066 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:23:28.529764 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 713/1418] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 11 05:23:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:23:28.677308 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a79176-aeaf-453a-9af1-a47387671462 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:23:28.678850 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-54a79176-aeaf-453a-9af1-a47387671462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:23:28.825171 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a79176-aeaf-453a-9af1-a47387671462 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:23:28.864794 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:23:28.937485 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baddb7f-da9f-4524-8953-13e28a32898e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cd6136036bd467c946cae90d5c29263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:23:28.938026 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baddb7f-da9f-4524-8953-13e28a32898e service nova] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:23:28.938303 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baddb7f-da9f-4524-8953-13e28a32898e service nova] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:23:28.938572 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baddb7f-da9f-4524-8953-13e28a32898e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:23:28.940216 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-6baddb7f-da9f-4524-8953-13e28a32898e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:23:29.027790 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baddb7f-da9f-4524-8953-13e28a32898e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:23:29.029442 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baddb7f-da9f-4524-8953-13e28a32898e service nova] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:23:29.046824 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 706/1419] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:23:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:23:30.168422 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985fc8a3-a856-4084-b0e2-603df213da6e None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:23:30.168967 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985fc8a3-a856-4084-b0e2-603df213da6e None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:23:30.169068 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985fc8a3-a856-4084-b0e2-603df213da6e None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:23:30.170367 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 714/1420] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 11 05:23:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:23:30.176539 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5480c4-73b9-4fe0-a0f6-5fddd0b66065 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:23:30.176959 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5480c4-73b9-4fe0-a0f6-5fddd0b66065 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:23:30.177089 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5480c4-73b9-4fe0-a0f6-5fddd0b66065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:23:30.231953 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:23:30.254410 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-9c5480c4-73b9-4fe0-a0f6-5fddd0b66065 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:23:30.256222 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-9c5480c4-73b9-4fe0-a0f6-5fddd0b66065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:23:30.352164 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 707/1421] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 11 05:23:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:23:30.502728 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985fc8a3-a856-4084-b0e2-603df213da6e None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:23:30.504247 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-985fc8a3-a856-4084-b0e2-603df213da6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:23:30.648449 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985fc8a3-a856-4084-b0e2-603df213da6e None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:23:30.660263 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:23:30.762750 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98ba9dc-8d8c-4f06-ae27-01a192eff4fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cd6136036bd467c946cae90d5c29263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:23:30.763283 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98ba9dc-8d8c-4f06-ae27-01a192eff4fc service nova] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:23:30.763559 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98ba9dc-8d8c-4f06-ae27-01a192eff4fc service nova] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:23:30.763860 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98ba9dc-8d8c-4f06-ae27-01a192eff4fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:23:30.765498 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-a98ba9dc-8d8c-4f06-ae27-01a192eff4fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:23:30.853036 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98ba9dc-8d8c-4f06-ae27-01a192eff4fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:23:30.854626 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98ba9dc-8d8c-4f06-ae27-01a192eff4fc service nova] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:23:30.872729 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 715/1422] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:23:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:23:31.985146 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98fe30c-57e7-4e66-954e-57b1ec17786a None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:23:31.985712 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98fe30c-57e7-4e66-954e-57b1ec17786a None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:23:31.985712 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98fe30c-57e7-4e66-954e-57b1ec17786a None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:23:31.987022 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 708/1423] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 11 05:23:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:23:31.993840 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b7edf-56c1-4deb-8bd2-8aa614c9bcbb None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:23:31.994304 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b7edf-56c1-4deb-8bd2-8aa614c9bcbb None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:23:31.994413 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b7edf-56c1-4deb-8bd2-8aa614c9bcbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:23:32.014421 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:23:32.070062 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-4e1b7edf-56c1-4deb-8bd2-8aa614c9bcbb None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:23:32.071195 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-4e1b7edf-56c1-4deb-8bd2-8aa614c9bcbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:23:32.166373 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 716/1424] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 11 05:23:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:23:32.317799 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98fe30c-57e7-4e66-954e-57b1ec17786a None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:23:32.319309 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-f98fe30c-57e7-4e66-954e-57b1ec17786a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:23:32.430958 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:23:32.467076 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98fe30c-57e7-4e66-954e-57b1ec17786a None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:23:32.576043 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1772616c-345a-414a-873a-99e88c7a7c6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cd6136036bd467c946cae90d5c29263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:23:32.576639 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1772616c-345a-414a-873a-99e88c7a7c6c service nova] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:23:32.576912 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1772616c-345a-414a-873a-99e88c7a7c6c service nova] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:23:32.577180 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1772616c-345a-414a-873a-99e88c7a7c6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:23:32.578759 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-1772616c-345a-414a-873a-99e88c7a7c6c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:23:32.653649 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:23:32.667104 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1772616c-345a-414a-873a-99e88c7a7c6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:23:32.668729 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1772616c-345a-414a-873a-99e88c7a7c6c service nova] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:23:32.687090 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 709/1425] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:23:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:23:33.800091 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948225fe-4ffa-43ab-92bb-f7d3c843b7ca None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:23:33.800576 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948225fe-4ffa-43ab-92bb-f7d3c843b7ca None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:23:33.800684 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948225fe-4ffa-43ab-92bb-f7d3c843b7ca None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:23:33.802581 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 717/1426] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 11 05:23:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:23:33.808909 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ae14ad-3f7b-43aa-92d3-bfa7cafadd07 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:23:33.809353 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ae14ad-3f7b-43aa-92d3-bfa7cafadd07 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:23:33.809456 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ae14ad-3f7b-43aa-92d3-bfa7cafadd07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:23:33.884209 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-f0ae14ad-3f7b-43aa-92d3-bfa7cafadd07 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:23:33.885354 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-f0ae14ad-3f7b-43aa-92d3-bfa7cafadd07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:23:33.980573 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 710/1427] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 11 05:23:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:23:34.131357 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948225fe-4ffa-43ab-92bb-f7d3c843b7ca None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:23:34.132920 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-948225fe-4ffa-43ab-92bb-f7d3c843b7ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:23:34.216825 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:23:34.279980 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948225fe-4ffa-43ab-92bb-f7d3c843b7ca None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:23:34.395918 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4af98cc-ca68-4ee7-96ef-603af2948dec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cd6136036bd467c946cae90d5c29263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:23:34.396532 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4af98cc-ca68-4ee7-96ef-603af2948dec service nova] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:23:34.396808 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4af98cc-ca68-4ee7-96ef-603af2948dec service nova] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:23:34.397076 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4af98cc-ca68-4ee7-96ef-603af2948dec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:23:34.398678 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-d4af98cc-ca68-4ee7-96ef-603af2948dec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:23:34.446266 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:23:34.487494 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4af98cc-ca68-4ee7-96ef-603af2948dec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:23:34.489099 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4af98cc-ca68-4ee7-96ef-603af2948dec service nova] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:23:34.507411 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 718/1428] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:23:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:23:35.546694 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d45759-a588-4484-8198-4861aaf10470 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:23:35.547266 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d45759-a588-4484-8198-4861aaf10470 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:23:35.547266 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d45759-a588-4484-8198-4861aaf10470 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:23:35.548602 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 711/1429] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 11 05:23:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:23:35.554651 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b877c-08c5-4e30-98f5-d93cef1bdf50 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:23:35.555042 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b877c-08c5-4e30-98f5-d93cef1bdf50 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:23:35.555206 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b877c-08c5-4e30-98f5-d93cef1bdf50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:23:35.629989 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-088b877c-08c5-4e30-98f5-d93cef1bdf50 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:23:35.631191 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-088b877c-08c5-4e30-98f5-d93cef1bdf50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:23:35.728484 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 719/1430] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 11 05:23:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:23:35.877324 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d45759-a588-4484-8198-4861aaf10470 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:23:35.878889 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-01d45759-a588-4484-8198-4861aaf10470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:23:35.929075 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:23:36.145827 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d45759-a588-4484-8198-4861aaf10470 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:23:36.257366 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7fa047-0601-413f-b7ab-bbe1d5cc12b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cd6136036bd467c946cae90d5c29263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:23:36.257975 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7fa047-0601-413f-b7ab-bbe1d5cc12b4 service nova] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:23:36.258257 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7fa047-0601-413f-b7ab-bbe1d5cc12b4 service nova] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:23:36.258528 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7fa047-0601-413f-b7ab-bbe1d5cc12b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:23:36.260220 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-9b7fa047-0601-413f-b7ab-bbe1d5cc12b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:23:36.267089 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:23:36.351423 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7fa047-0601-413f-b7ab-bbe1d5cc12b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:23:36.353145 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7fa047-0601-413f-b7ab-bbe1d5cc12b4 service nova] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:23:36.371597 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 712/1431] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:23:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:23:37.420876 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d3f28-fef0-4b1e-92f3-9c4a051390fc None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:23:37.421456 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d3f28-fef0-4b1e-92f3-9c4a051390fc None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:23:37.421456 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d3f28-fef0-4b1e-92f3-9c4a051390fc None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:23:37.422775 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 720/1432] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 11 05:23:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:23:37.429808 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10744faf-0aa4-4bb9-bba1-32d2cfb131e7 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:23:37.430264 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10744faf-0aa4-4bb9-bba1-32d2cfb131e7 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:23:37.430368 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10744faf-0aa4-4bb9-bba1-32d2cfb131e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:23:37.504134 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-10744faf-0aa4-4bb9-bba1-32d2cfb131e7 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:23:37.505381 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-10744faf-0aa4-4bb9-bba1-32d2cfb131e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:23:37.572819 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:23:37.601375 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 713/1433] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 11 05:23:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:23:37.750690 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57d3f28-fef0-4b1e-92f3-9c4a051390fc None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:23:37.752219 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-b57d3f28-fef0-4b1e-92f3-9c4a051390fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:23:37.769376 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:23:37.898216 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57d3f28-fef0-4b1e-92f3-9c4a051390fc None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:23:37.983118 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:23:38.010179 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be3a152-c9b4-4a58-8fb1-a7623b7b6184 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cd6136036bd467c946cae90d5c29263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:23:38.010715 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3a152-c9b4-4a58-8fb1-a7623b7b6184 service nova] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:23:38.010992 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3a152-c9b4-4a58-8fb1-a7623b7b6184 service nova] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:23:38.011264 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3a152-c9b4-4a58-8fb1-a7623b7b6184 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:23:38.012919 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-4be3a152-c9b4-4a58-8fb1-a7623b7b6184 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:23:38.100465 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be3a152-c9b4-4a58-8fb1-a7623b7b6184 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:23:38.102063 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be3a152-c9b4-4a58-8fb1-a7623b7b6184 service nova] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:23:38.120227 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 721/1434] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:23:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:23:39.177647 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74022de1-acfd-44ba-b850-5c65d53897f9 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:23:39.178199 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74022de1-acfd-44ba-b850-5c65d53897f9 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:23:39.178199 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74022de1-acfd-44ba-b850-5c65d53897f9 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:23:39.179556 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 714/1435] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 11 05:23:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:23:39.185751 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7e98ca-373f-40c8-a3f9-fc65b0d5abf0 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:23:39.186212 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7e98ca-373f-40c8-a3f9-fc65b0d5abf0 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:23:39.186317 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7e98ca-373f-40c8-a3f9-fc65b0d5abf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:23:39.263575 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-ca7e98ca-373f-40c8-a3f9-fc65b0d5abf0 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:23:39.264880 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-ca7e98ca-373f-40c8-a3f9-fc65b0d5abf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:23:39.305417 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:23:39.359879 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 722/1436] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 11 05:23:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:23:39.511408 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74022de1-acfd-44ba-b850-5c65d53897f9 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:23:39.512937 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-74022de1-acfd-44ba-b850-5c65d53897f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:23:39.654879 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74022de1-acfd-44ba-b850-5c65d53897f9 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:23:39.708333 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:23:39.769677 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75c0682-6d14-4a8c-bcd9-22d284130ce0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cd6136036bd467c946cae90d5c29263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:23:39.770203 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c0682-6d14-4a8c-bcd9-22d284130ce0 service nova] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:23:39.770472 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c0682-6d14-4a8c-bcd9-22d284130ce0 service nova] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:23:39.770736 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c0682-6d14-4a8c-bcd9-22d284130ce0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:23:39.772359 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-d75c0682-6d14-4a8c-bcd9-22d284130ce0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:23:39.859931 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75c0682-6d14-4a8c-bcd9-22d284130ce0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:23:39.861530 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75c0682-6d14-4a8c-bcd9-22d284130ce0 service nova] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:23:39.881473 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 715/1437] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:23:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:23:40.931339 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751d2c04-88a3-46d2-912a-35974b3d5376 None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:23:40.931884 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751d2c04-88a3-46d2-912a-35974b3d5376 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:23:40.931884 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751d2c04-88a3-46d2-912a-35974b3d5376 None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:23:40.933165 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 723/1438] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 11 05:23:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:23:40.939424 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98638d-c20c-4d90-8ff1-f638626a5c19 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:23:40.939884 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98638d-c20c-4d90-8ff1-f638626a5c19 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:23:40.940000 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98638d-c20c-4d90-8ff1-f638626a5c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:23:41.014919 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-4a98638d-c20c-4d90-8ff1-f638626a5c19 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:23:41.016157 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-4a98638d-c20c-4d90-8ff1-f638626a5c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:23:41.018148 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:23:41.111323 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 716/1439] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 11 05:23:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:23:41.260757 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751d2c04-88a3-46d2-912a-35974b3d5376 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:23:41.262193 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-751d2c04-88a3-46d2-912a-35974b3d5376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:23:41.404828 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751d2c04-88a3-46d2-912a-35974b3d5376 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:23:41.434413 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:23:41.521051 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12253c1a-0dab-4af4-a02a-112a470f8e51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cd6136036bd467c946cae90d5c29263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:23:41.521618 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12253c1a-0dab-4af4-a02a-112a470f8e51 service nova] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:23:41.521895 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12253c1a-0dab-4af4-a02a-112a470f8e51 service nova] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:23:41.522167 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12253c1a-0dab-4af4-a02a-112a470f8e51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:23:41.523810 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-12253c1a-0dab-4af4-a02a-112a470f8e51 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:23:41.613450 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12253c1a-0dab-4af4-a02a-112a470f8e51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:23:41.615885 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12253c1a-0dab-4af4-a02a-112a470f8e51 service nova] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:23:41.634170 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 724/1440] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:23:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:23:43.678118 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195caf86-414f-4b5f-82cd-f2789bd4bf7f None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:23:43.678666 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195caf86-414f-4b5f-82cd-f2789bd4bf7f None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:23:43.678666 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195caf86-414f-4b5f-82cd-f2789bd4bf7f None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:23:43.680030 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 717/1441] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 05:23:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:23:43.685368 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d0e25-73fe-4411-9768-01c64dd14cef None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:23:43.685782 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d0e25-73fe-4411-9768-01c64dd14cef None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:23:43.685945 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d0e25-73fe-4411-9768-01c64dd14cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:23:43.726858 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:23:43.753730 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-f81d0e25-73fe-4411-9768-01c64dd14cef None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:23:43.755240 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-f81d0e25-73fe-4411-9768-01c64dd14cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:23:43.852352 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 725/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 05:23:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:23:44.133686 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195caf86-414f-4b5f-82cd-f2789bd4bf7f None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:23:44.135209 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-195caf86-414f-4b5f-82cd-f2789bd4bf7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:23:44.235993 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195caf86-414f-4b5f-82cd-f2789bd4bf7f None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:23:44.271372 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:23:44.312315 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98791934-77d5-4b81-bc3a-6fad6a917704 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:23:44.312925 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98791934-77d5-4b81-bc3a-6fad6a917704 service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:23:44.313199 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98791934-77d5-4b81-bc3a-6fad6a917704 service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:23:44.313464 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98791934-77d5-4b81-bc3a-6fad6a917704 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:23:44.315055 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-98791934-77d5-4b81-bc3a-6fad6a917704 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:23:44.420630 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98791934-77d5-4b81-bc3a-6fad6a917704 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:23:44.422071 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98791934-77d5-4b81-bc3a-6fad6a917704 service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:23:44.440036 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 718/1443] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:23:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:23:46.726054 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da300f-7347-46f4-9764-b6e4ff37cd3f None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:23:46.726551 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da300f-7347-46f4-9764-b6e4ff37cd3f None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:23:46.726668 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da300f-7347-46f4-9764-b6e4ff37cd3f None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:23:46.728014 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 726/1444] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 05:23:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:23:46.733112 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d326df-7316-4037-89bd-474e1d278e0d None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:23:46.733553 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d326df-7316-4037-89bd-474e1d278e0d None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:23:46.733659 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d326df-7316-4037-89bd-474e1d278e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:23:46.800425 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-31d326df-7316-4037-89bd-474e1d278e0d None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:23:46.801636 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-31d326df-7316-4037-89bd-474e1d278e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:23:46.813998 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:23:46.897347 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 719/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 05:23:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:23:47.180393 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53da300f-7347-46f4-9764-b6e4ff37cd3f None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:23:47.181932 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-53da300f-7347-46f4-9764-b6e4ff37cd3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:23:47.284832 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53da300f-7347-46f4-9764-b6e4ff37cd3f None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:23:47.297706 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:23:47.358534 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c8fb36-0eb3-43c5-8c39-c545b07fc64d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:23:47.359139 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c8fb36-0eb3-43c5-8c39-c545b07fc64d service neutron] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:23:47.359414 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c8fb36-0eb3-43c5-8c39-c545b07fc64d service neutron] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:23:47.359770 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c8fb36-0eb3-43c5-8c39-c545b07fc64d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:23:47.361325 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-50c8fb36-0eb3-43c5-8c39-c545b07fc64d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:23:47.469692 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c8fb36-0eb3-43c5-8c39-c545b07fc64d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:23:47.471126 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c8fb36-0eb3-43c5-8c39-c545b07fc64d service neutron] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:23:47.489404 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 727/1446] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:23:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:23:49.945005 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb42f5e-e4bf-400c-85e8-467050bda2ce None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:23:49.945599 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb42f5e-e4bf-400c-85e8-467050bda2ce None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:23:49.945599 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb42f5e-e4bf-400c-85e8-467050bda2ce None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:23:49.947028 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 720/1447] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 05:23:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:23:49.952415 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c5252a-3da8-4f7f-b2aa-aeb1570fec94 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:23:49.952825 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c5252a-3da8-4f7f-b2aa-aeb1570fec94 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:23:49.952968 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c5252a-3da8-4f7f-b2aa-aeb1570fec94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:23:50.001326 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:23:50.019651 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-44c5252a-3da8-4f7f-b2aa-aeb1570fec94 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:23:50.020887 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-44c5252a-3da8-4f7f-b2aa-aeb1570fec94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:23:50.118866 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 728/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 05:23:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:23:50.405341 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb42f5e-e4bf-400c-85e8-467050bda2ce None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:23:50.406871 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-fdb42f5e-e4bf-400c-85e8-467050bda2ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:23:50.509580 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb42f5e-e4bf-400c-85e8-467050bda2ce None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:23:50.547932 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:23:50.581507 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0dfbe1-dbcd-495f-9bf5-9c040246c925 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:23:50.582096 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0dfbe1-dbcd-495f-9bf5-9c040246c925 service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:23:50.582896 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0dfbe1-dbcd-495f-9bf5-9c040246c925 service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:23:50.583160 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0dfbe1-dbcd-495f-9bf5-9c040246c925 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:23:50.584780 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-ea0dfbe1-dbcd-495f-9bf5-9c040246c925 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:23:50.691456 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0dfbe1-dbcd-495f-9bf5-9c040246c925 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:23:50.692964 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0dfbe1-dbcd-495f-9bf5-9c040246c925 service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:23:50.710859 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 721/1449] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:23:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:23:52.987748 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc15f244-6b41-4697-b3f6-8d58b8849e67 None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:23:52.988261 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc15f244-6b41-4697-b3f6-8d58b8849e67 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:23:52.988261 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc15f244-6b41-4697-b3f6-8d58b8849e67 None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:23:52.990352 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 729/1450] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 05:23:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:23:52.995603 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8707184-da95-4711-8268-9ef1ec50f0dc None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:23:52.996032 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8707184-da95-4711-8268-9ef1ec50f0dc None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:23:52.996220 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8707184-da95-4711-8268-9ef1ec50f0dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:23:53.060976 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-d8707184-da95-4711-8268-9ef1ec50f0dc None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:23:53.062167 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-d8707184-da95-4711-8268-9ef1ec50f0dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:23:53.082552 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:23:53.156943 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 722/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 05:23:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:23:53.440151 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc15f244-6b41-4697-b3f6-8d58b8849e67 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:23:53.441736 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-cc15f244-6b41-4697-b3f6-8d58b8849e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:23:53.542964 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc15f244-6b41-4697-b3f6-8d58b8849e67 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:23:53.563441 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:23:53.616331 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f06ecc5-5db8-4533-bd8b-fd5b128c39bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:23:53.616915 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f06ecc5-5db8-4533-bd8b-fd5b128c39bd service neutron] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:23:53.617191 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f06ecc5-5db8-4533-bd8b-fd5b128c39bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:23:53.617462 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f06ecc5-5db8-4533-bd8b-fd5b128c39bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:23:53.619044 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-6f06ecc5-5db8-4533-bd8b-fd5b128c39bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:23:53.726915 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f06ecc5-5db8-4533-bd8b-fd5b128c39bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:23:53.728347 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f06ecc5-5db8-4533-bd8b-fd5b128c39bd service neutron] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:23:53.746984 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 730/1452] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:23:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:23:55.973409 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab122932-4d20-478a-ab6b-460afb11bea9 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:23:55.973938 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab122932-4d20-478a-ab6b-460afb11bea9 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:23:55.973938 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab122932-4d20-478a-ab6b-460afb11bea9 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:23:55.975299 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 723/1453] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 05:23:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:23:55.980685 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb34f26-8bdf-4bd4-a4f7-93a8c3325512 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:23:55.981114 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb34f26-8bdf-4bd4-a4f7-93a8c3325512 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:23:55.981256 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb34f26-8bdf-4bd4-a4f7-93a8c3325512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:23:56.060049 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:23:56.062924 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-2fb34f26-8bdf-4bd4-a4f7-93a8c3325512 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:23:56.065882 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-2fb34f26-8bdf-4bd4-a4f7-93a8c3325512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:23:56.164704 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 731/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 05:23:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 05:23:56.450673 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab122932-4d20-478a-ab6b-460afb11bea9 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:23:56.452257 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-ab122932-4d20-478a-ab6b-460afb11bea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:23:56.553365 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab122932-4d20-478a-ab6b-460afb11bea9 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:23:56.601001 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:23:56.625981 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f283a5-7354-4042-9528-0e9442159506 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:23:56.626581 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f283a5-7354-4042-9528-0e9442159506 service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:23:56.626856 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f283a5-7354-4042-9528-0e9442159506 service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:23:56.627123 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f283a5-7354-4042-9528-0e9442159506 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:23:56.628756 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-a7f283a5-7354-4042-9528-0e9442159506 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:23:56.737248 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f283a5-7354-4042-9528-0e9442159506 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:23:56.738690 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f283a5-7354-4042-9528-0e9442159506 service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:23:56.756764 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 724/1455] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:23:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:23:58.930604 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3231a243-e51f-4b6f-ad7e-bc5a74286c8c None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:23:58.931136 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3231a243-e51f-4b6f-ad7e-bc5a74286c8c None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:23:58.931136 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3231a243-e51f-4b6f-ad7e-bc5a74286c8c None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:23:58.932520 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 732/1456] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 05:23:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:23:58.937796 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b9737-6fd9-46d8-9391-74bad3ebbb44 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:23:58.938215 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b9737-6fd9-46d8-9391-74bad3ebbb44 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:23:58.938313 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b9737-6fd9-46d8-9391-74bad3ebbb44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:23:59.002904 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-ac3b9737-6fd9-46d8-9391-74bad3ebbb44 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:23:59.004716 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-ac3b9737-6fd9-46d8-9391-74bad3ebbb44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:23:59.032954 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:23:59.100716 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 725/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 05:23:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:23:59.382522 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3231a243-e51f-4b6f-ad7e-bc5a74286c8c None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:23:59.384100 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-3231a243-e51f-4b6f-ad7e-bc5a74286c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:23:59.488011 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3231a243-e51f-4b6f-ad7e-bc5a74286c8c None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:23:59.517504 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:23:59.562232 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b372725d-1eeb-4e48-b17b-b365ec63e69a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:23:59.562836 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b372725d-1eeb-4e48-b17b-b365ec63e69a service neutron] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:23:59.563112 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b372725d-1eeb-4e48-b17b-b365ec63e69a service neutron] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:23:59.563381 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b372725d-1eeb-4e48-b17b-b365ec63e69a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:23:59.565030 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-b372725d-1eeb-4e48-b17b-b365ec63e69a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:23:59.672522 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b372725d-1eeb-4e48-b17b-b365ec63e69a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:23:59.673948 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b372725d-1eeb-4e48-b17b-b365ec63e69a service neutron] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:23:59.810942 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 733/1458] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:23:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:24:01.998182 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c0536-2da3-4cf0-9352-3bbc4957b401 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:24:01.998720 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c0536-2da3-4cf0-9352-3bbc4957b401 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:24:01.998720 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c0536-2da3-4cf0-9352-3bbc4957b401 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:24:02.000164 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 726/1459] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 05:24:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:24:02.005904 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e840d0da-e547-4b1d-aa51-a1552d7668b4 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:24:02.006292 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e840d0da-e547-4b1d-aa51-a1552d7668b4 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:24:02.006434 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e840d0da-e547-4b1d-aa51-a1552d7668b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:24:02.070335 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-e840d0da-e547-4b1d-aa51-a1552d7668b4 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:24:02.071450 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-e840d0da-e547-4b1d-aa51-a1552d7668b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:24:02.079504 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:24:02.166716 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 734/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 05:24:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:24:02.449342 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c0536-2da3-4cf0-9352-3bbc4957b401 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:24:02.450886 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-4e7c0536-2da3-4cf0-9352-3bbc4957b401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:24:02.553755 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c0536-2da3-4cf0-9352-3bbc4957b401 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:24:02.608372 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:24:02.627131 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e4508f-daff-49b0-aa87-7de0ad28cbc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:24:02.627763 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e4508f-daff-49b0-aa87-7de0ad28cbc2 service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:24:02.628046 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e4508f-daff-49b0-aa87-7de0ad28cbc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:24:02.628320 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e4508f-daff-49b0-aa87-7de0ad28cbc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:24:02.630486 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-19e4508f-daff-49b0-aa87-7de0ad28cbc2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:24:02.737550 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e4508f-daff-49b0-aa87-7de0ad28cbc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:24:02.739460 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e4508f-daff-49b0-aa87-7de0ad28cbc2 service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:24:02.757981 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 727/1461] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:24:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:24:04.994954 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cace1fb7-6d9e-4347-a1ba-c7af38a61fc2 None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:24:04.995566 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cace1fb7-6d9e-4347-a1ba-c7af38a61fc2 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:24:04.995566 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cace1fb7-6d9e-4347-a1ba-c7af38a61fc2 None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:24:04.996881 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 735/1462] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 05:24:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:24:05.002205 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84371e2f-67d2-48ec-94c2-2274c439e640 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:24:05.002608 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84371e2f-67d2-48ec-94c2-2274c439e640 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:24:05.002749 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84371e2f-67d2-48ec-94c2-2274c439e640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:24:05.068399 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-84371e2f-67d2-48ec-94c2-2274c439e640 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:24:05.069602 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-84371e2f-67d2-48ec-94c2-2274c439e640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:24:05.107218 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:24:05.164805 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 728/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 05:24:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:24:05.454421 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cace1fb7-6d9e-4347-a1ba-c7af38a61fc2 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:24:05.456064 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-cace1fb7-6d9e-4347-a1ba-c7af38a61fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:24:05.558127 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cace1fb7-6d9e-4347-a1ba-c7af38a61fc2 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:24:05.595752 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:24:05.632158 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae18fc5-24f0-4f46-91d1-0750b0a2f5be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:24:05.632764 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae18fc5-24f0-4f46-91d1-0750b0a2f5be service neutron] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:24:05.633043 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae18fc5-24f0-4f46-91d1-0750b0a2f5be service neutron] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:24:05.633315 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae18fc5-24f0-4f46-91d1-0750b0a2f5be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:24:05.634915 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-cae18fc5-24f0-4f46-91d1-0750b0a2f5be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:24:05.745501 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae18fc5-24f0-4f46-91d1-0750b0a2f5be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:24:05.746926 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae18fc5-24f0-4f46-91d1-0750b0a2f5be service neutron] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:24:05.765240 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 736/1464] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:24:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:24:07.935065 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d695ae0a-57df-422b-b1b7-7d007ba20e25 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:24:07.935650 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d695ae0a-57df-422b-b1b7-7d007ba20e25 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:24:07.935650 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d695ae0a-57df-422b-b1b7-7d007ba20e25 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:24:07.936974 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 729/1465] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 05:24:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:24:07.942924 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c425a4bd-1a79-483e-a0c8-71de7dc198b3 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:24:07.943391 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c425a4bd-1a79-483e-a0c8-71de7dc198b3 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:24:07.943514 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c425a4bd-1a79-483e-a0c8-71de7dc198b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:24:08.008872 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-c425a4bd-1a79-483e-a0c8-71de7dc198b3 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:24:08.010075 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-c425a4bd-1a79-483e-a0c8-71de7dc198b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:24:08.027518 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:24:08.104016 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 737/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 05:24:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:24:08.385072 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d695ae0a-57df-422b-b1b7-7d007ba20e25 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:24:08.386617 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-d695ae0a-57df-422b-b1b7-7d007ba20e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:24:08.487779 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d695ae0a-57df-422b-b1b7-7d007ba20e25 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:24:08.553382 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:24:08.560177 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d7bcce-6042-4c07-bd39-00f756d5015d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:24:08.560786 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d7bcce-6042-4c07-bd39-00f756d5015d service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:24:08.561061 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d7bcce-6042-4c07-bd39-00f756d5015d service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:24:08.561330 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d7bcce-6042-4c07-bd39-00f756d5015d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:24:08.562910 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-c6d7bcce-6042-4c07-bd39-00f756d5015d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:24:08.669797 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d7bcce-6042-4c07-bd39-00f756d5015d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:24:08.671234 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d7bcce-6042-4c07-bd39-00f756d5015d service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:24:08.689594 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 730/1467] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:24:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:24:10.905668 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15c4b8-08e1-4dfa-9df7-138de18e8d8f None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:24:10.906240 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15c4b8-08e1-4dfa-9df7-138de18e8d8f None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:24:10.906240 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15c4b8-08e1-4dfa-9df7-138de18e8d8f None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:24:10.907559 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 738/1468] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 05:24:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:24:10.913696 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc6fcd-e91d-4db8-b648-314ab16a2470 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:24:10.914105 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc6fcd-e91d-4db8-b648-314ab16a2470 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:24:10.914243 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc6fcd-e91d-4db8-b648-314ab16a2470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:24:10.979404 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-45dc6fcd-e91d-4db8-b648-314ab16a2470 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:24:10.980581 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-45dc6fcd-e91d-4db8-b648-314ab16a2470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:24:11.028200 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:24:11.076915 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 731/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 05:24:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:24:11.369388 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa15c4b8-08e1-4dfa-9df7-138de18e8d8f None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:24:11.370956 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-fa15c4b8-08e1-4dfa-9df7-138de18e8d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:24:11.477461 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa15c4b8-08e1-4dfa-9df7-138de18e8d8f None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:24:11.525092 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:24:11.549962 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02360a2e-ea6a-4f42-93c8-638f1dac1e5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:24:11.550563 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02360a2e-ea6a-4f42-93c8-638f1dac1e5c service neutron] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:24:11.551327 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02360a2e-ea6a-4f42-93c8-638f1dac1e5c service neutron] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:24:11.551624 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02360a2e-ea6a-4f42-93c8-638f1dac1e5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:24:11.553261 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-02360a2e-ea6a-4f42-93c8-638f1dac1e5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:24:11.660938 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02360a2e-ea6a-4f42-93c8-638f1dac1e5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:24:11.662359 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02360a2e-ea6a-4f42-93c8-638f1dac1e5c service neutron] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:24:11.680742 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 739/1470] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:24:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:24:21.075462 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=22 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:24:21.678464 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=66 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:24:31.515910 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76985857-b655-4525-b4b1-32dd4123189f None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:24:31.516506 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76985857-b655-4525-b4b1-32dd4123189f None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:24:31.516506 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76985857-b655-4525-b4b1-32dd4123189f None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:24:31.517798 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 732/1471] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:24:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:24:31.523096 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f9304-8aaa-4711-9ffd-e9d844546b79 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:24:31.523535 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f9304-8aaa-4711-9ffd-e9d844546b79 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:24:31.523647 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f9304-8aaa-4711-9ffd-e9d844546b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:24:31.588000 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-145f9304-8aaa-4711-9ffd-e9d844546b79 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:24:31.589196 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-145f9304-8aaa-4711-9ffd-e9d844546b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:24:31.684834 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 740/1472] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:24:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:24:31.984558 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c603c-0a61-40e5-8859-ff65163146f7 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:24:31.984850 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c603c-0a61-40e5-8859-ff65163146f7 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:24:31.985124 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c603c-0a61-40e5-8859-ff65163146f7 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:24:31.986477 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 733/1473] 10.222.0.16 () {54 vars in 966 bytes} [Sun Sep 11 05:24:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:24:31.991707 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ee0cf-99a6-4e6d-937e-47eb077f91bf None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:24:31.991990 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ee0cf-99a6-4e6d-937e-47eb077f91bf None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:24:31.992288 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ee0cf-99a6-4e6d-937e-47eb077f91bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:24:32.067250 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-c89ee0cf-99a6-4e6d-937e-47eb077f91bf None None] MFA Rules not processed for user `bdd09106382447e9bf8b3a6a9ada89b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:24:32.068407 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-c89ee0cf-99a6-4e6d-937e-47eb077f91bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:24:32.088975 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:24:32.143786 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 741/1474] 10.222.0.16 () {58 vars in 1063 bytes} [Sun Sep 11 05:24:31 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:24:32.152018 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c603c-0a61-40e5-8859-ff65163146f7 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:24:32.153561 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-7b2c603c-0a61-40e5-8859-ff65163146f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:24:32.256712 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c603c-0a61-40e5-8859-ff65163146f7 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:24:32.329006 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6397e44b-067d-4c6e-bf38-879da106838c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdd09106382447e9bf8b3a6a9ada89b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:24:32.329521 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6397e44b-067d-4c6e-bf38-879da106838c service glance] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:24:32.329794 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6397e44b-067d-4c6e-bf38-879da106838c service glance] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:24:32.330057 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6397e44b-067d-4c6e-bf38-879da106838c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:24:32.332273 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-6397e44b-067d-4c6e-bf38-879da106838c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:24:32.384617 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:24:32.437814 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6397e44b-067d-4c6e-bf38-879da106838c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:24:32.439248 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6397e44b-067d-4c6e-bf38-879da106838c service glance] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:24:32.458118 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 734/1475] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:24:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 05:24:34.674300 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aafc2a-0159-4865-b394-2d7891fbde7f None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:24:34.674847 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aafc2a-0159-4865-b394-2d7891fbde7f None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:24:34.674847 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aafc2a-0159-4865-b394-2d7891fbde7f None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:24:34.676824 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 742/1476] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:24:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:24:34.682102 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c63cca-c355-47e6-b844-d77a564e2cc3 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:24:34.682550 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c63cca-c355-47e6-b844-d77a564e2cc3 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:24:34.682660 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c63cca-c355-47e6-b844-d77a564e2cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:24:34.747855 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-21c63cca-c355-47e6-b844-d77a564e2cc3 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:24:34.749060 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-21c63cca-c355-47e6-b844-d77a564e2cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:24:34.848296 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 735/1477] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:24:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:24:35.123066 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aafc2a-0159-4865-b394-2d7891fbde7f None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:24:35.124585 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-e5aafc2a-0159-4865-b394-2d7891fbde7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:24:35.250761 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aafc2a-0159-4865-b394-2d7891fbde7f None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:24:35.300026 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:24:35.344383 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b0f6cf-93ae-44c9-aba9-834226883905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:24:35.344984 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b0f6cf-93ae-44c9-aba9-834226883905 admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:24:35.345256 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b0f6cf-93ae-44c9-aba9-834226883905 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:24:35.345526 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b0f6cf-93ae-44c9-aba9-834226883905 admin admin] PATH_INFO: `/v3/projects` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:24:35.346155 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b0f6cf-93ae-44c9-aba9-834226883905 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:24:35.347902 dv-cinder-856921-1-smb devstack@keystone.service[81383]: WARNING py.warnings [None req-02b0f6cf-93ae-44c9-aba9-834226883905 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 05:24:35.347902 dv-cinder-856921-1-smb devstack@keystone.service[81383]: warnings.warn(msg) Sep 11 05:24:35.347902 dv-cinder-856921-1-smb devstack@keystone.service[81383]: Sep 11 05:24:35.349026 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b0f6cf-93ae-44c9-aba9-834226883905 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:24:35.367639 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 743/1478] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 05:24:35 2022] GET /identity/v3/projects => generated 2553 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:24:37.526289 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a557d4-3ccf-4712-81dd-e6a7dd80935c None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:24:37.526840 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a557d4-3ccf-4712-81dd-e6a7dd80935c None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:24:37.526962 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a557d4-3ccf-4712-81dd-e6a7dd80935c None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:24:37.528304 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 736/1479] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:24:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:24:37.533504 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a9dcb-038b-4d01-a65b-4a29e18e74ec None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:24:37.533948 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a9dcb-038b-4d01-a65b-4a29e18e74ec None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:24:37.534057 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a9dcb-038b-4d01-a65b-4a29e18e74ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:24:37.598932 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-933a9dcb-038b-4d01-a65b-4a29e18e74ec None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:24:37.600152 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-933a9dcb-038b-4d01-a65b-4a29e18e74ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:24:37.696137 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 744/1480] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:24:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:24:37.990155 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a557d4-3ccf-4712-81dd-e6a7dd80935c None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:24:37.992187 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-33a557d4-3ccf-4712-81dd-e6a7dd80935c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:24:38.002027 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:24:38.139622 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a557d4-3ccf-4712-81dd-e6a7dd80935c None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:24:38.221338 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:24:38.253860 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59551897-cfc2-43ff-a838-d0d99eb93f2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cd6136036bd467c946cae90d5c29263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:24:38.254460 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59551897-cfc2-43ff-a838-d0d99eb93f2d service nova] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:24:38.254734 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59551897-cfc2-43ff-a838-d0d99eb93f2d service nova] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:24:38.255014 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59551897-cfc2-43ff-a838-d0d99eb93f2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:24:38.256625 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-59551897-cfc2-43ff-a838-d0d99eb93f2d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:24:38.343781 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59551897-cfc2-43ff-a838-d0d99eb93f2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:24:38.345382 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59551897-cfc2-43ff-a838-d0d99eb93f2d service nova] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:24:38.362843 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 737/1481] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:24:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:24:40.680349 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d633551f-2777-468f-9f0b-fcb879a3f6ab None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:24:40.680947 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d633551f-2777-468f-9f0b-fcb879a3f6ab None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:24:40.680947 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d633551f-2777-468f-9f0b-fcb879a3f6ab None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:24:40.682276 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 745/1482] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:24:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:24:40.687470 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308dc321-6836-46c8-b515-c582ff8d09c9 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:24:40.687954 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308dc321-6836-46c8-b515-c582ff8d09c9 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:24:40.688060 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308dc321-6836-46c8-b515-c582ff8d09c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:24:40.754712 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-308dc321-6836-46c8-b515-c582ff8d09c9 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:24:40.756225 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-308dc321-6836-46c8-b515-c582ff8d09c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:24:40.801789 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:24:40.858294 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 738/1483] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:24:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:24:41.145233 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d633551f-2777-468f-9f0b-fcb879a3f6ab None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:24:41.146782 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-d633551f-2777-468f-9f0b-fcb879a3f6ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:24:41.173266 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:24:41.254504 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d633551f-2777-468f-9f0b-fcb879a3f6ab None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:24:41.325581 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2775b7-d0ce-472b-b110-d6b2022e5eb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:24:41.326191 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2775b7-d0ce-472b-b110-d6b2022e5eb8 service neutron] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:24:41.326463 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2775b7-d0ce-472b-b110-d6b2022e5eb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:24:41.326727 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2775b7-d0ce-472b-b110-d6b2022e5eb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:24:41.328361 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-ac2775b7-d0ce-472b-b110-d6b2022e5eb8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:24:41.401564 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:24:41.437890 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2775b7-d0ce-472b-b110-d6b2022e5eb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:24:41.439349 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2775b7-d0ce-472b-b110-d6b2022e5eb8 service neutron] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:24:41.458019 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 746/1484] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:24:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:24:43.675097 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b81fd-efe1-449a-bc11-d22befec9d45 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:24:43.675669 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b81fd-efe1-449a-bc11-d22befec9d45 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:24:43.675669 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b81fd-efe1-449a-bc11-d22befec9d45 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:24:43.677046 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 739/1485] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:24:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:24:43.682228 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c09f780-ec0d-4ce4-9a58-5bfddb898bbd None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:24:43.682660 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c09f780-ec0d-4ce4-9a58-5bfddb898bbd None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:24:43.682806 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c09f780-ec0d-4ce4-9a58-5bfddb898bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:24:43.748754 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-8c09f780-ec0d-4ce4-9a58-5bfddb898bbd None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:24:43.749971 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-8c09f780-ec0d-4ce4-9a58-5bfddb898bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:24:43.845365 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 747/1486] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:24:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:24:44.130839 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341b81fd-efe1-449a-bc11-d22befec9d45 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:24:44.132443 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-341b81fd-efe1-449a-bc11-d22befec9d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:24:44.235800 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341b81fd-efe1-449a-bc11-d22befec9d45 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:24:44.310227 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:24:44.311897 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c47fc3a-ae5e-4f37-9761-a9391fbc7b9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:24:44.312570 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c47fc3a-ae5e-4f37-9761-a9391fbc7b9a service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:24:44.313075 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c47fc3a-ae5e-4f37-9761-a9391fbc7b9a service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:24:44.313503 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c47fc3a-ae5e-4f37-9761-a9391fbc7b9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:24:44.315345 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-1c47fc3a-ae5e-4f37-9761-a9391fbc7b9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:24:44.422604 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c47fc3a-ae5e-4f37-9761-a9391fbc7b9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:24:44.424067 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c47fc3a-ae5e-4f37-9761-a9391fbc7b9a service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:24:44.441905 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 740/1487] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:24:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:24:46.712440 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70390c20-49c4-443c-aecb-9ec61e6dc325 None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:24:46.712898 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70390c20-49c4-443c-aecb-9ec61e6dc325 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:24:46.713017 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70390c20-49c4-443c-aecb-9ec61e6dc325 None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:24:46.714437 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 748/1488] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:24:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 05:24:46.719691 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30b9d0b-e45a-4d79-ae60-4b47a7bb0abe None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:24:46.720108 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30b9d0b-e45a-4d79-ae60-4b47a7bb0abe None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:24:46.720260 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30b9d0b-e45a-4d79-ae60-4b47a7bb0abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:24:46.786214 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-d30b9d0b-e45a-4d79-ae60-4b47a7bb0abe None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:24:46.787435 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-d30b9d0b-e45a-4d79-ae60-4b47a7bb0abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:24:46.839917 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:24:46.884566 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 741/1489] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:24:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:24:47.179923 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70390c20-49c4-443c-aecb-9ec61e6dc325 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:24:47.181463 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-70390c20-49c4-443c-aecb-9ec61e6dc325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:24:47.217629 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:24:47.285686 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70390c20-49c4-443c-aecb-9ec61e6dc325 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:24:47.359703 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8330ad-15b8-4cb3-bbf1-77322ed85287 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:24:47.360315 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8330ad-15b8-4cb3-bbf1-77322ed85287 service neutron] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:24:47.360589 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8330ad-15b8-4cb3-bbf1-77322ed85287 service neutron] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:24:47.360858 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8330ad-15b8-4cb3-bbf1-77322ed85287 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:24:47.362445 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-ff8330ad-15b8-4cb3-bbf1-77322ed85287 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:24:47.441224 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:24:47.469465 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8330ad-15b8-4cb3-bbf1-77322ed85287 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:24:47.470898 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8330ad-15b8-4cb3-bbf1-77322ed85287 service neutron] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:24:47.489114 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 749/1490] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:24:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:24:49.841030 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9945933c-d322-40ea-9987-9b0e7abab3f3 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:24:49.841509 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9945933c-d322-40ea-9987-9b0e7abab3f3 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:24:49.841619 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9945933c-d322-40ea-9987-9b0e7abab3f3 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:24:49.842957 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 742/1491] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 05:24:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:24:49.849092 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb8f8b-6948-4553-af92-45f6e6dd30c2 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:24:49.849522 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb8f8b-6948-4553-af92-45f6e6dd30c2 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:24:49.849645 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb8f8b-6948-4553-af92-45f6e6dd30c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:24:49.924302 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-3fbb8f8b-6948-4553-af92-45f6e6dd30c2 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:24:49.925523 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-3fbb8f8b-6948-4553-af92-45f6e6dd30c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:24:50.021242 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 750/1492] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 05:24:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:24:50.310479 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9945933c-d322-40ea-9987-9b0e7abab3f3 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:24:50.312483 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-9945933c-d322-40ea-9987-9b0e7abab3f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:24:50.413293 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9945933c-d322-40ea-9987-9b0e7abab3f3 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:24:50.486929 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac2629a-8f3e-4646-bcb3-bb5fb545a733 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:24:50.488234 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac2629a-8f3e-4646-bcb3-bb5fb545a733 service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:24:50.488507 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac2629a-8f3e-4646-bcb3-bb5fb545a733 service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:24:50.488771 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac2629a-8f3e-4646-bcb3-bb5fb545a733 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:24:50.490379 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-0ac2629a-8f3e-4646-bcb3-bb5fb545a733 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:24:50.500001 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:24:50.601977 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac2629a-8f3e-4646-bcb3-bb5fb545a733 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:24:50.603345 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac2629a-8f3e-4646-bcb3-bb5fb545a733 service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:24:50.621727 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 743/1493] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:24:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:25:00.019596 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=82 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:25:00.619580 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=50 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:26:10.248048 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c20337-8327-40f9-9b53-8279927233d0 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:26:10.248711 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c20337-8327-40f9-9b53-8279927233d0 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:26:10.248711 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c20337-8327-40f9-9b53-8279927233d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:26:10.323187 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-50c20337-8327-40f9-9b53-8279927233d0 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:26:10.324410 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-50c20337-8327-40f9-9b53-8279927233d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:26:10.421215 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 751/1494] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:26:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:26:10.429165 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99ab57-6f22-49c0-a920-0effc6d75763 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:26:10.429672 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99ab57-6f22-49c0-a920-0effc6d75763 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:26:10.429779 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99ab57-6f22-49c0-a920-0effc6d75763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:26:10.504579 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-2b99ab57-6f22-49c0-a920-0effc6d75763 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:26:10.505741 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-2b99ab57-6f22-49c0-a920-0effc6d75763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:26:10.600574 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 744/1495] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:26:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:26:10.605194 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c20337-8327-40f9-9b53-8279927233d0 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:26:10.606472 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-50c20337-8327-40f9-9b53-8279927233d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:26:10.618076 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c20337-8327-40f9-9b53-8279927233d0 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:26:10.679865 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:26:10.714906 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a373af90-d6a6-40af-8091-e538dc2e627d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:26:10.715509 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a373af90-d6a6-40af-8091-e538dc2e627d admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:26:10.715812 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a373af90-d6a6-40af-8091-e538dc2e627d admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:26:10.716080 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a373af90-d6a6-40af-8091-e538dc2e627d admin admin] PATH_INFO: `/v3/domains` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:26:10.716711 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a373af90-d6a6-40af-8091-e538dc2e627d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:26:10.717006 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a373af90-d6a6-40af-8091-e538dc2e627d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:26:10.718041 dv-cinder-856921-1-smb devstack@keystone.service[81383]: WARNING py.warnings [None req-a373af90-d6a6-40af-8091-e538dc2e627d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 05:26:10.718041 dv-cinder-856921-1-smb devstack@keystone.service[81383]: warnings.warn(msg) Sep 11 05:26:10.718041 dv-cinder-856921-1-smb devstack@keystone.service[81383]: Sep 11 05:26:10.718921 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a373af90-d6a6-40af-8091-e538dc2e627d admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:26:10.729762 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 752/1496] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 05:26:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:26:10.738557 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b99ab57-6f22-49c0-a920-0effc6d75763 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:26:10.747880 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b99ab57-6f22-49c0-a920-0effc6d75763 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:26:10.809596 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:26:10.843148 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957e7986-6cdf-40f3-aea5-ca50b6b9bfc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:26:10.843778 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e7986-6cdf-40f3-aea5-ca50b6b9bfc0 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:26:10.844056 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e7986-6cdf-40f3-aea5-ca50b6b9bfc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:26:10.844356 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e7986-6cdf-40f3-aea5-ca50b6b9bfc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:26:10.844990 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957e7986-6cdf-40f3-aea5-ca50b6b9bfc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:26:10.846711 dv-cinder-856921-1-smb devstack@keystone.service[81384]: WARNING py.warnings [None req-957e7986-6cdf-40f3-aea5-ca50b6b9bfc0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 05:26:10.846711 dv-cinder-856921-1-smb devstack@keystone.service[81384]: warnings.warn(msg) Sep 11 05:26:10.846711 dv-cinder-856921-1-smb devstack@keystone.service[81384]: Sep 11 05:26:10.847925 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957e7986-6cdf-40f3-aea5-ca50b6b9bfc0 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:26:10.904412 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 745/1497] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:26:10 2022] POST /identity/v3/projects => generated 379 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:26:10.908592 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a373af90-d6a6-40af-8091-e538dc2e627d admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:26:10.910111 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-a373af90-d6a6-40af-8091-e538dc2e627d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:26:10.943494 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a373af90-d6a6-40af-8091-e538dc2e627d admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:26:11.034734 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68ddb0d-c5db-475e-b4cb-3213fea939c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:26:11.035241 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ddb0d-c5db-475e-b4cb-3213fea939c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:26:11.035516 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ddb0d-c5db-475e-b4cb-3213fea939c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:26:11.035813 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ddb0d-c5db-475e-b4cb-3213fea939c7 admin admin] PATH_INFO: `/v3/users` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:26:11.036448 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68ddb0d-c5db-475e-b4cb-3213fea939c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:26:11.037441 dv-cinder-856921-1-smb devstack@keystone.service[81383]: WARNING py.warnings [None req-b68ddb0d-c5db-475e-b4cb-3213fea939c7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 05:26:11.037441 dv-cinder-856921-1-smb devstack@keystone.service[81383]: warnings.warn(msg) Sep 11 05:26:11.037441 dv-cinder-856921-1-smb devstack@keystone.service[81383]: Sep 11 05:26:11.038631 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68ddb0d-c5db-475e-b4cb-3213fea939c7 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:26:11.080230 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 753/1498] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:26:10 2022] POST /identity/v3/users => generated 290 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:26:11.084425 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957e7986-6cdf-40f3-aea5-ca50b6b9bfc0 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:26:11.085941 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-957e7986-6cdf-40f3-aea5-ca50b6b9bfc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:26:11.147454 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957e7986-6cdf-40f3-aea5-ca50b6b9bfc0 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:26:11.228616 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:26:11.240467 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9af3062-4a6b-42be-b763-b4babb2c9aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:26:11.241310 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af3062-4a6b-42be-b763-b4babb2c9aa0 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:26:11.241586 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af3062-4a6b-42be-b763-b4babb2c9aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:26:11.241850 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af3062-4a6b-42be-b763-b4babb2c9aa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:26:11.242480 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9af3062-4a6b-42be-b763-b4babb2c9aa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:26:11.243533 dv-cinder-856921-1-smb devstack@keystone.service[81384]: WARNING py.warnings [None req-d9af3062-4a6b-42be-b763-b4babb2c9aa0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 05:26:11.243533 dv-cinder-856921-1-smb devstack@keystone.service[81384]: warnings.warn(msg) Sep 11 05:26:11.243533 dv-cinder-856921-1-smb devstack@keystone.service[81384]: Sep 11 05:26:11.244435 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9af3062-4a6b-42be-b763-b4babb2c9aa0 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:26:11.256421 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 746/1499] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:26:11 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:26:11.260538 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68ddb0d-c5db-475e-b4cb-3213fea939c7 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:26:11.262042 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-b68ddb0d-c5db-475e-b4cb-3213fea939c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:26:11.273171 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68ddb0d-c5db-475e-b4cb-3213fea939c7 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:26:11.298609 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:26:11.367965 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9c5894-56e1-4774-bd6e-d9f70d9826c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:26:11.368572 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c5894-56e1-4774-bd6e-d9f70d9826c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:26:11.368846 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c5894-56e1-4774-bd6e-d9f70d9826c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:26:11.369107 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c5894-56e1-4774-bd6e-d9f70d9826c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:26:11.369742 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9c5894-56e1-4774-bd6e-d9f70d9826c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:26:11.370756 dv-cinder-856921-1-smb devstack@keystone.service[81383]: WARNING py.warnings [None req-9f9c5894-56e1-4774-bd6e-d9f70d9826c8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 05:26:11.370756 dv-cinder-856921-1-smb devstack@keystone.service[81383]: warnings.warn(msg) Sep 11 05:26:11.370756 dv-cinder-856921-1-smb devstack@keystone.service[81383]: Sep 11 05:26:11.371663 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9c5894-56e1-4774-bd6e-d9f70d9826c8 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:26:11.383644 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 754/1500] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:26:11 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:26:11.387893 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9af3062-4a6b-42be-b763-b4babb2c9aa0 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:26:11.389456 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-d9af3062-4a6b-42be-b763-b4babb2c9aa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:26:11.423110 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9af3062-4a6b-42be-b763-b4babb2c9aa0 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:26:11.514192 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516214f4-5bbe-4d50-9954-90c9d0294681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:26:11.514839 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516214f4-5bbe-4d50-9954-90c9d0294681 admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:26:11.515113 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516214f4-5bbe-4d50-9954-90c9d0294681 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:26:11.515378 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516214f4-5bbe-4d50-9954-90c9d0294681 admin admin] PATH_INFO: `/v3/projects/6fe2a5c2230c4e639b548f31ba3d7f9f/users/659f66002d3b405c92fdcc5a452d6ce3/roles/aa7ff8e0ec1e48e5811335b9eb38b448` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:26:11.538161 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516214f4-5bbe-4d50-9954-90c9d0294681 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fe2a5c2230c4e639b548f31ba3d7f9f, user_id=659f66002d3b405c92fdcc5a452d6ce3, role_id=aa7ff8e0ec1e48e5811335b9eb38b448)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:26:11.539182 dv-cinder-856921-1-smb devstack@keystone.service[81384]: WARNING py.warnings [None req-516214f4-5bbe-4d50-9954-90c9d0294681 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 05:26:11.539182 dv-cinder-856921-1-smb devstack@keystone.service[81384]: warnings.warn(msg) Sep 11 05:26:11.539182 dv-cinder-856921-1-smb devstack@keystone.service[81384]: Sep 11 05:26:11.541130 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516214f4-5bbe-4d50-9954-90c9d0294681 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:26:11.564717 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 747/1501] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:26:11 2022] PUT /identity/v3/projects/6fe2a5c2230c4e639b548f31ba3d7f9f/users/659f66002d3b405c92fdcc5a452d6ce3/roles/aa7ff8e0ec1e48e5811335b9eb38b448 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:26:11.576756 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6490cd-86e9-4f98-8d32-184d3c4a8ba7 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:26:11.577046 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6490cd-86e9-4f98-8d32-184d3c4a8ba7 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:26:11.577351 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6490cd-86e9-4f98-8d32-184d3c4a8ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:26:11.633914 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-ec6490cd-86e9-4f98-8d32-184d3c4a8ba7 None None] MFA Rules not processed for user `659f66002d3b405c92fdcc5a452d6ce3`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:26:11.635129 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-ec6490cd-86e9-4f98-8d32-184d3c4a8ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:26:11.710880 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 755/1502] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:26:11 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:26:11.724632 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82b7d0-762c-41bc-a2af-8ffcdfe88165 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:26:11.724919 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82b7d0-762c-41bc-a2af-8ffcdfe88165 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:26:11.725192 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82b7d0-762c-41bc-a2af-8ffcdfe88165 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:26:11.726549 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 748/1503] 10.222.0.16 () {54 vars in 964 bytes} [Sun Sep 11 05:26:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:26:11.731174 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f152d-1972-49ed-a437-0d2db9b72857 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:26:11.731463 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f152d-1972-49ed-a437-0d2db9b72857 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:26:11.731778 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f152d-1972-49ed-a437-0d2db9b72857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:26:11.762812 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:26:11.809168 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-d58f152d-1972-49ed-a437-0d2db9b72857 None None] MFA Rules not processed for user `5a147e14b61d481db1cac02c58ac3500`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:26:11.810414 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-d58f152d-1972-49ed-a437-0d2db9b72857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:26:11.884407 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 756/1504] 10.222.0.16 () {58 vars in 1061 bytes} [Sun Sep 11 05:26:11 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:26:11.894721 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af82b7d0-762c-41bc-a2af-8ffcdfe88165 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:26:11.896272 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-af82b7d0-762c-41bc-a2af-8ffcdfe88165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:26:11.944833 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:26:11.998284 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af82b7d0-762c-41bc-a2af-8ffcdfe88165 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:26:12.071147 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5098031d-bf1d-4219-9cc6-b852da339887 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a147e14b61d481db1cac02c58ac3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:26:12.071775 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098031d-bf1d-4219-9cc6-b852da339887 service cinder] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:26:12.072049 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098031d-bf1d-4219-9cc6-b852da339887 service cinder] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:26:12.072314 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098031d-bf1d-4219-9cc6-b852da339887 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:26:12.073887 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-5098031d-bf1d-4219-9cc6-b852da339887 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:26:12.170671 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5098031d-bf1d-4219-9cc6-b852da339887 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:26:12.172148 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5098031d-bf1d-4219-9cc6-b852da339887 service cinder] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:26:12.176145 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:26:12.190599 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 749/1505] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:26:11 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:26:12.237514 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c1c11-4cb1-4e78-8373-22e3dc0cd19a None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:26:12.237801 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c1c11-4cb1-4e78-8373-22e3dc0cd19a None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:26:12.238079 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c1c11-4cb1-4e78-8373-22e3dc0cd19a None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:26:12.239338 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 757/1506] 10.222.0.16 () {52 vars in 830 bytes} [Sun Sep 11 05:26:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:26:12.243152 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5098031d-bf1d-4219-9cc6-b852da339887 service cinder] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:26:12.244420 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-5098031d-bf1d-4219-9cc6-b852da339887 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:26:12.342132 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5098031d-bf1d-4219-9cc6-b852da339887 service cinder] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:26:12.434785 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251ca6de-d474-480e-82af-3bf6577b8a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:26:12.435335 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251ca6de-d474-480e-82af-3bf6577b8a50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:26:12.435607 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251ca6de-d474-480e-82af-3bf6577b8a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:26:12.435904 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251ca6de-d474-480e-82af-3bf6577b8a50 admin admin] PATH_INFO: `/v3/users/659f66002d3b405c92fdcc5a452d6ce3` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:26:12.448234 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251ca6de-d474-480e-82af-3bf6577b8a50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=659f66002d3b405c92fdcc5a452d6ce3)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:26:12.449251 dv-cinder-856921-1-smb devstack@keystone.service[81384]: WARNING py.warnings [None req-251ca6de-d474-480e-82af-3bf6577b8a50 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 05:26:12.449251 dv-cinder-856921-1-smb devstack@keystone.service[81384]: warnings.warn(msg) Sep 11 05:26:12.449251 dv-cinder-856921-1-smb devstack@keystone.service[81384]: Sep 11 05:26:12.450458 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251ca6de-d474-480e-82af-3bf6577b8a50 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:26:12.460477 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:26:12.516619 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-251ca6de-d474-480e-82af-3bf6577b8a50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '659f66002d3b405c92fdcc5a452d6ce3'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:26:12.539138 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-251ca6de-d474-480e-82af-3bf6577b8a50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '659f66002d3b405c92fdcc5a452d6ce3'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:26:12.553885 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-251ca6de-d474-480e-82af-3bf6577b8a50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '659f66002d3b405c92fdcc5a452d6ce3'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:26:12.563502 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-251ca6de-d474-480e-82af-3bf6577b8a50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '659f66002d3b405c92fdcc5a452d6ce3'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:26:12.564094 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-251ca6de-d474-480e-82af-3bf6577b8a50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '659f66002d3b405c92fdcc5a452d6ce3'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:26:12.569526 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 750/1507] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:26:12 2022] DELETE /identity/v3/users/659f66002d3b405c92fdcc5a452d6ce3 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:26:12.573936 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c844e122-9e4a-43b1-83b5-bbb9695a5d1d None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:26:12.574462 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c844e122-9e4a-43b1-83b5-bbb9695a5d1d None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:26:12.574736 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c844e122-9e4a-43b1-83b5-bbb9695a5d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:26:12.631498 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-c844e122-9e4a-43b1-83b5-bbb9695a5d1d None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:26:12.633018 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-c844e122-9e4a-43b1-83b5-bbb9695a5d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:26:12.709108 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:26:12.722169 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 758/1508] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:26:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 05:26:12.731724 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251ca6de-d474-480e-82af-3bf6577b8a50 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:26:12.732969 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-251ca6de-d474-480e-82af-3bf6577b8a50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:26:12.833208 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251ca6de-d474-480e-82af-3bf6577b8a50 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:26:12.887506 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:26:12.908471 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014e2a66-e23a-4072-80a1-53022ebfc011 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:26:12.909082 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e2a66-e23a-4072-80a1-53022ebfc011 service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:26:12.909358 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e2a66-e23a-4072-80a1-53022ebfc011 service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:26:12.909629 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e2a66-e23a-4072-80a1-53022ebfc011 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:26:12.911231 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-014e2a66-e23a-4072-80a1-53022ebfc011 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:26:13.026332 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014e2a66-e23a-4072-80a1-53022ebfc011 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:26:13.028943 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014e2a66-e23a-4072-80a1-53022ebfc011 service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:26:13.056819 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 751/1509] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:26:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:26:13.420019 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c844e122-9e4a-43b1-83b5-bbb9695a5d1d None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:26:13.421444 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-c844e122-9e4a-43b1-83b5-bbb9695a5d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:26:13.434388 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c844e122-9e4a-43b1-83b5-bbb9695a5d1d None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:26:13.529094 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b273f5f1-8c9b-4818-ab7c-ac2e6f188378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:26:13.529727 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b273f5f1-8c9b-4818-ab7c-ac2e6f188378 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:26:13.530007 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b273f5f1-8c9b-4818-ab7c-ac2e6f188378 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:26:13.530278 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b273f5f1-8c9b-4818-ab7c-ac2e6f188378 admin admin] PATH_INFO: `/v3/projects/6fe2a5c2230c4e639b548f31ba3d7f9f` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:26:13.540623 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b273f5f1-8c9b-4818-ab7c-ac2e6f188378 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fe2a5c2230c4e639b548f31ba3d7f9f)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:26:13.541601 dv-cinder-856921-1-smb devstack@keystone.service[81383]: WARNING py.warnings [None req-b273f5f1-8c9b-4818-ab7c-ac2e6f188378 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 05:26:13.541601 dv-cinder-856921-1-smb devstack@keystone.service[81383]: warnings.warn(msg) Sep 11 05:26:13.541601 dv-cinder-856921-1-smb devstack@keystone.service[81383]: Sep 11 05:26:13.542797 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b273f5f1-8c9b-4818-ab7c-ac2e6f188378 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:26:13.600463 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-b273f5f1-8c9b-4818-ab7c-ac2e6f188378 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fe2a5c2230c4e639b548f31ba3d7f9f', 'request_id': 'req-b273f5f1-8c9b-4818-ab7c-ac2e6f188378'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:26:13.610685 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-b273f5f1-8c9b-4818-ab7c-ac2e6f188378 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fe2a5c2230c4e639b548f31ba3d7f9f', 'request_id': 'req-b273f5f1-8c9b-4818-ab7c-ac2e6f188378'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:26:13.617887 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-b273f5f1-8c9b-4818-ab7c-ac2e6f188378 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fe2a5c2230c4e639b548f31ba3d7f9f', 'request_id': 'req-b273f5f1-8c9b-4818-ab7c-ac2e6f188378'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:26:13.648643 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-b273f5f1-8c9b-4818-ab7c-ac2e6f188378 admin admin] The token cache is being invalidate because project 6fe2a5c2230c4e639b548f31ba3d7f9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81383) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:26:13.648932 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-b273f5f1-8c9b-4818-ab7c-ac2e6f188378 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:26:13.649362 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-b273f5f1-8c9b-4818-ab7c-ac2e6f188378 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:26:13.650748 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 759/1510] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:26:13 2022] DELETE /identity/v3/projects/6fe2a5c2230c4e639b548f31ba3d7f9f => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:26:23.055309 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=62 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:26:23.646616 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:27:40.800628 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a76e2d-1112-4344-870d-81a774f2d466 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:27:40.801140 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a76e2d-1112-4344-870d-81a774f2d466 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:27:40.801248 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a76e2d-1112-4344-870d-81a774f2d466 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:27:40.802676 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 752/1511] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 11 05:27:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:27:40.807616 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c62fe9-4c63-4266-9615-80fda1f8f123 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:27:40.808081 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c62fe9-4c63-4266-9615-80fda1f8f123 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:27:40.808189 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c62fe9-4c63-4266-9615-80fda1f8f123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:27:40.888941 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-02c62fe9-4c63-4266-9615-80fda1f8f123 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:27:40.890158 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-02c62fe9-4c63-4266-9615-80fda1f8f123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:27:40.998448 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 760/1512] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 11 05:27:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:27:41.153802 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a76e2d-1112-4344-870d-81a774f2d466 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:27:41.155892 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-30a76e2d-1112-4344-870d-81a774f2d466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:27:41.275741 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a76e2d-1112-4344-870d-81a774f2d466 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:27:41.281241 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b295ed-5186-4dd4-ac57-612db574e6ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cd6136036bd467c946cae90d5c29263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:27:41.282338 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b295ed-5186-4dd4-ac57-612db574e6ed service nova] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:27:41.282612 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b295ed-5186-4dd4-ac57-612db574e6ed service nova] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:27:41.282879 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b295ed-5186-4dd4-ac57-612db574e6ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:27:41.290776 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b295ed-5186-4dd4-ac57-612db574e6ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:27:41.292429 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b295ed-5186-4dd4-ac57-612db574e6ed service nova] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:27:41.302185 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 753/1513] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:27:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:27:42.379762 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab3d97c-0d20-41f1-96fb-e459cdaa585c None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:27:42.380339 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab3d97c-0d20-41f1-96fb-e459cdaa585c None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:27:42.380339 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab3d97c-0d20-41f1-96fb-e459cdaa585c None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:27:42.381910 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 761/1514] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 11 05:27:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:27:42.388258 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fbae9d-4478-467f-b2e9-a00b37e66bea None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:27:42.388732 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fbae9d-4478-467f-b2e9-a00b37e66bea None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:27:42.388851 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fbae9d-4478-467f-b2e9-a00b37e66bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:27:42.409099 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-b9fbae9d-4478-467f-b2e9-a00b37e66bea None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:27:42.410296 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-b9fbae9d-4478-467f-b2e9-a00b37e66bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:27:42.418131 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 754/1515] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 11 05:27:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:27:42.571782 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab3d97c-0d20-41f1-96fb-e459cdaa585c None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:27:42.587338 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab3d97c-0d20-41f1-96fb-e459cdaa585c None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:27:42.592780 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b4b4f4-1538-4a6a-b29e-41ec0801dc34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cd6136036bd467c946cae90d5c29263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:27:42.593378 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b4b4f4-1538-4a6a-b29e-41ec0801dc34 service nova] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:27:42.593658 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b4b4f4-1538-4a6a-b29e-41ec0801dc34 service nova] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:27:42.593954 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b4b4f4-1538-4a6a-b29e-41ec0801dc34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:27:42.601980 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b4b4f4-1538-4a6a-b29e-41ec0801dc34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:27:42.603566 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b4b4f4-1538-4a6a-b29e-41ec0801dc34 service nova] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:27:42.612902 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 762/1516] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:27:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:27:42.616698 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3285e50-7f8b-4f3e-8bce-91038c2dd7ad None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:27:42.616980 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3285e50-7f8b-4f3e-8bce-91038c2dd7ad None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:27:42.617252 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3285e50-7f8b-4f3e-8bce-91038c2dd7ad None None] PATH_INFO: `/v3` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:27:42.618542 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 755/1517] 10.222.0.43 () {54 vars in 925 bytes} [Sun Sep 11 05:27:42 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:27:42.625058 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1108e14f-a75e-4200-a7e6-0c782522b553 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:27:42.625753 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1108e14f-a75e-4200-a7e6-0c782522b553 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:27:42.626064 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1108e14f-a75e-4200-a7e6-0c782522b553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:27:42.692189 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-1108e14f-a75e-4200-a7e6-0c782522b553 None None] MFA Rules not processed for user `72e1d7dd79ff43e7b585b5090762465f`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:27:42.693571 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-1108e14f-a75e-4200-a7e6-0c782522b553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:27:42.711867 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:27:42.769594 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 763/1518] 10.222.0.43 () {58 vars in 1015 bytes} [Sun Sep 11 05:27:42 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 05:27:46.317927 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d197a52-0c0d-4db6-a3ce-c2f1f5f408f4 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:27:46.318458 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d197a52-0c0d-4db6-a3ce-c2f1f5f408f4 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:27:46.318458 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d197a52-0c0d-4db6-a3ce-c2f1f5f408f4 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:27:46.319882 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 756/1519] 10.222.0.16 () {54 vars in 961 bytes} [Sun Sep 11 05:27:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:27:46.325135 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252b7be-9c9a-417a-bd36-51777ef16896 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:27:46.325569 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252b7be-9c9a-417a-bd36-51777ef16896 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:27:46.325722 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252b7be-9c9a-417a-bd36-51777ef16896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:27:46.345566 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-c252b7be-9c9a-417a-bd36-51777ef16896 None None] MFA Rules not processed for user `72e1d7dd79ff43e7b585b5090762465f`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:27:46.346770 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-c252b7be-9c9a-417a-bd36-51777ef16896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:27:46.355289 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 764/1520] 10.222.0.16 () {58 vars in 1058 bytes} [Sun Sep 11 05:27:46 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:27:46.362680 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d197a52-0c0d-4db6-a3ce-c2f1f5f408f4 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:27:46.376680 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d197a52-0c0d-4db6-a3ce-c2f1f5f408f4 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:27:46.381459 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0f9c62-71ed-4d9e-b974-b12a7d4e0c2b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72e1d7dd79ff43e7b585b5090762465f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:27:46.382069 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f9c62-71ed-4d9e-b974-b12a7d4e0c2b service placement] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:27:46.382343 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f9c62-71ed-4d9e-b974-b12a7d4e0c2b service placement] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:27:46.382609 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f9c62-71ed-4d9e-b974-b12a7d4e0c2b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:27:46.390615 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0f9c62-71ed-4d9e-b974-b12a7d4e0c2b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:27:46.392845 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0f9c62-71ed-4d9e-b974-b12a7d4e0c2b service placement] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:27:46.402163 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 757/1521] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:27:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:27:54.090981 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d618f6c2-686b-4d5b-8a2a-d812234c745f None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:27:54.091555 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d618f6c2-686b-4d5b-8a2a-d812234c745f None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:27:54.091555 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d618f6c2-686b-4d5b-8a2a-d812234c745f None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:27:54.092828 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 765/1522] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 11 05:27:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:27:54.098904 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6dcd2a-43d4-4a7f-b022-56a5103c137b None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:27:54.099297 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6dcd2a-43d4-4a7f-b022-56a5103c137b None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:27:54.099464 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6dcd2a-43d4-4a7f-b022-56a5103c137b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:27:54.119389 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-fc6dcd2a-43d4-4a7f-b022-56a5103c137b None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:27:54.120621 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-fc6dcd2a-43d4-4a7f-b022-56a5103c137b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:27:54.129028 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 758/1523] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 11 05:27:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:27:54.282450 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d618f6c2-686b-4d5b-8a2a-d812234c745f None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:27:54.297479 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d618f6c2-686b-4d5b-8a2a-d812234c745f None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:27:54.302937 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec56005-42d2-4e5a-8c3b-63625fef2226 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cd6136036bd467c946cae90d5c29263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:27:54.303535 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec56005-42d2-4e5a-8c3b-63625fef2226 service nova] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:27:54.303846 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec56005-42d2-4e5a-8c3b-63625fef2226 service nova] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:27:54.304121 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec56005-42d2-4e5a-8c3b-63625fef2226 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:27:54.312188 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec56005-42d2-4e5a-8c3b-63625fef2226 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:27:54.314344 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec56005-42d2-4e5a-8c3b-63625fef2226 service nova] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:27:54.323619 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 766/1524] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:27:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:27:55.396437 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148857d-79a4-4111-b8da-44cf4b667551 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:27:55.397018 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148857d-79a4-4111-b8da-44cf4b667551 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:27:55.397018 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148857d-79a4-4111-b8da-44cf4b667551 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:27:55.398312 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 759/1525] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 11 05:27:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:27:55.404688 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436844f9-daf9-460f-96bc-3a9a44e49f80 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:27:55.405147 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436844f9-daf9-460f-96bc-3a9a44e49f80 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:27:55.405265 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436844f9-daf9-460f-96bc-3a9a44e49f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:27:55.424746 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-436844f9-daf9-460f-96bc-3a9a44e49f80 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:27:55.425985 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-436844f9-daf9-460f-96bc-3a9a44e49f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:27:55.433814 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 767/1526] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 11 05:27:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:27:55.585145 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4148857d-79a4-4111-b8da-44cf4b667551 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:27:55.599180 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4148857d-79a4-4111-b8da-44cf4b667551 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:27:55.604509 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91b1e4f-713b-402c-94d2-dbed7c4e0e47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cd6136036bd467c946cae90d5c29263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:27:55.605097 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b1e4f-713b-402c-94d2-dbed7c4e0e47 service nova] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:27:55.605373 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b1e4f-713b-402c-94d2-dbed7c4e0e47 service nova] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:27:55.605641 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b1e4f-713b-402c-94d2-dbed7c4e0e47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:27:55.614086 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91b1e4f-713b-402c-94d2-dbed7c4e0e47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:27:55.615668 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91b1e4f-713b-402c-94d2-dbed7c4e0e47 service nova] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:27:55.625685 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 760/1527] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:27:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:27:59.685871 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b417c-4d3a-42ce-8631-0fe769581242 None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:27:59.686443 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b417c-4d3a-42ce-8631-0fe769581242 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:27:59.686443 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b417c-4d3a-42ce-8631-0fe769581242 None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:27:59.687854 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 768/1528] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 05:27:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:27:59.693506 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b6c1dc-6b54-4662-b041-157cfc412c28 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:27:59.693941 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b6c1dc-6b54-4662-b041-157cfc412c28 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:27:59.694049 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b6c1dc-6b54-4662-b041-157cfc412c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:27:59.712851 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-30b6c1dc-6b54-4662-b041-157cfc412c28 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:27:59.714024 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-30b6c1dc-6b54-4662-b041-157cfc412c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:27:59.722291 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 761/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 05:27:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:28:00.016636 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774b417c-4d3a-42ce-8631-0fe769581242 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:28:00.018308 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-774b417c-4d3a-42ce-8631-0fe769581242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:28:00.111581 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774b417c-4d3a-42ce-8631-0fe769581242 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:28:00.115148 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b78616-55c7-42fa-8891-45262c817349 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:28:00.115783 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b78616-55c7-42fa-8891-45262c817349 service neutron] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:28:00.116330 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b78616-55c7-42fa-8891-45262c817349 service neutron] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:28:00.116601 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b78616-55c7-42fa-8891-45262c817349 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:28:00.125460 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b78616-55c7-42fa-8891-45262c817349 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:28:00.126875 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b78616-55c7-42fa-8891-45262c817349 service neutron] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:28:00.136188 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 769/1530] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:28:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:28:02.274796 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99982d-76a9-4083-a2de-deaee933488c None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:28:02.275339 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99982d-76a9-4083-a2de-deaee933488c None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:28:02.275339 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99982d-76a9-4083-a2de-deaee933488c None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:28:02.276812 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 762/1531] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 05:28:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:28:02.282680 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9739354a-09f2-41d0-a178-3718ed56e169 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:28:02.283094 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9739354a-09f2-41d0-a178-3718ed56e169 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:28:02.283246 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9739354a-09f2-41d0-a178-3718ed56e169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:28:02.303059 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-9739354a-09f2-41d0-a178-3718ed56e169 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:28:02.304282 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-9739354a-09f2-41d0-a178-3718ed56e169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:28:02.312088 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 770/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 05:28:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:28:02.602492 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c99982d-76a9-4083-a2de-deaee933488c None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:28:02.613231 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c99982d-76a9-4083-a2de-deaee933488c None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:28:02.617060 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0505e13-b315-4643-8a51-cbe0f2894df2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:28:02.617650 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0505e13-b315-4643-8a51-cbe0f2894df2 service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:28:02.617928 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0505e13-b315-4643-8a51-cbe0f2894df2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:28:02.618198 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0505e13-b315-4643-8a51-cbe0f2894df2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:28:02.626862 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0505e13-b315-4643-8a51-cbe0f2894df2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:28:02.628324 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0505e13-b315-4643-8a51-cbe0f2894df2 service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:28:02.637440 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 763/1533] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:28:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:28:06.464518 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350a38e-c8f2-4c53-add4-a53fadffb798 None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:28:06.465090 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350a38e-c8f2-4c53-add4-a53fadffb798 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:28:06.465090 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350a38e-c8f2-4c53-add4-a53fadffb798 None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:28:06.466441 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 771/1534] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 05:28:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:28:06.472280 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a8177-830a-4232-baed-f135cb259d59 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:28:06.472710 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a8177-830a-4232-baed-f135cb259d59 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:28:06.472835 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a8177-830a-4232-baed-f135cb259d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:28:06.480289 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=81 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:28:06.493619 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-857a8177-830a-4232-baed-f135cb259d59 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:28:06.494824 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-857a8177-830a-4232-baed-f135cb259d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:28:06.503339 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 764/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 05:28:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:28:06.807392 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f350a38e-c8f2-4c53-add4-a53fadffb798 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:28:06.809122 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-f350a38e-c8f2-4c53-add4-a53fadffb798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:28:06.875598 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:28:06.890484 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f350a38e-c8f2-4c53-add4-a53fadffb798 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:28:06.894589 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd0b4bd-f68f-42d6-97f2-2c7de85474be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a147e14b61d481db1cac02c58ac3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:28:06.895211 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd0b4bd-f68f-42d6-97f2-2c7de85474be service cinder] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:28:06.895469 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd0b4bd-f68f-42d6-97f2-2c7de85474be service cinder] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:28:06.895773 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd0b4bd-f68f-42d6-97f2-2c7de85474be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:28:06.904722 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd0b4bd-f68f-42d6-97f2-2c7de85474be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:28:06.906147 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd0b4bd-f68f-42d6-97f2-2c7de85474be service cinder] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:28:06.921181 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 772/1536] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:28:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:28:09.097900 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b056f-595f-4565-93be-4c58ad7dabea None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:28:09.098439 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b056f-595f-4565-93be-4c58ad7dabea None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:28:09.098439 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b056f-595f-4565-93be-4c58ad7dabea None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:28:09.099744 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 765/1537] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 05:28:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:28:09.105192 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb6edb-bc0f-46b9-bc04-ae39f152f1bb None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:28:09.105628 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb6edb-bc0f-46b9-bc04-ae39f152f1bb None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:28:09.105737 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb6edb-bc0f-46b9-bc04-ae39f152f1bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:28:09.126773 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-3cfb6edb-bc0f-46b9-bc04-ae39f152f1bb None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:28:09.128015 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-3cfb6edb-bc0f-46b9-bc04-ae39f152f1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:28:09.135793 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 773/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 05:28:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:28:09.435994 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5b056f-595f-4565-93be-4c58ad7dabea None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:28:09.438363 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-2d5b056f-595f-4565-93be-4c58ad7dabea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:28:09.451514 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5b056f-595f-4565-93be-4c58ad7dabea None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:28:09.455107 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da28d21-eaf5-4dc2-842b-77d4fca4feb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a147e14b61d481db1cac02c58ac3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:28:09.455727 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da28d21-eaf5-4dc2-842b-77d4fca4feb5 service cinder] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:28:09.456012 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da28d21-eaf5-4dc2-842b-77d4fca4feb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:28:09.456285 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da28d21-eaf5-4dc2-842b-77d4fca4feb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:28:09.465202 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da28d21-eaf5-4dc2-842b-77d4fca4feb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:28:09.466633 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da28d21-eaf5-4dc2-842b-77d4fca4feb5 service cinder] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:28:09.476438 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 766/1539] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:28:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:28:19.121212 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=11 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:28:19.472330 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=8 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:29:35.609716 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe5451a-93d0-4603-9bb3-fa2b28eb2aad None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:35.610377 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe5451a-93d0-4603-9bb3-fa2b28eb2aad None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:35.610377 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe5451a-93d0-4603-9bb3-fa2b28eb2aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:35.642289 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-ebe5451a-93d0-4603-9bb3-fa2b28eb2aad None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:29:35.643525 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-ebe5451a-93d0-4603-9bb3-fa2b28eb2aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:29:35.653764 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 774/1540] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:29:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 05:29:35.663408 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09119cc-0fa3-4527-afb6-bacfe0810634 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:35.664008 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09119cc-0fa3-4527-afb6-bacfe0810634 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:35.664008 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09119cc-0fa3-4527-afb6-bacfe0810634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:35.684282 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34518b3c-45e6-4b02-b8d7-60a9bde82765 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:35.684601 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34518b3c-45e6-4b02-b8d7-60a9bde82765 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:35.684847 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34518b3c-45e6-4b02-b8d7-60a9bde82765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:35.693232 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-a09119cc-0fa3-4527-afb6-bacfe0810634 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:29:35.694714 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-a09119cc-0fa3-4527-afb6-bacfe0810634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:29:35.709243 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 767/1541] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:29:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 05:29:35.714953 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09119cc-0fa3-4527-afb6-bacfe0810634 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:35.723954 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-34518b3c-45e6-4b02-b8d7-60a9bde82765 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:29:35.725211 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-34518b3c-45e6-4b02-b8d7-60a9bde82765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:29:35.729795 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09119cc-0fa3-4527-afb6-bacfe0810634 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:35.737247 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d74efd0-7c5d-459c-97dc-b391878b6613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:35.737888 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d74efd0-7c5d-459c-97dc-b391878b6613 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:35.738421 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d74efd0-7c5d-459c-97dc-b391878b6613 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:35.738702 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d74efd0-7c5d-459c-97dc-b391878b6613 admin admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:35.739916 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d74efd0-7c5d-459c-97dc-b391878b6613 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:29:35.740495 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d74efd0-7c5d-459c-97dc-b391878b6613 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:35.741568 dv-cinder-856921-1-smb devstack@keystone.service[81384]: WARNING py.warnings [None req-5d74efd0-7c5d-459c-97dc-b391878b6613 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 05:29:35.741568 dv-cinder-856921-1-smb devstack@keystone.service[81384]: warnings.warn(msg) Sep 11 05:29:35.741568 dv-cinder-856921-1-smb devstack@keystone.service[81384]: Sep 11 05:29:35.742487 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d74efd0-7c5d-459c-97dc-b391878b6613 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:35.747086 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 775/1542] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:29:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 05:29:35.772061 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 768/1543] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 05:29:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:29:35.773671 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f853ddf9-bb79-466b-b523-67054e78a32b None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:35.773904 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f853ddf9-bb79-466b-b523-67054e78a32b None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:35.774188 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f853ddf9-bb79-466b-b523-67054e78a32b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:35.781692 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d74efd0-7c5d-459c-97dc-b391878b6613 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:35.804774 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d74efd0-7c5d-459c-97dc-b391878b6613 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:35.812839 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ce11e9-87ee-4e8a-8d13-c110809e02bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:35.813578 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ce11e9-87ee-4e8a-8d13-c110809e02bd admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:35.813860 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ce11e9-87ee-4e8a-8d13-c110809e02bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:35.814178 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ce11e9-87ee-4e8a-8d13-c110809e02bd admin admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:35.814874 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ce11e9-87ee-4e8a-8d13-c110809e02bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:35.821680 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ce11e9-87ee-4e8a-8d13-c110809e02bd admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:35.832899 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-f853ddf9-bb79-466b-b523-67054e78a32b None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:29:35.834121 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-f853ddf9-bb79-466b-b523-67054e78a32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:29:35.879158 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 776/1544] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:29:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:29:35.886618 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f853ddf9-bb79-466b-b523-67054e78a32b None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:35.891153 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 769/1545] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:29:35 2022] POST /identity/v3/projects => generated 377 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:29:35.896232 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ce11e9-87ee-4e8a-8d13-c110809e02bd admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:35.901185 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f853ddf9-bb79-466b-b523-67054e78a32b None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:36.001692 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ce11e9-87ee-4e8a-8d13-c110809e02bd admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:36.014557 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94de26f5-464c-4c12-a96a-dc496a2402f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:36.015186 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de26f5-464c-4c12-a96a-dc496a2402f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:36.015466 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de26f5-464c-4c12-a96a-dc496a2402f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:36.015761 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de26f5-464c-4c12-a96a-dc496a2402f5 admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:36.016419 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94de26f5-464c-4c12-a96a-dc496a2402f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:36.019641 dv-cinder-856921-1-smb devstack@keystone.service[81384]: WARNING py.warnings [None req-94de26f5-464c-4c12-a96a-dc496a2402f5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 05:29:36.019641 dv-cinder-856921-1-smb devstack@keystone.service[81384]: warnings.warn(msg) Sep 11 05:29:36.019641 dv-cinder-856921-1-smb devstack@keystone.service[81384]: Sep 11 05:29:36.019641 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94de26f5-464c-4c12-a96a-dc496a2402f5 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:36.055775 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28a5bc7-013a-447e-8532-e588c7443a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:36.056514 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a5bc7-013a-447e-8532-e588c7443a4a admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:36.056903 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a5bc7-013a-447e-8532-e588c7443a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:36.057188 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a5bc7-013a-447e-8532-e588c7443a4a admin admin] PATH_INFO: `/v3/domains` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:36.057877 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28a5bc7-013a-447e-8532-e588c7443a4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:29:36.058188 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28a5bc7-013a-447e-8532-e588c7443a4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:36.059865 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28a5bc7-013a-447e-8532-e588c7443a4a admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:36.081096 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 777/1546] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 05:29:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:29:36.082741 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8035124-5ee6-4ffe-af04-26e74a98d3ee None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:36.083278 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8035124-5ee6-4ffe-af04-26e74a98d3ee None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:36.083803 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8035124-5ee6-4ffe-af04-26e74a98d3ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:36.084740 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 770/1547] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:29:35 2022] POST /identity/v3/users => generated 289 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 05:29:36.086718 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a1bba6-377c-4983-b9eb-5db820376243 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:36.087008 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a1bba6-377c-4983-b9eb-5db820376243 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:36.091702 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a1bba6-377c-4983-b9eb-5db820376243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:36.110081 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-d0a1bba6-377c-4983-b9eb-5db820376243 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:29:36.111456 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-d0a1bba6-377c-4983-b9eb-5db820376243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:29:36.117139 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-b8035124-5ee6-4ffe-af04-26e74a98d3ee None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:29:36.118701 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-b8035124-5ee6-4ffe-af04-26e74a98d3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:29:36.121631 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 771/1548] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:29:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:29:36.123259 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e0a47-ed06-4b51-b2cf-67031ea2e7b5 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:36.123564 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e0a47-ed06-4b51-b2cf-67031ea2e7b5 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:36.123868 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e0a47-ed06-4b51-b2cf-67031ea2e7b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:36.129250 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 778/1549] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:29:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:29:36.130768 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e09f31-b7d7-45b5-b685-580543e77b1b None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:36.131292 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e09f31-b7d7-45b5-b685-580543e77b1b None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:36.131829 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e09f31-b7d7-45b5-b685-580543e77b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:36.146653 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-210e0a47-ed06-4b51-b2cf-67031ea2e7b5 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:29:36.147901 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-210e0a47-ed06-4b51-b2cf-67031ea2e7b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:29:36.155201 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-f7e09f31-b7d7-45b5-b685-580543e77b1b None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:29:36.156818 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-f7e09f31-b7d7-45b5-b685-580543e77b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:29:36.156966 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 772/1550] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:29:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:29:36.157807 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210e0a47-ed06-4b51-b2cf-67031ea2e7b5 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:36.167611 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 779/1551] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:29:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:29:36.167939 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210e0a47-ed06-4b51-b2cf-67031ea2e7b5 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:36.175423 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e09f31-b7d7-45b5-b685-580543e77b1b None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:36.175584 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed940d4-80aa-4990-bc44-ec47681d290c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:36.175584 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed940d4-80aa-4990-bc44-ec47681d290c admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:36.175584 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed940d4-80aa-4990-bc44-ec47681d290c admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:36.175584 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed940d4-80aa-4990-bc44-ec47681d290c admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:36.175972 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed940d4-80aa-4990-bc44-ec47681d290c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:36.176810 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed940d4-80aa-4990-bc44-ec47681d290c admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:36.184695 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e09f31-b7d7-45b5-b685-580543e77b1b None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:36.187715 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 773/1552] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:29:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:29:36.189311 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e62ea-b8dd-42a7-bdd1-b799350ad53f None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:36.189838 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e62ea-b8dd-42a7-bdd1-b799350ad53f None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:36.190172 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e62ea-b8dd-42a7-bdd1-b799350ad53f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:36.192571 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2210bb8f-abcf-4851-abcf-9c5661b18619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:36.193276 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2210bb8f-abcf-4851-abcf-9c5661b18619 admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:36.193632 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2210bb8f-abcf-4851-abcf-9c5661b18619 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:36.193974 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2210bb8f-abcf-4851-abcf-9c5661b18619 admin admin] PATH_INFO: `/v3/projects` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:36.194697 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2210bb8f-abcf-4851-abcf-9c5661b18619 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:36.195833 dv-cinder-856921-1-smb devstack@keystone.service[81383]: WARNING py.warnings [None req-2210bb8f-abcf-4851-abcf-9c5661b18619 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 05:29:36.195833 dv-cinder-856921-1-smb devstack@keystone.service[81383]: warnings.warn(msg) Sep 11 05:29:36.195833 dv-cinder-856921-1-smb devstack@keystone.service[81383]: Sep 11 05:29:36.197209 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2210bb8f-abcf-4851-abcf-9c5661b18619 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:36.214658 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-c35e62ea-b8dd-42a7-bdd1-b799350ad53f None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:29:36.216320 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-c35e62ea-b8dd-42a7-bdd1-b799350ad53f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:29:36.227115 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 774/1553] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:29:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:29:36.228649 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e69930-a329-4caa-aedd-67e9ad5c289d None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:36.228931 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e69930-a329-4caa-aedd-67e9ad5c289d None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:36.229207 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e69930-a329-4caa-aedd-67e9ad5c289d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:36.230684 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 780/1554] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:29:36 2022] POST /identity/v3/projects => generated 369 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:29:36.232252 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e51a73-bd70-4769-b8fa-f1e98f609a76 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:36.232893 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e51a73-bd70-4769-b8fa-f1e98f609a76 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:36.233168 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e51a73-bd70-4769-b8fa-f1e98f609a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:36.250354 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-50e69930-a329-4caa-aedd-67e9ad5c289d None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:29:36.251559 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-50e69930-a329-4caa-aedd-67e9ad5c289d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:29:36.251942 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-a4e51a73-bd70-4769-b8fa-f1e98f609a76 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:29:36.253054 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-a4e51a73-bd70-4769-b8fa-f1e98f609a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:29:36.320946 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 775/1556] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:29:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:29:36.321251 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 781/1556] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:29:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:29:36.321251 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1db508-6838-48bf-962b-41c98fee0eb4 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:36.321459 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d612d77e-fcb5-409c-bf0d-dd663a5db28d None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:36.321561 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1db508-6838-48bf-962b-41c98fee0eb4 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:36.321658 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d612d77e-fcb5-409c-bf0d-dd663a5db28d None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:36.321760 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1db508-6838-48bf-962b-41c98fee0eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:36.321856 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d612d77e-fcb5-409c-bf0d-dd663a5db28d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:36.335905 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-d612d77e-fcb5-409c-bf0d-dd663a5db28d None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:29:36.336277 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-4f1db508-6838-48bf-962b-41c98fee0eb4 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:29:36.337123 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-d612d77e-fcb5-409c-bf0d-dd663a5db28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:29:36.338210 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-4f1db508-6838-48bf-962b-41c98fee0eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:29:36.345667 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 776/1557] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:29:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:29:36.349328 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d612d77e-fcb5-409c-bf0d-dd663a5db28d None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:36.349440 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 782/1558] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:29:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:29:36.349440 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4addeb1-2345-4cec-ba35-2ece355cb86a None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:36.349440 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4addeb1-2345-4cec-ba35-2ece355cb86a None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:36.349440 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4addeb1-2345-4cec-ba35-2ece355cb86a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:36.354376 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:29:36.361138 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d612d77e-fcb5-409c-bf0d-dd663a5db28d None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:36.366374 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0bfdd7-4f6d-4ad2-ab09-b1bd4fc90b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:36.367051 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0bfdd7-4f6d-4ad2-ab09-b1bd4fc90b1b admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:36.367330 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0bfdd7-4f6d-4ad2-ab09-b1bd4fc90b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:36.367600 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0bfdd7-4f6d-4ad2-ab09-b1bd4fc90b1b admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:36.368299 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0bfdd7-4f6d-4ad2-ab09-b1bd4fc90b1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:36.368406 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-c4addeb1-2345-4cec-ba35-2ece355cb86a None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:29:36.369556 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-c4addeb1-2345-4cec-ba35-2ece355cb86a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:29:36.369899 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0bfdd7-4f6d-4ad2-ab09-b1bd4fc90b1b admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:36.377284 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 783/1559] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:29:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:29:36.380581 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4addeb1-2345-4cec-ba35-2ece355cb86a None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:36.383236 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 777/1560] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:29:36 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:29:36.384150 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0bfdd7-4f6d-4ad2-ab09-b1bd4fc90b1b admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:36.390899 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4addeb1-2345-4cec-ba35-2ece355cb86a None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:36.395353 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0bfdd7-4f6d-4ad2-ab09-b1bd4fc90b1b admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:36.395487 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c684404-791e-4d84-be3c-f8536a6d9d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:36.396031 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c684404-791e-4d84-be3c-f8536a6d9d2f admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:36.396370 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c684404-791e-4d84-be3c-f8536a6d9d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:36.396570 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c684404-791e-4d84-be3c-f8536a6d9d2f admin admin] PATH_INFO: `/v3/users` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:36.397193 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c684404-791e-4d84-be3c-f8536a6d9d2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:36.399098 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c684404-791e-4d84-be3c-f8536a6d9d2f admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:36.399965 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cf33fd-1d23-4b4e-b96f-0f07e46fb0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:36.400567 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cf33fd-1d23-4b4e-b96f-0f07e46fb0cb admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:36.400825 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cf33fd-1d23-4b4e-b96f-0f07e46fb0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:36.401095 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cf33fd-1d23-4b4e-b96f-0f07e46fb0cb admin admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:36.401734 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cf33fd-1d23-4b4e-b96f-0f07e46fb0cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:29:36.402035 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cf33fd-1d23-4b4e-b96f-0f07e46fb0cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:36.403621 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cf33fd-1d23-4b4e-b96f-0f07e46fb0cb admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:36.416941 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 778/1561] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 05:29:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:29:36.423769 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 784/1562] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:29:36 2022] POST /identity/v3/users => generated 285 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:29:36.423769 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8213e-0541-4dd9-99ca-396d6728369b None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:36.423769 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8213e-0541-4dd9-99ca-396d6728369b None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:36.423769 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8213e-0541-4dd9-99ca-396d6728369b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:36.424962 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cf33fd-1d23-4b4e-b96f-0f07e46fb0cb admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:36.435071 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cf33fd-1d23-4b4e-b96f-0f07e46fb0cb admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:36.440616 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1294d3-78dc-4b5f-a141-c2bba76d0236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:36.441279 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1294d3-78dc-4b5f-a141-c2bba76d0236 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:36.441529 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1294d3-78dc-4b5f-a141-c2bba76d0236 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:36.441801 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1294d3-78dc-4b5f-a141-c2bba76d0236 admin admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:36.442119 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-5bf8213e-0541-4dd9-99ca-396d6728369b None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:29:36.442433 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1294d3-78dc-4b5f-a141-c2bba76d0236 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:29:36.442732 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1294d3-78dc-4b5f-a141-c2bba76d0236 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:36.443309 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-5bf8213e-0541-4dd9-99ca-396d6728369b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:29:36.444366 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1294d3-78dc-4b5f-a141-c2bba76d0236 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:36.453133 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 785/1563] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:29:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:29:36.453937 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf8213e-0541-4dd9-99ca-396d6728369b None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:36.458527 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:29:36.459670 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 779/1564] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 05:29:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:29:36.460896 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1294d3-78dc-4b5f-a141-c2bba76d0236 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:36.469811 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf8213e-0541-4dd9-99ca-396d6728369b None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:36.471154 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1294d3-78dc-4b5f-a141-c2bba76d0236 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:36.474849 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d746409-3fb4-4109-850c-c6be48c43225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:36.475485 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d746409-3fb4-4109-850c-c6be48c43225 admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:36.475613 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb9ab20-b43f-4ea1-8756-a4918bd5ba4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:36.475795 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d746409-3fb4-4109-850c-c6be48c43225 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:36.476072 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d746409-3fb4-4109-850c-c6be48c43225 admin admin] PATH_INFO: `/v3/domains` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:36.476241 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9ab20-b43f-4ea1-8756-a4918bd5ba4c admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:36.476518 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9ab20-b43f-4ea1-8756-a4918bd5ba4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:36.476788 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9ab20-b43f-4ea1-8756-a4918bd5ba4c admin admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:36.476883 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d746409-3fb4-4109-850c-c6be48c43225 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:29:36.477130 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d746409-3fb4-4109-850c-c6be48c43225 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:36.477417 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb9ab20-b43f-4ea1-8756-a4918bd5ba4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:29:36.477718 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb9ab20-b43f-4ea1-8756-a4918bd5ba4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:36.478784 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d746409-3fb4-4109-850c-c6be48c43225 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:36.479290 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb9ab20-b43f-4ea1-8756-a4918bd5ba4c admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:36.491199 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 786/1565] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 05:29:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:29:36.491621 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 780/1566] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 05:29:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:29:36.492842 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d183d-495c-4d85-9cdd-9bfe01effdd1 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:36.493141 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d183d-495c-4d85-9cdd-9bfe01effdd1 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:36.493415 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d183d-495c-4d85-9cdd-9bfe01effdd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:36.493832 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d746409-3fb4-4109-850c-c6be48c43225 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:36.507182 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d746409-3fb4-4109-850c-c6be48c43225 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:36.512059 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fbe7c2-739d-47cc-81ce-c99a67a6f34d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:36.512859 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fbe7c2-739d-47cc-81ce-c99a67a6f34d admin admin] REQUEST_METHOD: `PUT` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:36.513163 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fbe7c2-739d-47cc-81ce-c99a67a6f34d admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:36.513458 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fbe7c2-739d-47cc-81ce-c99a67a6f34d admin admin] PATH_INFO: `/v3/projects/4ae751d903914a85bf8049a90e21e495/users/72ae9b828c41476ca9414cd26163d384/roles/aa7ff8e0ec1e48e5811335b9eb38b448` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:36.516880 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-818d183d-495c-4d85-9cdd-9bfe01effdd1 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:29:36.518063 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-818d183d-495c-4d85-9cdd-9bfe01effdd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:29:36.525779 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 781/1567] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:29:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:29:36.526542 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818d183d-495c-4d85-9cdd-9bfe01effdd1 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:36.530506 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fbe7c2-739d-47cc-81ce-c99a67a6f34d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ae751d903914a85bf8049a90e21e495, user_id=72ae9b828c41476ca9414cd26163d384, role_id=aa7ff8e0ec1e48e5811335b9eb38b448)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:36.531583 dv-cinder-856921-1-smb devstack@keystone.service[81383]: WARNING py.warnings [None req-59fbe7c2-739d-47cc-81ce-c99a67a6f34d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 05:29:36.531583 dv-cinder-856921-1-smb devstack@keystone.service[81383]: warnings.warn(msg) Sep 11 05:29:36.531583 dv-cinder-856921-1-smb devstack@keystone.service[81383]: Sep 11 05:29:36.533633 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fbe7c2-739d-47cc-81ce-c99a67a6f34d admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:36.535836 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818d183d-495c-4d85-9cdd-9bfe01effdd1 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:36.541279 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf9815e-af6f-4d2e-a8e6-fd73b3b7637a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:36.541992 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf9815e-af6f-4d2e-a8e6-fd73b3b7637a admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:36.542268 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf9815e-af6f-4d2e-a8e6-fd73b3b7637a admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:36.542543 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf9815e-af6f-4d2e-a8e6-fd73b3b7637a admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:36.543271 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf9815e-af6f-4d2e-a8e6-fd73b3b7637a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:36.545016 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf9815e-af6f-4d2e-a8e6-fd73b3b7637a admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:36.547247 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 787/1568] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:29:36 2022] PUT /identity/v3/projects/4ae751d903914a85bf8049a90e21e495/users/72ae9b828c41476ca9414cd26163d384/roles/aa7ff8e0ec1e48e5811335b9eb38b448 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:29:36.548245 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fbe7c2-739d-47cc-81ce-c99a67a6f34d admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:36.558580 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 782/1569] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:29:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:29:36.558580 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf9815e-af6f-4d2e-a8e6-fd73b3b7637a admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:36.566105 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf9815e-af6f-4d2e-a8e6-fd73b3b7637a admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:36.616702 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fbe7c2-739d-47cc-81ce-c99a67a6f34d admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:36.621461 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f078e30-6d02-421a-aae5-ccac824e1631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:36.622069 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f078e30-6d02-421a-aae5-ccac824e1631 admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:36.622342 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f078e30-6d02-421a-aae5-ccac824e1631 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:36.622608 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f078e30-6d02-421a-aae5-ccac824e1631 admin admin] PATH_INFO: `/v3/projects` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:36.622724 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fc299a-9b1e-45df-b993-928eaaedc45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:36.623782 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f078e30-6d02-421a-aae5-ccac824e1631 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:36.623899 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc299a-9b1e-45df-b993-928eaaedc45f admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:36.624111 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc299a-9b1e-45df-b993-928eaaedc45f admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:36.624403 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc299a-9b1e-45df-b993-928eaaedc45f admin admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:36.625039 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fc299a-9b1e-45df-b993-928eaaedc45f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:29:36.625347 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fc299a-9b1e-45df-b993-928eaaedc45f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:36.625687 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f078e30-6d02-421a-aae5-ccac824e1631 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:36.626955 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fc299a-9b1e-45df-b993-928eaaedc45f admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:36.638331 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 783/1570] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 05:29:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:29:36.639800 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fc299a-9b1e-45df-b993-928eaaedc45f admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:36.650875 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fc299a-9b1e-45df-b993-928eaaedc45f admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:36.653849 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 788/1571] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:29:36 2022] POST /identity/v3/projects => generated 383 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:29:36.655062 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f078e30-6d02-421a-aae5-ccac824e1631 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:36.655808 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b639340-a5ab-48f8-ba27-7aefde4f2295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:36.656411 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b639340-a5ab-48f8-ba27-7aefde4f2295 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:36.656760 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b639340-a5ab-48f8-ba27-7aefde4f2295 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:36.657045 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b639340-a5ab-48f8-ba27-7aefde4f2295 admin admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:36.657675 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b639340-a5ab-48f8-ba27-7aefde4f2295 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:36.659628 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b639340-a5ab-48f8-ba27-7aefde4f2295 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:36.686776 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 784/1572] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:29:36 2022] POST /identity/v3/projects => generated 389 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:29:36.687569 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b639340-a5ab-48f8-ba27-7aefde4f2295 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:36.721550 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f078e30-6d02-421a-aae5-ccac824e1631 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:36.751488 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b639340-a5ab-48f8-ba27-7aefde4f2295 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:36.758079 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be386f5-c1dd-42ff-9f78-c847be6902e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:36.758638 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be386f5-c1dd-42ff-9f78-c847be6902e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:36.758920 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be386f5-c1dd-42ff-9f78-c847be6902e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:36.759194 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be386f5-c1dd-42ff-9f78-c847be6902e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:36.759877 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be386f5-c1dd-42ff-9f78-c847be6902e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:36.761818 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be386f5-c1dd-42ff-9f78-c847be6902e0 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:36.774190 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:29:36.777288 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:29:36.785146 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea6484b-9699-432a-b48e-78fdade025b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:36.787308 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea6484b-9699-432a-b48e-78fdade025b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:36.788507 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea6484b-9699-432a-b48e-78fdade025b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:36.788780 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea6484b-9699-432a-b48e-78fdade025b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:36.789545 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea6484b-9699-432a-b48e-78fdade025b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:36.791324 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea6484b-9699-432a-b48e-78fdade025b3 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:36.798271 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 785/1573] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:29:36 2022] POST /identity/v3/projects => generated 373 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:29:36.799229 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be386f5-c1dd-42ff-9f78-c847be6902e0 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:36.822121 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 789/1574] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:29:36 2022] POST /identity/v3/projects => generated 379 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:29:36.822121 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85726ab8-e2b6-41a8-999c-abbad4e6be71 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:36.822121 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85726ab8-e2b6-41a8-999c-abbad4e6be71 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:36.822121 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85726ab8-e2b6-41a8-999c-abbad4e6be71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:36.840027 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-85726ab8-e2b6-41a8-999c-abbad4e6be71 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:29:36.841229 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-85726ab8-e2b6-41a8-999c-abbad4e6be71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:29:36.867162 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be386f5-c1dd-42ff-9f78-c847be6902e0 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:36.906535 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 790/1575] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:29:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:29:36.908675 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85726ab8-e2b6-41a8-999c-abbad4e6be71 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:36.919000 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85726ab8-e2b6-41a8-999c-abbad4e6be71 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:36.924261 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2545008e-44df-425e-87ed-3fef38514de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:36.924871 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2545008e-44df-425e-87ed-3fef38514de7 admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:36.925154 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2545008e-44df-425e-87ed-3fef38514de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:36.925431 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2545008e-44df-425e-87ed-3fef38514de7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:36.926112 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2545008e-44df-425e-87ed-3fef38514de7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:36.927754 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2545008e-44df-425e-87ed-3fef38514de7 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:36.931952 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168708be-9b25-4cd2-8c1c-0c3e8e4db949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:36.932565 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168708be-9b25-4cd2-8c1c-0c3e8e4db949 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:36.933258 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168708be-9b25-4cd2-8c1c-0c3e8e4db949 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:36.933551 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168708be-9b25-4cd2-8c1c-0c3e8e4db949 admin admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:36.934196 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168708be-9b25-4cd2-8c1c-0c3e8e4db949 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:29:36.934500 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168708be-9b25-4cd2-8c1c-0c3e8e4db949 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:36.936366 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168708be-9b25-4cd2-8c1c-0c3e8e4db949 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:36.937880 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 791/1576] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:29:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:29:36.939281 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2545008e-44df-425e-87ed-3fef38514de7 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:36.948530 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 786/1577] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 05:29:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:29:36.949443 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168708be-9b25-4cd2-8c1c-0c3e8e4db949 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:36.952358 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2545008e-44df-425e-87ed-3fef38514de7 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:36.957699 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74aad93-f584-416c-9fd2-23dee2bc468e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:36.958399 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74aad93-f584-416c-9fd2-23dee2bc468e admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:36.958745 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74aad93-f584-416c-9fd2-23dee2bc468e admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:36.959087 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74aad93-f584-416c-9fd2-23dee2bc468e admin admin] PATH_INFO: `/v3/projects` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:36.959707 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168708be-9b25-4cd2-8c1c-0c3e8e4db949 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:36.959827 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74aad93-f584-416c-9fd2-23dee2bc468e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:36.961720 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74aad93-f584-416c-9fd2-23dee2bc468e admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:36.964407 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f95cbd3-9bbf-41ef-bc1b-f2ce4a37f130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:36.965023 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f95cbd3-9bbf-41ef-bc1b-f2ce4a37f130 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:36.965296 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f95cbd3-9bbf-41ef-bc1b-f2ce4a37f130 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:36.965588 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f95cbd3-9bbf-41ef-bc1b-f2ce4a37f130 admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:36.966389 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f95cbd3-9bbf-41ef-bc1b-f2ce4a37f130 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:36.968845 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f95cbd3-9bbf-41ef-bc1b-f2ce4a37f130 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:36.994073 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 792/1578] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:29:36 2022] POST /identity/v3/projects => generated 365 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:29:36.994073 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74aad93-f584-416c-9fd2-23dee2bc468e admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:36.994377 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 787/1579] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:29:36 2022] POST /identity/v3/users => generated 292 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:29:36.994377 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f95cbd3-9bbf-41ef-bc1b-f2ce4a37f130 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:37.005076 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f95cbd3-9bbf-41ef-bc1b-f2ce4a37f130 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:37.061926 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74aad93-f584-416c-9fd2-23dee2bc468e admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:37.064593 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389543ee-86d4-41df-809d-f0659cb2bb11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:37.065199 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389543ee-86d4-41df-809d-f0659cb2bb11 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:37.065474 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389543ee-86d4-41df-809d-f0659cb2bb11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:37.065744 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389543ee-86d4-41df-809d-f0659cb2bb11 admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:37.066371 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389543ee-86d4-41df-809d-f0659cb2bb11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:37.066642 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a36ac7-b4f4-4805-bafc-c717cf0ce31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:37.067258 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a36ac7-b4f4-4805-bafc-c717cf0ce31f admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:37.067534 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a36ac7-b4f4-4805-bafc-c717cf0ce31f admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:37.067851 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a36ac7-b4f4-4805-bafc-c717cf0ce31f admin admin] PATH_INFO: `/v3/users` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:37.068331 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389543ee-86d4-41df-809d-f0659cb2bb11 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:37.068575 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a36ac7-b4f4-4805-bafc-c717cf0ce31f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:37.070490 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a36ac7-b4f4-4805-bafc-c717cf0ce31f admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:37.090051 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 788/1580] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:29:36 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:29:37.090938 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389543ee-86d4-41df-809d-f0659cb2bb11 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:37.092585 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 793/1581] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:29:36 2022] POST /identity/v3/users => generated 295 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:29:37.093399 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a36ac7-b4f4-4805-bafc-c717cf0ce31f admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:37.099720 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:29:37.104268 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389543ee-86d4-41df-809d-f0659cb2bb11 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:37.110459 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb355b-d1e4-4ba3-b773-2f7491566353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:37.111060 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb355b-d1e4-4ba3-b773-2f7491566353 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:37.111365 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb355b-d1e4-4ba3-b773-2f7491566353 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:37.111631 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb355b-d1e4-4ba3-b773-2f7491566353 admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:37.112330 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdb355b-d1e4-4ba3-b773-2f7491566353 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:37.114257 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdb355b-d1e4-4ba3-b773-2f7491566353 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:37.135705 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 789/1582] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:29:37 2022] POST /identity/v3/users => generated 290 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:29:37.136635 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb355b-d1e4-4ba3-b773-2f7491566353 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:37.141167 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:29:37.147650 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb355b-d1e4-4ba3-b773-2f7491566353 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:37.153192 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6c418e-c0e6-42f2-a4a6-35ce5b40c8f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:37.153834 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c418e-c0e6-42f2-a4a6-35ce5b40c8f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:37.154115 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c418e-c0e6-42f2-a4a6-35ce5b40c8f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:37.154293 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a36ac7-b4f4-4805-bafc-c717cf0ce31f admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:37.154466 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c418e-c0e6-42f2-a4a6-35ce5b40c8f5 admin admin] PATH_INFO: `/v3/projects/56650a2edf6c440092f885e1470eb8d1/users/a31f229e622c4898b73410bab27af40c/roles/aa7ff8e0ec1e48e5811335b9eb38b448` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:37.157950 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27dfb22-f6ac-4e24-b28b-12fd3e46f5a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:37.158562 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27dfb22-f6ac-4e24-b28b-12fd3e46f5a9 service neutron] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:37.158843 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27dfb22-f6ac-4e24-b28b-12fd3e46f5a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:37.159119 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27dfb22-f6ac-4e24-b28b-12fd3e46f5a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:37.168453 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27dfb22-f6ac-4e24-b28b-12fd3e46f5a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:37.169362 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6c418e-c0e6-42f2-a4a6-35ce5b40c8f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56650a2edf6c440092f885e1470eb8d1, user_id=a31f229e622c4898b73410bab27af40c, role_id=aa7ff8e0ec1e48e5811335b9eb38b448)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:37.169938 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27dfb22-f6ac-4e24-b28b-12fd3e46f5a9 service neutron] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:37.172096 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6c418e-c0e6-42f2-a4a6-35ce5b40c8f5 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:37.180965 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 794/1583] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:29:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:29:37.181729 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27dfb22-f6ac-4e24-b28b-12fd3e46f5a9 service neutron] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:37.185259 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 790/1584] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:29:37 2022] PUT /identity/v3/projects/56650a2edf6c440092f885e1470eb8d1/users/a31f229e622c4898b73410bab27af40c/roles/aa7ff8e0ec1e48e5811335b9eb38b448 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:29:37.186596 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6c418e-c0e6-42f2-a4a6-35ce5b40c8f5 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:37.192176 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27dfb22-f6ac-4e24-b28b-12fd3e46f5a9 service neutron] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:37.253920 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea3e35e-f5f4-4785-8a79-0726c300ef73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:37.254601 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea3e35e-f5f4-4785-8a79-0726c300ef73 admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:37.254971 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea3e35e-f5f4-4785-8a79-0726c300ef73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:37.255165 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea3e35e-f5f4-4785-8a79-0726c300ef73 admin admin] PATH_INFO: `/v3/projects` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:37.256251 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea3e35e-f5f4-4785-8a79-0726c300ef73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:37.257564 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6c418e-c0e6-42f2-a4a6-35ce5b40c8f5 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:37.257922 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea3e35e-f5f4-4785-8a79-0726c300ef73 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:37.262700 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5640fa-b9c0-4cf5-bdb4-05f16c809362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:37.263466 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5640fa-b9c0-4cf5-bdb4-05f16c809362 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:37.263860 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5640fa-b9c0-4cf5-bdb4-05f16c809362 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:37.264376 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5640fa-b9c0-4cf5-bdb4-05f16c809362 admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:37.265080 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5640fa-b9c0-4cf5-bdb4-05f16c809362 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:37.267351 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5640fa-b9c0-4cf5-bdb4-05f16c809362 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:37.289169 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 795/1585] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:29:37 2022] POST /identity/v3/projects => generated 393 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:29:37.289785 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea3e35e-f5f4-4785-8a79-0726c300ef73 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:37.293997 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 791/1586] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:29:37 2022] POST /identity/v3/users => generated 283 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:29:37.295017 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5640fa-b9c0-4cf5-bdb4-05f16c809362 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:37.305155 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5640fa-b9c0-4cf5-bdb4-05f16c809362 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:37.361462 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea3e35e-f5f4-4785-8a79-0726c300ef73 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:37.367337 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdb42d9-cb59-40e0-a84a-9a533f9c280d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:37.368345 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb42d9-cb59-40e0-a84a-9a533f9c280d admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:37.368868 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb42d9-cb59-40e0-a84a-9a533f9c280d admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:37.369316 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb42d9-cb59-40e0-a84a-9a533f9c280d admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:37.370215 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdb42d9-cb59-40e0-a84a-9a533f9c280d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:37.374703 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdb42d9-cb59-40e0-a84a-9a533f9c280d admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:37.385334 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fe54f8-73f3-4514-a872-c100b6c7b103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:37.386027 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe54f8-73f3-4514-a872-c100b6c7b103 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:37.386315 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe54f8-73f3-4514-a872-c100b6c7b103 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:37.386572 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe54f8-73f3-4514-a872-c100b6c7b103 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:37.387512 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fe54f8-73f3-4514-a872-c100b6c7b103 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:37.388851 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 796/1587] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:29:37 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:29:37.389947 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fe54f8-73f3-4514-a872-c100b6c7b103 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:37.390219 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdb42d9-cb59-40e0-a84a-9a533f9c280d admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:37.401605 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 792/1588] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:29:37 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:29:37.402625 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fe54f8-73f3-4514-a872-c100b6c7b103 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:37.403275 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdb42d9-cb59-40e0-a84a-9a533f9c280d admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:37.409444 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9d0ec4-4189-4d1c-9b6b-3b08a9a8966d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:37.410183 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9d0ec4-4189-4d1c-9b6b-3b08a9a8966d admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:37.410559 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9d0ec4-4189-4d1c-9b6b-3b08a9a8966d admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:37.410918 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9d0ec4-4189-4d1c-9b6b-3b08a9a8966d admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:37.411625 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9d0ec4-4189-4d1c-9b6b-3b08a9a8966d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:37.413502 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9d0ec4-4189-4d1c-9b6b-3b08a9a8966d admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:37.414462 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fe54f8-73f3-4514-a872-c100b6c7b103 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:37.419738 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c116d3f8-fc18-4d5e-8068-f03028aa2c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:37.420974 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c116d3f8-fc18-4d5e-8068-f03028aa2c69 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:37.421324 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c116d3f8-fc18-4d5e-8068-f03028aa2c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:37.421670 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c116d3f8-fc18-4d5e-8068-f03028aa2c69 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:37.422388 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c116d3f8-fc18-4d5e-8068-f03028aa2c69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:37.424088 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c116d3f8-fc18-4d5e-8068-f03028aa2c69 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:37.427061 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 797/1589] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:29:37 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:29:37.427061 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2121718-f196-435e-b092-515355e319be None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:37.427061 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2121718-f196-435e-b092-515355e319be None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:37.427061 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2121718-f196-435e-b092-515355e319be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:37.435937 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 793/1590] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:29:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:29:37.436663 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c116d3f8-fc18-4d5e-8068-f03028aa2c69 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:37.447291 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c116d3f8-fc18-4d5e-8068-f03028aa2c69 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:37.452964 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03106a65-76f4-4f58-b8ae-7a6723724c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:37.453647 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03106a65-76f4-4f58-b8ae-7a6723724c51 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:37.454133 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03106a65-76f4-4f58-b8ae-7a6723724c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:37.454280 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03106a65-76f4-4f58-b8ae-7a6723724c51 admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:37.455117 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03106a65-76f4-4f58-b8ae-7a6723724c51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:37.457028 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03106a65-76f4-4f58-b8ae-7a6723724c51 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:37.463752 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-a2121718-f196-435e-b092-515355e319be None None] MFA Rules not processed for user `a31f229e622c4898b73410bab27af40c`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:29:37.465034 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-a2121718-f196-435e-b092-515355e319be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:29:37.485291 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 794/1591] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:29:37 2022] POST /identity/v3/users => generated 297 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:29:37.485291 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03106a65-76f4-4f58-b8ae-7a6723724c51 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:37.494700 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03106a65-76f4-4f58-b8ae-7a6723724c51 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:37.500032 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f60f26b-6623-485a-a8af-0c708fc97185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:37.500704 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60f26b-6623-485a-a8af-0c708fc97185 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:37.501062 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60f26b-6623-485a-a8af-0c708fc97185 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:37.501390 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60f26b-6623-485a-a8af-0c708fc97185 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:37.502097 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f60f26b-6623-485a-a8af-0c708fc97185 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:37.503820 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f60f26b-6623-485a-a8af-0c708fc97185 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:37.518253 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 795/1592] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:29:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:29:37.518253 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f60f26b-6623-485a-a8af-0c708fc97185 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:37.522626 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:29:37.527703 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f60f26b-6623-485a-a8af-0c708fc97185 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:37.534444 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df7d568-cfdc-4eac-8eb4-0b2752993f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:37.535541 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df7d568-cfdc-4eac-8eb4-0b2752993f8c admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:37.536025 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df7d568-cfdc-4eac-8eb4-0b2752993f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:37.536467 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df7d568-cfdc-4eac-8eb4-0b2752993f8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:37.537304 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df7d568-cfdc-4eac-8eb4-0b2752993f8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:37.539257 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df7d568-cfdc-4eac-8eb4-0b2752993f8c admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:37.542109 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:29:37.557119 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 796/1593] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:29:37 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:29:37.557119 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df7d568-cfdc-4eac-8eb4-0b2752993f8c admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:37.566713 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 798/1594] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:29:37 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:29:37.566713 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2121718-f196-435e-b092-515355e319be None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:37.566993 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df7d568-cfdc-4eac-8eb4-0b2752993f8c admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:37.571468 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6586b70-879d-4723-81c1-28c0ddc1126e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:37.572199 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6586b70-879d-4723-81c1-28c0ddc1126e admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:37.572543 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6586b70-879d-4723-81c1-28c0ddc1126e admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:37.572887 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6586b70-879d-4723-81c1-28c0ddc1126e admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:37.573605 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6586b70-879d-4723-81c1-28c0ddc1126e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:37.575263 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6586b70-879d-4723-81c1-28c0ddc1126e admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:37.578339 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2121718-f196-435e-b092-515355e319be None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:37.582935 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0479b30-2b47-4b31-9c42-129b461754ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:37.583620 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0479b30-2b47-4b31-9c42-129b461754ba admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:37.583992 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0479b30-2b47-4b31-9c42-129b461754ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:37.584331 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0479b30-2b47-4b31-9c42-129b461754ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:37.585045 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0479b30-2b47-4b31-9c42-129b461754ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:37.586713 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0479b30-2b47-4b31-9c42-129b461754ba admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:37.586858 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 797/1595] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:29:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:29:37.587712 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6586b70-879d-4723-81c1-28c0ddc1126e admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:37.600282 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6586b70-879d-4723-81c1-28c0ddc1126e admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:37.603039 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 799/1596] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:29:37 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:29:37.605469 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83024962-6b60-42b8-a5f5-fa4974be1e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:37.606235 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83024962-6b60-42b8-a5f5-fa4974be1e4a admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:37.606638 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83024962-6b60-42b8-a5f5-fa4974be1e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:37.606979 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83024962-6b60-42b8-a5f5-fa4974be1e4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:37.607184 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0479b30-2b47-4b31-9c42-129b461754ba admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:37.608490 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83024962-6b60-42b8-a5f5-fa4974be1e4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:37.610615 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83024962-6b60-42b8-a5f5-fa4974be1e4a admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:37.619505 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0479b30-2b47-4b31-9c42-129b461754ba admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:37.624779 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeb77c1-0bdf-4171-bc63-8ec81e8534d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:37.625562 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb77c1-0bdf-4171-bc63-8ec81e8534d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:37.625937 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb77c1-0bdf-4171-bc63-8ec81e8534d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:37.626368 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb77c1-0bdf-4171-bc63-8ec81e8534d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:37.627149 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeb77c1-0bdf-4171-bc63-8ec81e8534d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:37.627862 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 798/1597] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:29:37 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:29:37.628762 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83024962-6b60-42b8-a5f5-fa4974be1e4a admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:37.629241 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeb77c1-0bdf-4171-bc63-8ec81e8534d4 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:37.640404 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83024962-6b60-42b8-a5f5-fa4974be1e4a admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:37.641962 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 800/1598] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:29:37 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:29:37.642887 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeb77c1-0bdf-4171-bc63-8ec81e8534d4 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:37.645575 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b338063-b4ff-40f6-a61f-f56834d89584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:37.646313 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b338063-b4ff-40f6-a61f-f56834d89584 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:37.646691 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b338063-b4ff-40f6-a61f-f56834d89584 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:37.647030 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b338063-b4ff-40f6-a61f-f56834d89584 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:37.647949 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b338063-b4ff-40f6-a61f-f56834d89584 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:37.650022 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b338063-b4ff-40f6-a61f-f56834d89584 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:37.655110 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeb77c1-0bdf-4171-bc63-8ec81e8534d4 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:37.661199 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 799/1599] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:29:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:29:37.661647 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa46ee-a50e-447b-a0b4-07d2d86d8c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:37.663538 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b338063-b4ff-40f6-a61f-f56834d89584 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:37.663641 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa46ee-a50e-447b-a0b4-07d2d86d8c0d admin admin] REQUEST_METHOD: `PUT` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:37.663641 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa46ee-a50e-447b-a0b4-07d2d86d8c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:37.663913 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa46ee-a50e-447b-a0b4-07d2d86d8c0d admin admin] PATH_INFO: `/v3/projects/e9fc3c31ce704cffb7c2e80c1f29e185/users/c6acfbf2b06e4e14ab37cf34732d86b5/roles/aa7ff8e0ec1e48e5811335b9eb38b448` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:37.674518 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b338063-b4ff-40f6-a61f-f56834d89584 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:37.679419 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47864b32-dda9-42d2-8f33-7e7103740570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:37.680126 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47864b32-dda9-42d2-8f33-7e7103740570 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:37.680469 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47864b32-dda9-42d2-8f33-7e7103740570 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:37.680804 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47864b32-dda9-42d2-8f33-7e7103740570 admin admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:37.681510 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47864b32-dda9-42d2-8f33-7e7103740570 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:37.683910 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47864b32-dda9-42d2-8f33-7e7103740570 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:37.684756 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fa46ee-a50e-447b-a0b4-07d2d86d8c0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9fc3c31ce704cffb7c2e80c1f29e185, user_id=c6acfbf2b06e4e14ab37cf34732d86b5, role_id=aa7ff8e0ec1e48e5811335b9eb38b448)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:37.687622 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fa46ee-a50e-447b-a0b4-07d2d86d8c0d admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:37.705403 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 801/1600] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:29:37 2022] PUT /identity/v3/projects/e9fc3c31ce704cffb7c2e80c1f29e185/users/c6acfbf2b06e4e14ab37cf34732d86b5/roles/aa7ff8e0ec1e48e5811335b9eb38b448 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:29:37.706183 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa46ee-a50e-447b-a0b4-07d2d86d8c0d admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:37.720856 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 800/1601] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:29:37 2022] POST /identity/v3/projects => generated 367 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:29:37.722502 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47864b32-dda9-42d2-8f33-7e7103740570 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:37.791204 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa46ee-a50e-447b-a0b4-07d2d86d8c0d admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:37.794234 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47864b32-dda9-42d2-8f33-7e7103740570 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:37.797304 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cbb300-4ece-4d38-9457-87a0be6d0739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:37.798224 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cbb300-4ece-4d38-9457-87a0be6d0739 admin admin] REQUEST_METHOD: `PUT` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:37.798563 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cbb300-4ece-4d38-9457-87a0be6d0739 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:37.798783 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cbb300-4ece-4d38-9457-87a0be6d0739 admin admin] PATH_INFO: `/v3/projects/8ff34ddc3d494ea5a30ed08c11879fc2/users/0b33626d0fd04806a99b1c40acff4ac7/roles/aa7ff8e0ec1e48e5811335b9eb38b448` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:37.799211 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff32ac3e-e866-4a50-a359-f2831adf7bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:37.799967 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32ac3e-e866-4a50-a359-f2831adf7bc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:37.800314 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32ac3e-e866-4a50-a359-f2831adf7bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:37.800659 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32ac3e-e866-4a50-a359-f2831adf7bc8 admin admin] PATH_INFO: `/v3/projects/aa9a5f2733a34f13a9ca6940e3fe3c56/users/2733ccb746fd454b8e53bf6ae162f38e/roles/aa7ff8e0ec1e48e5811335b9eb38b448` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:37.817129 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cbb300-4ece-4d38-9457-87a0be6d0739 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ff34ddc3d494ea5a30ed08c11879fc2, user_id=0b33626d0fd04806a99b1c40acff4ac7, role_id=aa7ff8e0ec1e48e5811335b9eb38b448)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:37.817519 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff32ac3e-e866-4a50-a359-f2831adf7bc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa9a5f2733a34f13a9ca6940e3fe3c56, user_id=2733ccb746fd454b8e53bf6ae162f38e, role_id=aa7ff8e0ec1e48e5811335b9eb38b448)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:37.819924 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cbb300-4ece-4d38-9457-87a0be6d0739 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:37.820945 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff32ac3e-e866-4a50-a359-f2831adf7bc8 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:37.834275 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 802/1602] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:29:37 2022] PUT /identity/v3/projects/8ff34ddc3d494ea5a30ed08c11879fc2/users/0b33626d0fd04806a99b1c40acff4ac7/roles/aa7ff8e0ec1e48e5811335b9eb38b448 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:29:37.835102 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cbb300-4ece-4d38-9457-87a0be6d0739 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:37.836163 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 801/1603] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:29:37 2022] PUT /identity/v3/projects/aa9a5f2733a34f13a9ca6940e3fe3c56/users/2733ccb746fd454b8e53bf6ae162f38e/roles/aa7ff8e0ec1e48e5811335b9eb38b448 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:29:37.841287 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff32ac3e-e866-4a50-a359-f2831adf7bc8 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:37.912703 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff32ac3e-e866-4a50-a359-f2831adf7bc8 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:37.918437 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1945bf96-267d-4e1d-9402-e080dfe3dfd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:37.919105 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1945bf96-267d-4e1d-9402-e080dfe3dfd2 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:37.919386 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1945bf96-267d-4e1d-9402-e080dfe3dfd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:37.919657 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1945bf96-267d-4e1d-9402-e080dfe3dfd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:37.920407 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1945bf96-267d-4e1d-9402-e080dfe3dfd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:37.922023 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1945bf96-267d-4e1d-9402-e080dfe3dfd2 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:37.931189 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cbb300-4ece-4d38-9457-87a0be6d0739 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:37.937676 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 802/1604] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:29:37 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:29:37.937676 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1945bf96-267d-4e1d-9402-e080dfe3dfd2 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:37.940993 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c70f9e-f57a-4684-a852-35e22015648e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:37.941741 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c70f9e-f57a-4684-a852-35e22015648e admin admin] REQUEST_METHOD: `PUT` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:37.942100 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c70f9e-f57a-4684-a852-35e22015648e admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:37.942462 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c70f9e-f57a-4684-a852-35e22015648e admin admin] PATH_INFO: `/v3/projects/c4c8044eca3e4e6485c510ba8e3126de/users/87ebd7f813984d42aa137de7e1090757/roles/aa7ff8e0ec1e48e5811335b9eb38b448` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:37.947980 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1945bf96-267d-4e1d-9402-e080dfe3dfd2 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:37.953849 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e074f1b5-1ba4-462d-96d6-c521335aa588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:37.954250 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074f1b5-1ba4-462d-96d6-c521335aa588 admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:37.954381 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074f1b5-1ba4-462d-96d6-c521335aa588 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:37.954655 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074f1b5-1ba4-462d-96d6-c521335aa588 admin admin] PATH_INFO: `/v3/projects/7a56876ea9194df5ad3a2a84988f81fd/users/252a604d65904fd6bb0c3e47c9941bd7/roles/aa7ff8e0ec1e48e5811335b9eb38b448` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:37.960381 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c70f9e-f57a-4684-a852-35e22015648e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4c8044eca3e4e6485c510ba8e3126de, user_id=87ebd7f813984d42aa137de7e1090757, role_id=aa7ff8e0ec1e48e5811335b9eb38b448)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:37.963896 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c70f9e-f57a-4684-a852-35e22015648e admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:37.982001 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e074f1b5-1ba4-462d-96d6-c521335aa588 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a56876ea9194df5ad3a2a84988f81fd, user_id=252a604d65904fd6bb0c3e47c9941bd7, role_id=aa7ff8e0ec1e48e5811335b9eb38b448)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:37.984363 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 803/1605] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:29:37 2022] PUT /identity/v3/projects/c4c8044eca3e4e6485c510ba8e3126de/users/87ebd7f813984d42aa137de7e1090757/roles/aa7ff8e0ec1e48e5811335b9eb38b448 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:29:37.987168 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e074f1b5-1ba4-462d-96d6-c521335aa588 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:37.988569 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b166322-7e3d-4e12-9ee4-eab9a3d190ba None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:37.989993 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b166322-7e3d-4e12-9ee4-eab9a3d190ba None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:37.990628 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b166322-7e3d-4e12-9ee4-eab9a3d190ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:38.002082 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:29:38.004329 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:29:38.015744 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 803/1606] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:29:37 2022] PUT /identity/v3/projects/7a56876ea9194df5ad3a2a84988f81fd/users/252a604d65904fd6bb0c3e47c9941bd7/roles/aa7ff8e0ec1e48e5811335b9eb38b448 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:29:38.016690 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e074f1b5-1ba4-462d-96d6-c521335aa588 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:38.047654 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-6b166322-7e3d-4e12-9ee4-eab9a3d190ba None None] MFA Rules not processed for user `c6acfbf2b06e4e14ab37cf34732d86b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:29:38.049750 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-6b166322-7e3d-4e12-9ee4-eab9a3d190ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:29:38.098709 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e074f1b5-1ba4-462d-96d6-c521335aa588 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:38.108518 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b84dc5-4ad9-448d-a229-030ab4a5897e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:38.109422 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b84dc5-4ad9-448d-a229-030ab4a5897e admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:38.109854 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b84dc5-4ad9-448d-a229-030ab4a5897e admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:38.110469 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b84dc5-4ad9-448d-a229-030ab4a5897e admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:38.111406 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b84dc5-4ad9-448d-a229-030ab4a5897e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:38.114818 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b84dc5-4ad9-448d-a229-030ab4a5897e admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:38.138739 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 804/1607] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:29:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:29:38.140054 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f2d7ea-ef63-4c7a-9b91-e0da5a6e471e None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:38.140344 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f2d7ea-ef63-4c7a-9b91-e0da5a6e471e None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:38.140620 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f2d7ea-ef63-4c7a-9b91-e0da5a6e471e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:38.145509 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 804/1608] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:29:38 2022] POST /identity/v3/users => generated 290 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:29:38.147208 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b2526-b90a-49df-9d13-86fe550bd31f None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:38.147672 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b2526-b90a-49df-9d13-86fe550bd31f None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:38.148604 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b2526-b90a-49df-9d13-86fe550bd31f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:38.163092 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-40f2d7ea-ef63-4c7a-9b91-e0da5a6e471e None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:29:38.164448 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-40f2d7ea-ef63-4c7a-9b91-e0da5a6e471e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:29:38.173285 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 805/1609] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:29:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:29:38.174103 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f2d7ea-ef63-4c7a-9b91-e0da5a6e471e None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:38.189134 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f2d7ea-ef63-4c7a-9b91-e0da5a6e471e None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:38.195206 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9717337c-3ec9-4c76-8bcf-b5d0372c31d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:38.196493 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9717337c-3ec9-4c76-8bcf-b5d0372c31d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:38.197088 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9717337c-3ec9-4c76-8bcf-b5d0372c31d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:38.197384 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9717337c-3ec9-4c76-8bcf-b5d0372c31d0 admin admin] PATH_INFO: `/v3/projects/e2544255d57a43c981bb681bfe939c06/users/dae006738da54b26a64097de95bef254/roles/aa7ff8e0ec1e48e5811335b9eb38b448` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:38.197958 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-250b2526-b90a-49df-9d13-86fe550bd31f None None] MFA Rules not processed for user `0b33626d0fd04806a99b1c40acff4ac7`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:29:38.199744 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-250b2526-b90a-49df-9d13-86fe550bd31f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:29:38.218598 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9717337c-3ec9-4c76-8bcf-b5d0372c31d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2544255d57a43c981bb681bfe939c06, user_id=dae006738da54b26a64097de95bef254, role_id=aa7ff8e0ec1e48e5811335b9eb38b448)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:38.221531 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9717337c-3ec9-4c76-8bcf-b5d0372c31d0 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:38.242942 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 806/1610] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:29:38 2022] PUT /identity/v3/projects/e2544255d57a43c981bb681bfe939c06/users/dae006738da54b26a64097de95bef254/roles/aa7ff8e0ec1e48e5811335b9eb38b448 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:29:38.242942 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f086fd5-ed5c-4300-ab89-1c71fe83c684 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:38.242942 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f086fd5-ed5c-4300-ab89-1c71fe83c684 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:38.242942 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f086fd5-ed5c-4300-ab89-1c71fe83c684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:38.262592 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-4f086fd5-ed5c-4300-ab89-1c71fe83c684 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:29:38.263597 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-4f086fd5-ed5c-4300-ab89-1c71fe83c684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:29:38.286668 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 805/1611] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:29:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:29:38.288617 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b76a1-1cc8-478e-82cc-deb151a252d6 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:38.288996 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b76a1-1cc8-478e-82cc-deb151a252d6 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:38.289497 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b76a1-1cc8-478e-82cc-deb151a252d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:38.324948 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-6f8b76a1-1cc8-478e-82cc-deb151a252d6 None None] MFA Rules not processed for user `252a604d65904fd6bb0c3e47c9941bd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:29:38.327624 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-6f8b76a1-1cc8-478e-82cc-deb151a252d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:29:38.363033 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 807/1612] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:29:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:29:38.368261 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f086fd5-ed5c-4300-ab89-1c71fe83c684 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:38.379993 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f086fd5-ed5c-4300-ab89-1c71fe83c684 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:38.385886 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae0427e-8065-42e8-8a61-66c4e1c66cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:38.386740 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae0427e-8065-42e8-8a61-66c4e1c66cd2 admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:38.387263 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae0427e-8065-42e8-8a61-66c4e1c66cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:38.387945 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae0427e-8065-42e8-8a61-66c4e1c66cd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:38.389321 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae0427e-8065-42e8-8a61-66c4e1c66cd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:38.391290 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae0427e-8065-42e8-8a61-66c4e1c66cd2 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:38.403762 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 808/1613] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:29:38 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:29:38.405362 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a3a14-1b30-41ba-953e-9022a8ddba91 None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:38.405773 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a3a14-1b30-41ba-953e-9022a8ddba91 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:38.406200 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a3a14-1b30-41ba-953e-9022a8ddba91 None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:38.408516 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 809/1614] 10.222.0.16 () {54 vars in 962 bytes} [Sun Sep 11 05:29:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:29:38.409920 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032a3a14-1b30-41ba-953e-9022a8ddba91 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:38.421829 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 806/1615] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:29:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:29:38.424313 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e54f4-fc6b-46eb-a03b-4a438a2f16c0 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:38.424856 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e54f4-fc6b-46eb-a03b-4a438a2f16c0 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:38.425318 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e54f4-fc6b-46eb-a03b-4a438a2f16c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:38.445472 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:29:38.454374 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-ad4e54f4-fc6b-46eb-a03b-4a438a2f16c0 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:29:38.457102 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-ad4e54f4-fc6b-46eb-a03b-4a438a2f16c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:29:38.472383 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 807/1616] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:29:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:29:38.477349 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd652cc-d025-4292-8537-496ce45cd2bb None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:38.477709 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd652cc-d025-4292-8537-496ce45cd2bb None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:38.478132 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd652cc-d025-4292-8537-496ce45cd2bb None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:38.480048 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 808/1617] 10.222.0.16 () {54 vars in 962 bytes} [Sun Sep 11 05:29:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:29:38.480850 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd652cc-d025-4292-8537-496ce45cd2bb None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:38.501309 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032a3a14-1b30-41ba-953e-9022a8ddba91 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:38.507051 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2aec41-eb26-4a51-a131-8f7e6394b6d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:38.509018 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2aec41-eb26-4a51-a131-8f7e6394b6d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:38.509372 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2aec41-eb26-4a51-a131-8f7e6394b6d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:38.509760 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2aec41-eb26-4a51-a131-8f7e6394b6d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:38.519966 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:29:38.527776 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2aec41-eb26-4a51-a131-8f7e6394b6d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:38.531222 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2aec41-eb26-4a51-a131-8f7e6394b6d4 service neutron] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:38.552608 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 810/1618] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:29:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:29:38.553085 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2aec41-eb26-4a51-a131-8f7e6394b6d4 service neutron] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:38.568691 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2aec41-eb26-4a51-a131-8f7e6394b6d4 service neutron] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:38.581513 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f717786-e348-4ad8-aa52-66a87ed67cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:38.582238 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f717786-e348-4ad8-aa52-66a87ed67cf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:38.582869 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f717786-e348-4ad8-aa52-66a87ed67cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:38.583190 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f717786-e348-4ad8-aa52-66a87ed67cf4 admin admin] PATH_INFO: `/v3/projects/2b550483f333457fa32c4987be88ef2e/users/72a3c7c50e28410691d2a6fc28c1b9dd/roles/5b702713e40145b49e0b42abd0a5fba9` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:38.593533 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd652cc-d025-4292-8537-496ce45cd2bb None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:38.604900 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f717786-e348-4ad8-aa52-66a87ed67cf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b550483f333457fa32c4987be88ef2e, user_id=72a3c7c50e28410691d2a6fc28c1b9dd, role_id=5b702713e40145b49e0b42abd0a5fba9)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:38.606348 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43995dad-47f8-436a-b5c3-433a9007df6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:38.606890 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43995dad-47f8-436a-b5c3-433a9007df6f service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:38.607175 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43995dad-47f8-436a-b5c3-433a9007df6f service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:38.608018 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43995dad-47f8-436a-b5c3-433a9007df6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:38.609150 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f717786-e348-4ad8-aa52-66a87ed67cf4 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:38.629095 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 811/1619] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:29:38 2022] PUT /identity/v3/projects/2b550483f333457fa32c4987be88ef2e/users/72a3c7c50e28410691d2a6fc28c1b9dd/roles/5b702713e40145b49e0b42abd0a5fba9 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:29:38.630576 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d725bcd6-3aef-49d8-bbd7-4d9f5b037f37 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:38.631106 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d725bcd6-3aef-49d8-bbd7-4d9f5b037f37 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:38.631106 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d725bcd6-3aef-49d8-bbd7-4d9f5b037f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:38.636478 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43995dad-47f8-436a-b5c3-433a9007df6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:38.639319 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43995dad-47f8-436a-b5c3-433a9007df6f service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:38.663448 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 809/1620] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:29:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:29:38.664576 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43995dad-47f8-436a-b5c3-433a9007df6f service neutron] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:38.676568 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43995dad-47f8-436a-b5c3-433a9007df6f service neutron] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:38.721921 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-d725bcd6-3aef-49d8-bbd7-4d9f5b037f37 None None] MFA Rules not processed for user `6cd6136036bd467c946cae90d5c29263`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:29:38.725259 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-d725bcd6-3aef-49d8-bbd7-4d9f5b037f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:29:38.800506 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5af2195-0ae9-4af3-9cf0-fb64d4f2c4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:38.801186 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5af2195-0ae9-4af3-9cf0-fb64d4f2c4c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:38.801630 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5af2195-0ae9-4af3-9cf0-fb64d4f2c4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:38.801761 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5af2195-0ae9-4af3-9cf0-fb64d4f2c4c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:38.802370 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5af2195-0ae9-4af3-9cf0-fb64d4f2c4c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:38.804489 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5af2195-0ae9-4af3-9cf0-fb64d4f2c4c6 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:38.840907 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 810/1621] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:29:38 2022] POST /identity/v3/projects => generated 365 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:29:38.840907 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5af2195-0ae9-4af3-9cf0-fb64d4f2c4c6 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:38.892226 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 812/1622] 10.222.0.16 () {58 vars in 1059 bytes} [Sun Sep 11 05:29:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:29:38.898084 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba79216-0bb9-4912-ad84-0e69faffa2f0 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:38.898588 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba79216-0bb9-4912-ad84-0e69faffa2f0 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:38.900585 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba79216-0bb9-4912-ad84-0e69faffa2f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:38.913315 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5af2195-0ae9-4af3-9cf0-fb64d4f2c4c6 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:38.918250 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6bb8fe-0825-4440-b549-df6c04d31bb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:38.919133 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6bb8fe-0825-4440-b549-df6c04d31bb9 service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:38.919133 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6bb8fe-0825-4440-b549-df6c04d31bb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:38.919493 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6bb8fe-0825-4440-b549-df6c04d31bb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:38.963795 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-aba79216-0bb9-4912-ad84-0e69faffa2f0 None None] MFA Rules not processed for user `6cd6136036bd467c946cae90d5c29263`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:29:38.967369 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-aba79216-0bb9-4912-ad84-0e69faffa2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:29:38.971609 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:29:39.001131 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6bb8fe-0825-4440-b549-df6c04d31bb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:39.002749 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6bb8fe-0825-4440-b549-df6c04d31bb9 service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:39.017443 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 811/1623] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:29:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:29:39.018395 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6bb8fe-0825-4440-b549-df6c04d31bb9 service neutron] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:39.033310 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6bb8fe-0825-4440-b549-df6c04d31bb9 service neutron] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:39.038635 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684facf4-eff8-4525-b574-cb9b1a1bc118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:39.039837 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684facf4-eff8-4525-b574-cb9b1a1bc118 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:39.040118 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684facf4-eff8-4525-b574-cb9b1a1bc118 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:39.040397 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684facf4-eff8-4525-b574-cb9b1a1bc118 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:39.041059 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684facf4-eff8-4525-b574-cb9b1a1bc118 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:39.043587 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684facf4-eff8-4525-b574-cb9b1a1bc118 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:39.070072 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 812/1624] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:29:39 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:29:39.072638 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684facf4-eff8-4525-b574-cb9b1a1bc118 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:39.098154 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684facf4-eff8-4525-b574-cb9b1a1bc118 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:39.109379 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20bf0ff-bb38-477b-b5ed-2a220b918314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:39.110023 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20bf0ff-bb38-477b-b5ed-2a220b918314 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:39.112938 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20bf0ff-bb38-477b-b5ed-2a220b918314 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:39.113386 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20bf0ff-bb38-477b-b5ed-2a220b918314 admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:39.114084 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20bf0ff-bb38-477b-b5ed-2a220b918314 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:39.118930 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20bf0ff-bb38-477b-b5ed-2a220b918314 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:39.150355 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 813/1625] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:29:39 2022] POST /identity/v3/users => generated 289 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:29:39.151959 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20bf0ff-bb38-477b-b5ed-2a220b918314 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:39.156375 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 813/1626] 10.222.0.16 () {58 vars in 1059 bytes} [Sun Sep 11 05:29:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:29:39.159246 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba79216-0bb9-4912-ad84-0e69faffa2f0 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:39.172136 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20bf0ff-bb38-477b-b5ed-2a220b918314 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:39.179584 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba79216-0bb9-4912-ad84-0e69faffa2f0 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:39.182615 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cede574f-1145-48ca-97af-1a9af8146cbe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cd6136036bd467c946cae90d5c29263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:39.184050 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede574f-1145-48ca-97af-1a9af8146cbe service nova] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:39.184540 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede574f-1145-48ca-97af-1a9af8146cbe service nova] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:39.184911 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee41816-d6a8-4c61-832d-ccac37d44ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:39.185365 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede574f-1145-48ca-97af-1a9af8146cbe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:39.186159 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee41816-d6a8-4c61-832d-ccac37d44ab5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:39.186444 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee41816-d6a8-4c61-832d-ccac37d44ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:39.186724 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee41816-d6a8-4c61-832d-ccac37d44ab5 admin admin] PATH_INFO: `/v3/projects/2b550483f333457fa32c4987be88ef2e/users/72a3c7c50e28410691d2a6fc28c1b9dd/roles/5b702713e40145b49e0b42abd0a5fba9` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:39.193949 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee41816-d6a8-4c61-832d-ccac37d44ab5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b550483f333457fa32c4987be88ef2e, user_id=72a3c7c50e28410691d2a6fc28c1b9dd, role_id=5b702713e40145b49e0b42abd0a5fba9)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:39.198573 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee41816-d6a8-4c61-832d-ccac37d44ab5 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:39.211469 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 814/1627] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:29:39 2022] PUT /identity/v3/projects/2b550483f333457fa32c4987be88ef2e/users/72a3c7c50e28410691d2a6fc28c1b9dd/roles/5b702713e40145b49e0b42abd0a5fba9 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:29:39.212488 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee41816-d6a8-4c61-832d-ccac37d44ab5 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:39.253202 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:29:39.393002 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cede574f-1145-48ca-97af-1a9af8146cbe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:39.393002 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cede574f-1145-48ca-97af-1a9af8146cbe service nova] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:39.393002 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 814/1628] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:29:39 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:29:39.393002 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cede574f-1145-48ca-97af-1a9af8146cbe service nova] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:39.393002 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cede574f-1145-48ca-97af-1a9af8146cbe service nova] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:39.402505 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee41816-d6a8-4c61-832d-ccac37d44ab5 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:39.414929 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a0634-a26a-4e9c-956f-2de2281640fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cd6136036bd467c946cae90d5c29263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:39.416771 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a0634-a26a-4e9c-956f-2de2281640fa service nova] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:39.417333 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a0634-a26a-4e9c-956f-2de2281640fa service nova] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:39.418361 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a0634-a26a-4e9c-956f-2de2281640fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:39.528698 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e27cf12-889b-4673-996d-0d42a2fa17e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:39.529985 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27cf12-889b-4673-996d-0d42a2fa17e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:39.530269 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27cf12-889b-4673-996d-0d42a2fa17e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:39.530548 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27cf12-889b-4673-996d-0d42a2fa17e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:39.532310 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e27cf12-889b-4673-996d-0d42a2fa17e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:39.536479 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e27cf12-889b-4673-996d-0d42a2fa17e8 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:39.570256 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 815/1629] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:29:39 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:29:39.572639 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29137fe-bf6a-4a36-8ef4-03fd7a9ed7fb None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:39.572931 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29137fe-bf6a-4a36-8ef4-03fd7a9ed7fb None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:39.573208 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29137fe-bf6a-4a36-8ef4-03fd7a9ed7fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:39.578873 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76a0634-a26a-4e9c-956f-2de2281640fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:39.584063 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76a0634-a26a-4e9c-956f-2de2281640fa service nova] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:39.610158 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 815/1630] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:29:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:29:39.612416 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a0634-a26a-4e9c-956f-2de2281640fa service nova] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:39.637659 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a0634-a26a-4e9c-956f-2de2281640fa service nova] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:39.643020 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481bfe9b-96d6-4157-b993-3f6ee6f6e76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:39.643927 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481bfe9b-96d6-4157-b993-3f6ee6f6e76f admin admin] REQUEST_METHOD: `PUT` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:39.644475 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481bfe9b-96d6-4157-b993-3f6ee6f6e76f admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:39.644907 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481bfe9b-96d6-4157-b993-3f6ee6f6e76f admin admin] PATH_INFO: `/v3/projects/61bfd0dc5d884147aea841ca5ba0489d/users/cd765f37d0f842d49f87485c75bdd499/roles/5b702713e40145b49e0b42abd0a5fba9` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:39.663815 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481bfe9b-96d6-4157-b993-3f6ee6f6e76f admin admin] RBAC: Authorizing `identity:create_grant(project_id=61bfd0dc5d884147aea841ca5ba0489d, user_id=cd765f37d0f842d49f87485c75bdd499, role_id=5b702713e40145b49e0b42abd0a5fba9)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:39.667193 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481bfe9b-96d6-4157-b993-3f6ee6f6e76f admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:39.669445 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-a29137fe-bf6a-4a36-8ef4-03fd7a9ed7fb None None] MFA Rules not processed for user `72a3c7c50e28410691d2a6fc28c1b9dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:29:39.673537 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-a29137fe-bf6a-4a36-8ef4-03fd7a9ed7fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:29:39.691257 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 816/1631] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:29:39 2022] PUT /identity/v3/projects/61bfd0dc5d884147aea841ca5ba0489d/users/cd765f37d0f842d49f87485c75bdd499/roles/5b702713e40145b49e0b42abd0a5fba9 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:29:39.695463 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252dc727-aad3-431c-b954-5e2df112f01f None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:39.695971 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252dc727-aad3-431c-b954-5e2df112f01f None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:39.696434 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252dc727-aad3-431c-b954-5e2df112f01f None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:39.700398 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 817/1632] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 11 05:29:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:29:39.702475 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252dc727-aad3-431c-b954-5e2df112f01f None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:39.734842 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:29:39.807272 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 816/1633] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:29:39 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:29:39.807272 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c92cfcd-2f53-407a-a86e-0de6df705b1d None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:39.807272 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c92cfcd-2f53-407a-a86e-0de6df705b1d None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:39.807272 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c92cfcd-2f53-407a-a86e-0de6df705b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:39.819170 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252dc727-aad3-431c-b954-5e2df112f01f None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:39.825733 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacc7a29-bb12-4c9f-a2f3-4c773c73d14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:39.827085 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc7a29-bb12-4c9f-a2f3-4c773c73d14e admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:39.827499 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc7a29-bb12-4c9f-a2f3-4c773c73d14e admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:39.828000 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc7a29-bb12-4c9f-a2f3-4c773c73d14e admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:39.828743 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacc7a29-bb12-4c9f-a2f3-4c773c73d14e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:39.829794 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-2c92cfcd-2f53-407a-a86e-0de6df705b1d None None] MFA Rules not processed for user `6cd6136036bd467c946cae90d5c29263`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:29:39.831091 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-2c92cfcd-2f53-407a-a86e-0de6df705b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:29:39.831332 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacc7a29-bb12-4c9f-a2f3-4c773c73d14e admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:39.854418 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 818/1634] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:29:39 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:29:39.855503 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacc7a29-bb12-4c9f-a2f3-4c773c73d14e admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:39.917486 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:29:39.951748 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 817/1635] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 05:29:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:29:39.954553 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c92cfcd-2f53-407a-a86e-0de6df705b1d None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:39.961541 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacc7a29-bb12-4c9f-a2f3-4c773c73d14e admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:39.971413 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e781d32f-31a5-4732-9317-690a25d76792 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a147e14b61d481db1cac02c58ac3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:39.972499 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e781d32f-31a5-4732-9317-690a25d76792 service cinder] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:39.972898 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e781d32f-31a5-4732-9317-690a25d76792 service cinder] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:39.973808 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c92cfcd-2f53-407a-a86e-0de6df705b1d None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:39.974339 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e781d32f-31a5-4732-9317-690a25d76792 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:39.980840 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bc9172-71c2-4553-abe4-5c141b8abceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:39.982118 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc9172-71c2-4553-abe4-5c141b8abceb admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:39.983382 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc9172-71c2-4553-abe4-5c141b8abceb admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:39.983994 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc9172-71c2-4553-abe4-5c141b8abceb admin admin] PATH_INFO: `/v3/projects/61bfd0dc5d884147aea841ca5ba0489d/users/cd765f37d0f842d49f87485c75bdd499/roles/5b702713e40145b49e0b42abd0a5fba9` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:39.986964 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bc9172-71c2-4553-abe4-5c141b8abceb admin admin] RBAC: Authorizing `identity:create_grant(project_id=61bfd0dc5d884147aea841ca5ba0489d, user_id=cd765f37d0f842d49f87485c75bdd499, role_id=5b702713e40145b49e0b42abd0a5fba9)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:39.991073 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bc9172-71c2-4553-abe4-5c141b8abceb admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:40.008307 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 818/1636] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:29:39 2022] PUT /identity/v3/projects/61bfd0dc5d884147aea841ca5ba0489d/users/cd765f37d0f842d49f87485c75bdd499/roles/5b702713e40145b49e0b42abd0a5fba9 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:29:40.009569 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bc9172-71c2-4553-abe4-5c141b8abceb admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:40.160756 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bc9172-71c2-4553-abe4-5c141b8abceb admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:40.163314 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e781d32f-31a5-4732-9317-690a25d76792 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:40.164859 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e781d32f-31a5-4732-9317-690a25d76792 service cinder] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:40.173216 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607019f6-b854-485b-b52c-b7938d75857f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a147e14b61d481db1cac02c58ac3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:40.174040 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607019f6-b854-485b-b52c-b7938d75857f service cinder] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:40.174326 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607019f6-b854-485b-b52c-b7938d75857f service cinder] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:40.174593 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607019f6-b854-485b-b52c-b7938d75857f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:40.191161 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 819/1637] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:29:39 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:29:40.192994 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db781a2-096d-4438-891d-439e84a29714 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:40.193282 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db781a2-096d-4438-891d-439e84a29714 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:40.193564 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db781a2-096d-4438-891d-439e84a29714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:40.271321 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-9db781a2-096d-4438-891d-439e84a29714 None None] MFA Rules not processed for user `cd765f37d0f842d49f87485c75bdd499`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:29:40.273967 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-9db781a2-096d-4438-891d-439e84a29714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:29:40.326178 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:29:40.366532 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607019f6-b854-485b-b52c-b7938d75857f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:40.368218 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607019f6-b854-485b-b52c-b7938d75857f service cinder] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:40.408650 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 819/1638] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:29:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:29:40.413168 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d177b51-e42b-4591-a0c2-3d76afdfb000 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:40.413734 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d177b51-e42b-4591-a0c2-3d76afdfb000 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:40.414411 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d177b51-e42b-4591-a0c2-3d76afdfb000 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:40.419757 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 820/1639] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 11 05:29:40 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:29:40.425350 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6056efff-584f-432c-8abc-fae36c820ca7 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:40.425928 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6056efff-584f-432c-8abc-fae36c820ca7 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:40.426751 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6056efff-584f-432c-8abc-fae36c820ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:40.465748 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-6056efff-584f-432c-8abc-fae36c820ca7 None None] MFA Rules not processed for user `6cd6136036bd467c946cae90d5c29263`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:29:40.469269 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 820/1640] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:29:40 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:29:40.471300 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-6056efff-584f-432c-8abc-fae36c820ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:29:40.508229 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db781a2-096d-4438-891d-439e84a29714 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:40.512020 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 821/1641] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 05:29:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:29:40.526689 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db781a2-096d-4438-891d-439e84a29714 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:40.538758 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf760ab-0d1e-4230-bad4-e2881785228b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a147e14b61d481db1cac02c58ac3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:40.539395 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf760ab-0d1e-4230-bad4-e2881785228b service cinder] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:40.539706 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf760ab-0d1e-4230-bad4-e2881785228b service cinder] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:40.540109 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf760ab-0d1e-4230-bad4-e2881785228b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:40.563064 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf760ab-0d1e-4230-bad4-e2881785228b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:40.564989 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf760ab-0d1e-4230-bad4-e2881785228b service cinder] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:40.588427 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 821/1642] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:29:40 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 05:29:40.798652 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6056efff-584f-432c-8abc-fae36c820ca7 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:40.809463 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6056efff-584f-432c-8abc-fae36c820ca7 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:40.819284 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65fe665-9e32-4345-9523-960a35d16d05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a147e14b61d481db1cac02c58ac3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:40.819952 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65fe665-9e32-4345-9523-960a35d16d05 service cinder] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:40.820230 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65fe665-9e32-4345-9523-960a35d16d05 service cinder] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:40.820496 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65fe665-9e32-4345-9523-960a35d16d05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:40.844061 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65fe665-9e32-4345-9523-960a35d16d05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:40.845532 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65fe665-9e32-4345-9523-960a35d16d05 service cinder] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:40.869295 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 822/1643] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:29:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:29:41.704265 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf760ab-0d1e-4230-bad4-e2881785228b service cinder] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:41.718414 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf760ab-0d1e-4230-bad4-e2881785228b service cinder] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:41.733957 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3627202-3d69-47a6-9bc3-c4bc3ef7e866 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a147e14b61d481db1cac02c58ac3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:41.739494 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3627202-3d69-47a6-9bc3-c4bc3ef7e866 service cinder] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:41.744622 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3627202-3d69-47a6-9bc3-c4bc3ef7e866 service cinder] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:41.760360 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3627202-3d69-47a6-9bc3-c4bc3ef7e866 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:42.001538 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:29:42.006676 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3627202-3d69-47a6-9bc3-c4bc3ef7e866 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:42.012649 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3627202-3d69-47a6-9bc3-c4bc3ef7e866 service cinder] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:42.042889 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 822/1644] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:29:41 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:29:44.753087 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65fe665-9e32-4345-9523-960a35d16d05 service cinder] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:44.968973 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65fe665-9e32-4345-9523-960a35d16d05 service cinder] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:44.986164 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f167368b-7be7-48ce-a306-692ae08636fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:44.986976 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167368b-7be7-48ce-a306-692ae08636fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:44.987333 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167368b-7be7-48ce-a306-692ae08636fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:44.987744 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167368b-7be7-48ce-a306-692ae08636fd admin admin] PATH_INFO: `/v3/users/0b33626d0fd04806a99b1c40acff4ac7` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:44.989144 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f167368b-7be7-48ce-a306-692ae08636fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b33626d0fd04806a99b1c40acff4ac7)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:44.991581 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f167368b-7be7-48ce-a306-692ae08636fd admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:45.153929 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-f167368b-7be7-48ce-a306-692ae08636fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b33626d0fd04806a99b1c40acff4ac7'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:29:45.186278 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-f167368b-7be7-48ce-a306-692ae08636fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b33626d0fd04806a99b1c40acff4ac7'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:29:45.204623 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-f167368b-7be7-48ce-a306-692ae08636fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b33626d0fd04806a99b1c40acff4ac7'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:29:45.229957 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-f167368b-7be7-48ce-a306-692ae08636fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b33626d0fd04806a99b1c40acff4ac7'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:29:45.231151 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-f167368b-7be7-48ce-a306-692ae08636fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b33626d0fd04806a99b1c40acff4ac7'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:29:45.241486 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 823/1645] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:29:44 2022] DELETE /identity/v3/users/0b33626d0fd04806a99b1c40acff4ac7 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:29:45.246139 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d69fc3b-473c-4665-a076-f56f674c520d None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:45.246619 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d69fc3b-473c-4665-a076-f56f674c520d None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:45.247033 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d69fc3b-473c-4665-a076-f56f674c520d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:45.304303 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-1d69fc3b-473c-4665-a076-f56f674c520d None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:29:45.312019 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-1d69fc3b-473c-4665-a076-f56f674c520d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:29:45.520350 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 823/1646] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:29:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:29:45.588833 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f167368b-7be7-48ce-a306-692ae08636fd admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:45.598414 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-f167368b-7be7-48ce-a306-692ae08636fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:29:45.773535 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:29:45.787978 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f167368b-7be7-48ce-a306-692ae08636fd admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:45.798814 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f3a441-ebf7-4378-a7f9-8de4c7a022f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:45.799476 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f3a441-ebf7-4378-a7f9-8de4c7a022f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:45.804375 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f3a441-ebf7-4378-a7f9-8de4c7a022f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:45.804886 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f3a441-ebf7-4378-a7f9-8de4c7a022f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:45.836915 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f3a441-ebf7-4378-a7f9-8de4c7a022f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:45.838581 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f3a441-ebf7-4378-a7f9-8de4c7a022f2 service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:45.853546 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 824/1647] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:29:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:29:46.171243 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d69fc3b-473c-4665-a076-f56f674c520d None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:46.175334 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-1d69fc3b-473c-4665-a076-f56f674c520d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:29:46.202157 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d69fc3b-473c-4665-a076-f56f674c520d None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:46.228869 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab87e8e9-e2e4-40b2-8003-68741593be0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:46.229633 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab87e8e9-e2e4-40b2-8003-68741593be0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:46.229926 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab87e8e9-e2e4-40b2-8003-68741593be0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:46.230197 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab87e8e9-e2e4-40b2-8003-68741593be0e admin admin] PATH_INFO: `/v3/users/a31f229e622c4898b73410bab27af40c` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:46.232701 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab87e8e9-e2e4-40b2-8003-68741593be0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a31f229e622c4898b73410bab27af40c)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:46.233533 dv-cinder-856921-1-smb devstack@keystone.service[81383]: WARNING py.warnings [None req-ab87e8e9-e2e4-40b2-8003-68741593be0e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 05:29:46.233533 dv-cinder-856921-1-smb devstack@keystone.service[81383]: warnings.warn(msg) Sep 11 05:29:46.233533 dv-cinder-856921-1-smb devstack@keystone.service[81383]: Sep 11 05:29:46.234864 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab87e8e9-e2e4-40b2-8003-68741593be0e admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:46.408918 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-ab87e8e9-e2e4-40b2-8003-68741593be0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a31f229e622c4898b73410bab27af40c'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:29:46.469467 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-ab87e8e9-e2e4-40b2-8003-68741593be0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a31f229e622c4898b73410bab27af40c'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:29:46.504775 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-ab87e8e9-e2e4-40b2-8003-68741593be0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a31f229e622c4898b73410bab27af40c'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:29:46.527849 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-ab87e8e9-e2e4-40b2-8003-68741593be0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a31f229e622c4898b73410bab27af40c'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:29:46.529955 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-ab87e8e9-e2e4-40b2-8003-68741593be0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a31f229e622c4898b73410bab27af40c'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:29:46.551999 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1376ff6d-b2fc-4bc3-9a44-c075385f870b None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:46.552290 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1376ff6d-b2fc-4bc3-9a44-c075385f870b None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:46.552584 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1376ff6d-b2fc-4bc3-9a44-c075385f870b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:46.555274 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 824/1648] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:29:46 2022] DELETE /identity/v3/users/a31f229e622c4898b73410bab27af40c => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:29:46.596776 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-1376ff6d-b2fc-4bc3-9a44-c075385f870b None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:29:46.600454 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-1376ff6d-b2fc-4bc3-9a44-c075385f870b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:29:46.866313 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab87e8e9-e2e4-40b2-8003-68741593be0e admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:46.867954 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-ab87e8e9-e2e4-40b2-8003-68741593be0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:29:46.874811 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 825/1649] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:29:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:29:46.915639 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab87e8e9-e2e4-40b2-8003-68741593be0e admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:46.931404 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc9615f-e6ec-4452-9575-e7367fb911a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:46.932104 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc9615f-e6ec-4452-9575-e7367fb911a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:46.932392 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc9615f-e6ec-4452-9575-e7367fb911a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:46.932667 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc9615f-e6ec-4452-9575-e7367fb911a9 admin admin] PATH_INFO: `/v3/users/c6acfbf2b06e4e14ab37cf34732d86b5` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:46.933885 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc9615f-e6ec-4452-9575-e7367fb911a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6acfbf2b06e4e14ab37cf34732d86b5)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:46.936431 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc9615f-e6ec-4452-9575-e7367fb911a9 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:46.999133 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1376ff6d-b2fc-4bc3-9a44-c075385f870b None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:47.001472 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-1376ff6d-b2fc-4bc3-9a44-c075385f870b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:29:47.040411 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-3cc9615f-e6ec-4452-9575-e7367fb911a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6acfbf2b06e4e14ab37cf34732d86b5'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:29:47.057556 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:29:47.059238 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-3cc9615f-e6ec-4452-9575-e7367fb911a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6acfbf2b06e4e14ab37cf34732d86b5'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:29:47.076698 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-3cc9615f-e6ec-4452-9575-e7367fb911a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6acfbf2b06e4e14ab37cf34732d86b5'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:29:47.097562 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-3cc9615f-e6ec-4452-9575-e7367fb911a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6acfbf2b06e4e14ab37cf34732d86b5'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:29:47.098698 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-3cc9615f-e6ec-4452-9575-e7367fb911a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6acfbf2b06e4e14ab37cf34732d86b5'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:29:47.106244 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 825/1650] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:29:46 2022] DELETE /identity/v3/users/c6acfbf2b06e4e14ab37cf34732d86b5 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:29:47.111781 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b77042-1644-432a-8585-9b98da0f40a5 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:47.112076 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b77042-1644-432a-8585-9b98da0f40a5 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:47.112353 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b77042-1644-432a-8585-9b98da0f40a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:47.156070 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1376ff6d-b2fc-4bc3-9a44-c075385f870b None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:47.157046 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-a0b77042-1644-432a-8585-9b98da0f40a5 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:29:47.158493 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-a0b77042-1644-432a-8585-9b98da0f40a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:29:47.296567 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363fadf6-c53a-4727-927c-d48028421a33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:47.297463 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363fadf6-c53a-4727-927c-d48028421a33 service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:47.298012 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363fadf6-c53a-4727-927c-d48028421a33 service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:47.298433 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363fadf6-c53a-4727-927c-d48028421a33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:47.300462 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-363fadf6-c53a-4727-927c-d48028421a33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:29:47.354764 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 826/1651] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:29:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:29:47.448609 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b77042-1644-432a-8585-9b98da0f40a5 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:47.451479 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-a0b77042-1644-432a-8585-9b98da0f40a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:29:47.474403 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b77042-1644-432a-8585-9b98da0f40a5 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:47.496524 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853fbc5b-f9df-41d2-944b-0a2e84e72d3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:47.497285 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853fbc5b-f9df-41d2-944b-0a2e84e72d3b service neutron] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:47.499022 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853fbc5b-f9df-41d2-944b-0a2e84e72d3b service neutron] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:47.499522 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853fbc5b-f9df-41d2-944b-0a2e84e72d3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:47.533461 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853fbc5b-f9df-41d2-944b-0a2e84e72d3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:47.535305 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853fbc5b-f9df-41d2-944b-0a2e84e72d3b service neutron] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:47.564084 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 827/1652] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:29:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 05:29:47.578062 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363fadf6-c53a-4727-927c-d48028421a33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:47.580077 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363fadf6-c53a-4727-927c-d48028421a33 service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:47.593737 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:29:47.611012 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 826/1653] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:29:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 612 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:29:48.256402 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8ce3d4-cdc8-4235-a4ac-9e13378c52bd None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:48.256861 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8ce3d4-cdc8-4235-a4ac-9e13378c52bd None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:48.257263 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8ce3d4-cdc8-4235-a4ac-9e13378c52bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:48.334654 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-1e8ce3d4-cdc8-4235-a4ac-9e13378c52bd None None] MFA Rules not processed for user `72ae9b828c41476ca9414cd26163d384`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:29:48.336763 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-1e8ce3d4-cdc8-4235-a4ac-9e13378c52bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:29:48.583401 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 828/1654] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:29:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:29:48.598894 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363fadf6-c53a-4727-927c-d48028421a33 service neutron] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:48.601956 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-363fadf6-c53a-4727-927c-d48028421a33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:29:48.781404 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8ce3d4-cdc8-4235-a4ac-9e13378c52bd None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:48.782845 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-1e8ce3d4-cdc8-4235-a4ac-9e13378c52bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:29:48.783199 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363fadf6-c53a-4727-927c-d48028421a33 service neutron] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:48.802267 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb6400d-8f42-477e-9c05-da29e39e4148 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cd6136036bd467c946cae90d5c29263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:48.803870 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb6400d-8f42-477e-9c05-da29e39e4148 service nova] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:48.804518 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb6400d-8f42-477e-9c05-da29e39e4148 service nova] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:48.805522 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb6400d-8f42-477e-9c05-da29e39e4148 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:48.825653 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb6400d-8f42-477e-9c05-da29e39e4148 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:48.832153 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb6400d-8f42-477e-9c05-da29e39e4148 service nova] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:48.837635 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8ce3d4-cdc8-4235-a4ac-9e13378c52bd None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:48.853184 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55aa2da-7600-49a3-8e3c-bf59023509db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:48.853606 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55aa2da-7600-49a3-8e3c-bf59023509db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:48.853890 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55aa2da-7600-49a3-8e3c-bf59023509db admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:48.854163 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55aa2da-7600-49a3-8e3c-bf59023509db admin admin] PATH_INFO: `/v3/projects/8ff34ddc3d494ea5a30ed08c11879fc2` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:48.855506 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55aa2da-7600-49a3-8e3c-bf59023509db admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ff34ddc3d494ea5a30ed08c11879fc2)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:48.858771 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55aa2da-7600-49a3-8e3c-bf59023509db admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:48.858917 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 827/1655] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:29:48 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:29:48.993528 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-d55aa2da-7600-49a3-8e3c-bf59023509db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ff34ddc3d494ea5a30ed08c11879fc2', 'request_id': 'req-d55aa2da-7600-49a3-8e3c-bf59023509db'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:29:48.999908 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:29:49.010524 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-d55aa2da-7600-49a3-8e3c-bf59023509db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ff34ddc3d494ea5a30ed08c11879fc2', 'request_id': 'req-d55aa2da-7600-49a3-8e3c-bf59023509db'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:29:49.025297 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-d55aa2da-7600-49a3-8e3c-bf59023509db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ff34ddc3d494ea5a30ed08c11879fc2', 'request_id': 'req-d55aa2da-7600-49a3-8e3c-bf59023509db'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:29:49.056887 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb6400d-8f42-477e-9c05-da29e39e4148 service nova] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:49.059072 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-adb6400d-8f42-477e-9c05-da29e39e4148 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:29:49.096830 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb6400d-8f42-477e-9c05-da29e39e4148 service nova] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:49.098815 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-d55aa2da-7600-49a3-8e3c-bf59023509db admin admin] The token cache is being invalidate because project 8ff34ddc3d494ea5a30ed08c11879fc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81383) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:29:49.104346 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-d55aa2da-7600-49a3-8e3c-bf59023509db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:29:49.105004 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-d55aa2da-7600-49a3-8e3c-bf59023509db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:29:49.124132 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 829/1656] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:29:48 2022] DELETE /identity/v3/projects/8ff34ddc3d494ea5a30ed08c11879fc2 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 05:29:49.128687 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac6ba9-a98b-41fb-aaa0-642998679e71 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:49.128975 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac6ba9-a98b-41fb-aaa0-642998679e71 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:49.129252 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac6ba9-a98b-41fb-aaa0-642998679e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:49.178489 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-74ac6ba9-a98b-41fb-aaa0-642998679e71 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:29:49.182370 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-74ac6ba9-a98b-41fb-aaa0-642998679e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:29:49.300754 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de6d656-2c4d-4c11-9dea-756f76821f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:49.301417 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de6d656-2c4d-4c11-9dea-756f76821f23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:49.301703 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de6d656-2c4d-4c11-9dea-756f76821f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:49.301980 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de6d656-2c4d-4c11-9dea-756f76821f23 admin admin] PATH_INFO: `/v3/projects/e9fc3c31ce704cffb7c2e80c1f29e185` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:49.311409 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de6d656-2c4d-4c11-9dea-756f76821f23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9fc3c31ce704cffb7c2e80c1f29e185)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:49.312517 dv-cinder-856921-1-smb devstack@keystone.service[81384]: WARNING py.warnings [None req-6de6d656-2c4d-4c11-9dea-756f76821f23 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 05:29:49.312517 dv-cinder-856921-1-smb devstack@keystone.service[81384]: warnings.warn(msg) Sep 11 05:29:49.312517 dv-cinder-856921-1-smb devstack@keystone.service[81384]: Sep 11 05:29:49.313814 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de6d656-2c4d-4c11-9dea-756f76821f23 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:49.349846 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 830/1657] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:29:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:29:49.352381 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ac6ba9-a98b-41fb-aaa0-642998679e71 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:49.366443 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-74ac6ba9-a98b-41fb-aaa0-642998679e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:29:49.403511 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ac6ba9-a98b-41fb-aaa0-642998679e71 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:49.434812 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-6de6d656-2c4d-4c11-9dea-756f76821f23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9fc3c31ce704cffb7c2e80c1f29e185', 'request_id': 'req-6de6d656-2c4d-4c11-9dea-756f76821f23'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:29:49.464073 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-6de6d656-2c4d-4c11-9dea-756f76821f23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9fc3c31ce704cffb7c2e80c1f29e185', 'request_id': 'req-6de6d656-2c4d-4c11-9dea-756f76821f23'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:29:49.485127 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-6de6d656-2c4d-4c11-9dea-756f76821f23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9fc3c31ce704cffb7c2e80c1f29e185', 'request_id': 'req-6de6d656-2c4d-4c11-9dea-756f76821f23'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:29:49.507879 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-6de6d656-2c4d-4c11-9dea-756f76821f23 admin admin] The token cache is being invalidate because project e9fc3c31ce704cffb7c2e80c1f29e185 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:29:49.508391 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-6de6d656-2c4d-4c11-9dea-756f76821f23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:29:49.509250 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-6de6d656-2c4d-4c11-9dea-756f76821f23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:29:49.515204 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 828/1658] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:29:49 2022] DELETE /identity/v3/projects/e9fc3c31ce704cffb7c2e80c1f29e185 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 05:29:49.517110 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3e648a-5503-4bcf-9ccc-1a6864a4c760 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:49.517779 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3e648a-5503-4bcf-9ccc-1a6864a4c760 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:49.518278 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3e648a-5503-4bcf-9ccc-1a6864a4c760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:49.543609 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-7e3e648a-5503-4bcf-9ccc-1a6864a4c760 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:29:49.545372 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-7e3e648a-5503-4bcf-9ccc-1a6864a4c760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:29:49.555949 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:29:49.565854 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b35c9eb-9491-4f7e-9c7f-3978df306f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:49.566534 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b35c9eb-9491-4f7e-9c7f-3978df306f12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:49.566812 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b35c9eb-9491-4f7e-9c7f-3978df306f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:49.567086 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b35c9eb-9491-4f7e-9c7f-3978df306f12 admin admin] PATH_INFO: `/v3/projects/56650a2edf6c440092f885e1470eb8d1` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:49.570849 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b35c9eb-9491-4f7e-9c7f-3978df306f12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56650a2edf6c440092f885e1470eb8d1)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:49.577375 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b35c9eb-9491-4f7e-9c7f-3978df306f12 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:49.679798 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 829/1659] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:29:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:29:49.682187 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e1e04a-e4c1-425f-97b0-1c0ced071105 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:49.686422 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e1e04a-e4c1-425f-97b0-1c0ced071105 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:49.686854 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e1e04a-e4c1-425f-97b0-1c0ced071105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:49.741499 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-59e1e04a-e4c1-425f-97b0-1c0ced071105 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:29:49.742873 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-59e1e04a-e4c1-425f-97b0-1c0ced071105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:29:49.761069 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-9b35c9eb-9491-4f7e-9c7f-3978df306f12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56650a2edf6c440092f885e1470eb8d1', 'request_id': 'req-9b35c9eb-9491-4f7e-9c7f-3978df306f12'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:29:49.779266 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-9b35c9eb-9491-4f7e-9c7f-3978df306f12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56650a2edf6c440092f885e1470eb8d1', 'request_id': 'req-9b35c9eb-9491-4f7e-9c7f-3978df306f12'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:29:49.795888 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-9b35c9eb-9491-4f7e-9c7f-3978df306f12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56650a2edf6c440092f885e1470eb8d1', 'request_id': 'req-9b35c9eb-9491-4f7e-9c7f-3978df306f12'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:29:49.823718 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-9b35c9eb-9491-4f7e-9c7f-3978df306f12 admin admin] The token cache is being invalidate because project 56650a2edf6c440092f885e1470eb8d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81383) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:29:49.824026 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-9b35c9eb-9491-4f7e-9c7f-3978df306f12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:29:49.827528 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-9b35c9eb-9491-4f7e-9c7f-3978df306f12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:29:49.831710 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 831/1660] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:29:49 2022] DELETE /identity/v3/projects/56650a2edf6c440092f885e1470eb8d1 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:29:49.835301 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b35c9eb-9491-4f7e-9c7f-3978df306f12 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:49.840501 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-9b35c9eb-9491-4f7e-9c7f-3978df306f12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:29:49.866810 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:29:49.900782 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 830/1661] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:29:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:29:49.910902 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e1e04a-e4c1-425f-97b0-1c0ced071105 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:49.917229 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-59e1e04a-e4c1-425f-97b0-1c0ced071105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:29:49.943090 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e1e04a-e4c1-425f-97b0-1c0ced071105 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:49.963969 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd420084-f914-4f32-b278-781549033fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:49.968891 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd420084-f914-4f32-b278-781549033fc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:49.969259 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd420084-f914-4f32-b278-781549033fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:49.970824 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd420084-f914-4f32-b278-781549033fc2 admin admin] PATH_INFO: `/v3/users/72a3c7c50e28410691d2a6fc28c1b9dd` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:49.973574 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd420084-f914-4f32-b278-781549033fc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72a3c7c50e28410691d2a6fc28c1b9dd)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:49.984141 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd420084-f914-4f32-b278-781549033fc2 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:50.022068 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b35c9eb-9491-4f7e-9c7f-3978df306f12 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:50.039717 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f55bf8-edc7-4fdb-ae24-c425f7085963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:50.043313 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f55bf8-edc7-4fdb-ae24-c425f7085963 admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:50.046890 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f55bf8-edc7-4fdb-ae24-c425f7085963 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:50.050935 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f55bf8-edc7-4fdb-ae24-c425f7085963 admin admin] PATH_INFO: `/v3/domains` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:50.054696 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f55bf8-edc7-4fdb-ae24-c425f7085963 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:29:50.056442 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f55bf8-edc7-4fdb-ae24-c425f7085963 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:50.061851 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f55bf8-edc7-4fdb-ae24-c425f7085963 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:50.097198 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 832/1662] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 05:29:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:29:50.099752 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f2cb4-ad63-4ab6-ae6f-73a03e31254a None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:50.100047 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f2cb4-ad63-4ab6-ae6f-73a03e31254a None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:50.103770 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f2cb4-ad63-4ab6-ae6f-73a03e31254a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:50.113476 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-bd420084-f914-4f32-b278-781549033fc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72a3c7c50e28410691d2a6fc28c1b9dd'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:29:50.157217 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-bd420084-f914-4f32-b278-781549033fc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72a3c7c50e28410691d2a6fc28c1b9dd'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:29:50.165437 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-d57f2cb4-ad63-4ab6-ae6f-73a03e31254a None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:29:50.170898 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-d57f2cb4-ad63-4ab6-ae6f-73a03e31254a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:29:50.180358 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-bd420084-f914-4f32-b278-781549033fc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72a3c7c50e28410691d2a6fc28c1b9dd'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:29:50.199503 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 833/1663] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:29:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:29:50.201837 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57f2cb4-ad63-4ab6-ae6f-73a03e31254a None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:50.203101 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-bd420084-f914-4f32-b278-781549033fc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72a3c7c50e28410691d2a6fc28c1b9dd'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:29:50.203850 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-bd420084-f914-4f32-b278-781549033fc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72a3c7c50e28410691d2a6fc28c1b9dd'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:29:50.221795 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 831/1664] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:29:49 2022] DELETE /identity/v3/users/72a3c7c50e28410691d2a6fc28c1b9dd => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:29:50.222785 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd420084-f914-4f32-b278-781549033fc2 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:50.227722 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57f2cb4-ad63-4ab6-ae6f-73a03e31254a None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:50.228374 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-bd420084-f914-4f32-b278-781549033fc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:29:50.326573 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:29:50.371846 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f75d5fe-b2e6-4dac-983b-67e4c09ced61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:50.373876 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f75d5fe-b2e6-4dac-983b-67e4c09ced61 admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:50.374170 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f75d5fe-b2e6-4dac-983b-67e4c09ced61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:50.376642 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f75d5fe-b2e6-4dac-983b-67e4c09ced61 admin admin] PATH_INFO: `/v3/projects` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:50.377843 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f75d5fe-b2e6-4dac-983b-67e4c09ced61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:50.383467 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f75d5fe-b2e6-4dac-983b-67e4c09ced61 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:50.417818 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd420084-f914-4f32-b278-781549033fc2 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:50.433163 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b151bf8-fc1b-4829-8a21-d532462702a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:50.434128 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b151bf8-fc1b-4829-8a21-d532462702a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:50.437636 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b151bf8-fc1b-4829-8a21-d532462702a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:50.438168 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b151bf8-fc1b-4829-8a21-d532462702a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:50.442792 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b151bf8-fc1b-4829-8a21-d532462702a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:29:50.443459 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b151bf8-fc1b-4829-8a21-d532462702a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:50.445288 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 834/1665] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:29:50 2022] POST /identity/v3/projects => generated 403 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:29:50.447172 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b151bf8-fc1b-4829-8a21-d532462702a3 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:50.452681 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f75d5fe-b2e6-4dac-983b-67e4c09ced61 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:50.456670 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-5f75d5fe-b2e6-4dac-983b-67e4c09ced61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:29:50.474571 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 832/1666] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 05:29:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:29:50.479519 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b151bf8-fc1b-4829-8a21-d532462702a3 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:50.501882 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b151bf8-fc1b-4829-8a21-d532462702a3 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:50.600457 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f75d5fe-b2e6-4dac-983b-67e4c09ced61 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:50.613859 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279317d4-e8b3-4c66-9b02-d5939eef7fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:50.613859 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279317d4-e8b3-4c66-9b02-d5939eef7fe3 admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:50.614593 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2577d1-e50b-4031-9419-b796b1dba32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:50.615622 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279317d4-e8b3-4c66-9b02-d5939eef7fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:50.615924 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279317d4-e8b3-4c66-9b02-d5939eef7fe3 admin admin] PATH_INFO: `/v3/users` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:50.616579 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279317d4-e8b3-4c66-9b02-d5939eef7fe3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:50.618548 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279317d4-e8b3-4c66-9b02-d5939eef7fe3 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:50.619994 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2577d1-e50b-4031-9419-b796b1dba32d admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:50.620312 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2577d1-e50b-4031-9419-b796b1dba32d admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:50.620594 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2577d1-e50b-4031-9419-b796b1dba32d admin admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:50.621385 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2577d1-e50b-4031-9419-b796b1dba32d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:50.625778 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2577d1-e50b-4031-9419-b796b1dba32d admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:50.669792 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 835/1667] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:29:50 2022] POST /identity/v3/users => generated 302 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:29:50.671825 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279317d4-e8b3-4c66-9b02-d5939eef7fe3 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:50.692063 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 833/1668] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:29:50 2022] POST /identity/v3/projects => generated 377 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 05:29:50.694862 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2577d1-e50b-4031-9419-b796b1dba32d admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:50.696872 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279317d4-e8b3-4c66-9b02-d5939eef7fe3 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:50.723006 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:29:50.843324 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc34d2e2-d86d-46f7-8c91-5ef340ee9d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:50.844790 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc34d2e2-d86d-46f7-8c91-5ef340ee9d93 admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:50.845226 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc34d2e2-d86d-46f7-8c91-5ef340ee9d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:50.845643 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc34d2e2-d86d-46f7-8c91-5ef340ee9d93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:50.846459 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc34d2e2-d86d-46f7-8c91-5ef340ee9d93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:50.850574 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc34d2e2-d86d-46f7-8c91-5ef340ee9d93 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:50.878757 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2577d1-e50b-4031-9419-b796b1dba32d admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:50.890786 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 836/1669] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:29:50 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 05:29:50.891954 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc34d2e2-d86d-46f7-8c91-5ef340ee9d93 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:50.895238 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2ea6de-ce16-4850-b55f-4685912bcd71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:50.895915 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ea6de-ce16-4850-b55f-4685912bcd71 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:50.896202 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ea6de-ce16-4850-b55f-4685912bcd71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:50.896471 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ea6de-ce16-4850-b55f-4685912bcd71 admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:50.897111 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2ea6de-ce16-4850-b55f-4685912bcd71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:50.903543 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2ea6de-ce16-4850-b55f-4685912bcd71 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:50.915158 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc34d2e2-d86d-46f7-8c91-5ef340ee9d93 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:50.940519 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501f2a5f-3118-4792-8857-763b32351256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:50.942708 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f2a5f-3118-4792-8857-763b32351256 admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:50.943335 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f2a5f-3118-4792-8857-763b32351256 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:50.944091 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f2a5f-3118-4792-8857-763b32351256 admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:50.945569 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501f2a5f-3118-4792-8857-763b32351256 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:50.948308 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501f2a5f-3118-4792-8857-763b32351256 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:50.954790 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 834/1670] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:29:50 2022] POST /identity/v3/users => generated 289 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:29:50.959003 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2ea6de-ce16-4850-b55f-4685912bcd71 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:50.974152 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 837/1671] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:29:50 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:29:50.978038 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501f2a5f-3118-4792-8857-763b32351256 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:50.985877 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2ea6de-ce16-4850-b55f-4685912bcd71 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:50.992492 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501f2a5f-3118-4792-8857-763b32351256 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:51.001788 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce8ba01-6e65-42b4-bf7c-ff4e2b41c745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:51.002433 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce8ba01-6e65-42b4-bf7c-ff4e2b41c745 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:51.003025 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce8ba01-6e65-42b4-bf7c-ff4e2b41c745 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:51.003025 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce8ba01-6e65-42b4-bf7c-ff4e2b41c745 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:51.003616 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce8ba01-6e65-42b4-bf7c-ff4e2b41c745 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:51.005405 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce8ba01-6e65-42b4-bf7c-ff4e2b41c745 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:51.014442 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca2f87a-fa71-4ca5-b659-2410faed2b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:51.017219 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2f87a-fa71-4ca5-b659-2410faed2b59 admin admin] REQUEST_METHOD: `PUT` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:51.017670 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2f87a-fa71-4ca5-b659-2410faed2b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:51.018107 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2f87a-fa71-4ca5-b659-2410faed2b59 admin admin] PATH_INFO: `/v3/projects/0a2220665a7645cca4b167a732a5da34/users/d9af828f280445418f1462561b2081e1/roles/aa7ff8e0ec1e48e5811335b9eb38b448` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:51.063834 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca2f87a-fa71-4ca5-b659-2410faed2b59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a2220665a7645cca4b167a732a5da34, user_id=d9af828f280445418f1462561b2081e1, role_id=aa7ff8e0ec1e48e5811335b9eb38b448)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:51.065597 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 835/1672] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:29:50 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:29:51.070864 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca2f87a-fa71-4ca5-b659-2410faed2b59 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:51.082305 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce8ba01-6e65-42b4-bf7c-ff4e2b41c745 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:51.129353 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 838/1673] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:29:50 2022] PUT /identity/v3/projects/0a2220665a7645cca4b167a732a5da34/users/d9af828f280445418f1462561b2081e1/roles/aa7ff8e0ec1e48e5811335b9eb38b448 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 05:29:51.134031 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557a6a78-8e6e-443e-8bf8-f0316b890fb8 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:51.135785 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce8ba01-6e65-42b4-bf7c-ff4e2b41c745 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:51.137426 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557a6a78-8e6e-443e-8bf8-f0316b890fb8 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:51.137905 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557a6a78-8e6e-443e-8bf8-f0316b890fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:51.164997 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:29:51.207815 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-557a6a78-8e6e-443e-8bf8-f0316b890fb8 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:29:51.209474 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-557a6a78-8e6e-443e-8bf8-f0316b890fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:29:51.223673 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4840ad36-7a3e-493e-b422-670569063190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:51.226072 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4840ad36-7a3e-493e-b422-670569063190 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:51.226759 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4840ad36-7a3e-493e-b422-670569063190 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:51.227901 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4840ad36-7a3e-493e-b422-670569063190 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:51.229013 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4840ad36-7a3e-493e-b422-670569063190 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:51.232491 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4840ad36-7a3e-493e-b422-670569063190 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:51.278214 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 836/1674] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:29:51 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:29:51.279302 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4840ad36-7a3e-493e-b422-670569063190 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:51.300301 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4840ad36-7a3e-493e-b422-670569063190 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:51.314719 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371a7f5e-7e69-4a47-9a1c-8fcf26122500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:51.315557 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a7f5e-7e69-4a47-9a1c-8fcf26122500 admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:51.316257 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a7f5e-7e69-4a47-9a1c-8fcf26122500 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:51.316624 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a7f5e-7e69-4a47-9a1c-8fcf26122500 admin admin] PATH_INFO: `/v3/projects/ac143326d2f946ae9fb6b64d06ef6b7e/users/99329dd81c044f4fb6ad025325f18f73/roles/aa7ff8e0ec1e48e5811335b9eb38b448` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:51.353994 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371a7f5e-7e69-4a47-9a1c-8fcf26122500 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac143326d2f946ae9fb6b64d06ef6b7e, user_id=99329dd81c044f4fb6ad025325f18f73, role_id=aa7ff8e0ec1e48e5811335b9eb38b448)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:51.357499 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371a7f5e-7e69-4a47-9a1c-8fcf26122500 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:51.391774 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 837/1675] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:29:51 2022] PUT /identity/v3/projects/ac143326d2f946ae9fb6b64d06ef6b7e/users/99329dd81c044f4fb6ad025325f18f73/roles/aa7ff8e0ec1e48e5811335b9eb38b448 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:29:51.406184 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87141763-15be-4a31-915a-233ca7414ae7 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:51.406568 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87141763-15be-4a31-915a-233ca7414ae7 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:51.406915 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87141763-15be-4a31-915a-233ca7414ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:51.420004 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 839/1676] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:29:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:29:51.461447 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557a6a78-8e6e-443e-8bf8-f0316b890fb8 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:51.462982 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-557a6a78-8e6e-443e-8bf8-f0316b890fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:29:51.484631 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557a6a78-8e6e-443e-8bf8-f0316b890fb8 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:51.489007 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-87141763-15be-4a31-915a-233ca7414ae7 None None] MFA Rules not processed for user `99329dd81c044f4fb6ad025325f18f73`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:29:51.492912 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-87141763-15be-4a31-915a-233ca7414ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:29:51.606505 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce626f7-cdfd-4d47-a0b1-530468e15ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:51.608328 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce626f7-cdfd-4d47-a0b1-530468e15ef7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:51.609320 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce626f7-cdfd-4d47-a0b1-530468e15ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:51.610668 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce626f7-cdfd-4d47-a0b1-530468e15ef7 admin admin] PATH_INFO: `/v3/users/252a604d65904fd6bb0c3e47c9941bd7` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:51.613715 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce626f7-cdfd-4d47-a0b1-530468e15ef7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=252a604d65904fd6bb0c3e47c9941bd7)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:51.617475 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce626f7-cdfd-4d47-a0b1-530468e15ef7 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:51.639416 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 838/1677] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:29:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 05:29:51.644850 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87141763-15be-4a31-915a-233ca7414ae7 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:51.664656 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:29:51.674400 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87141763-15be-4a31-915a-233ca7414ae7 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:51.686678 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa2d306-964e-4cec-951e-98b02ff91af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:51.687061 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2d306-964e-4cec-951e-98b02ff91af4 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:51.687441 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2d306-964e-4cec-951e-98b02ff91af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:51.688010 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2d306-964e-4cec-951e-98b02ff91af4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:51.689368 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa2d306-964e-4cec-951e-98b02ff91af4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:51.692282 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa2d306-964e-4cec-951e-98b02ff91af4 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:51.719115 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-fce626f7-cdfd-4d47-a0b1-530468e15ef7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '252a604d65904fd6bb0c3e47c9941bd7'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:29:51.734944 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 839/1678] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:29:51 2022] POST /identity/v3/projects => generated 379 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:29:51.736651 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa2d306-964e-4cec-951e-98b02ff91af4 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:51.764515 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-fce626f7-cdfd-4d47-a0b1-530468e15ef7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '252a604d65904fd6bb0c3e47c9941bd7'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:29:51.779713 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-fce626f7-cdfd-4d47-a0b1-530468e15ef7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '252a604d65904fd6bb0c3e47c9941bd7'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:29:51.795415 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-fce626f7-cdfd-4d47-a0b1-530468e15ef7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '252a604d65904fd6bb0c3e47c9941bd7'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:29:51.796679 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-fce626f7-cdfd-4d47-a0b1-530468e15ef7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '252a604d65904fd6bb0c3e47c9941bd7'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:29:51.814417 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 840/1679] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:29:51 2022] DELETE /identity/v3/users/252a604d65904fd6bb0c3e47c9941bd7 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:29:51.815631 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce626f7-cdfd-4d47-a0b1-530468e15ef7 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:51.819049 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-fce626f7-cdfd-4d47-a0b1-530468e15ef7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:29:51.861930 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa2d306-964e-4cec-951e-98b02ff91af4 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:51.874527 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:29:51.955636 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce626f7-cdfd-4d47-a0b1-530468e15ef7 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:51.960969 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f38456-2c60-4a04-9b1d-36239d76c562 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:51.961730 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f38456-2c60-4a04-9b1d-36239d76c562 service neutron] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:51.962021 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f38456-2c60-4a04-9b1d-36239d76c562 service neutron] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:51.962292 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f38456-2c60-4a04-9b1d-36239d76c562 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:51.964188 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-63f38456-2c60-4a04-9b1d-36239d76c562 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:29:51.981045 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002b5921-fbd9-4746-9d76-13b9bf81fb9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:51.981672 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b5921-fbd9-4746-9d76-13b9bf81fb9a admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:51.982483 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b5921-fbd9-4746-9d76-13b9bf81fb9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:51.982756 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b5921-fbd9-4746-9d76-13b9bf81fb9a admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:51.983400 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002b5921-fbd9-4746-9d76-13b9bf81fb9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:51.985545 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002b5921-fbd9-4746-9d76-13b9bf81fb9a admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:52.035466 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 840/1680] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:29:51 2022] POST /identity/v3/users => generated 296 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:29:52.036823 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0778548e-a0aa-45ff-919d-a12e4e939a26 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:52.037113 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0778548e-a0aa-45ff-919d-a12e4e939a26 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:52.037387 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0778548e-a0aa-45ff-919d-a12e4e939a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:52.080157 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-0778548e-a0aa-45ff-919d-a12e4e939a26 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:29:52.081605 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-0778548e-a0aa-45ff-919d-a12e4e939a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:29:52.103848 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 841/1681] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:29:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:29:52.103848 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0778548e-a0aa-45ff-919d-a12e4e939a26 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:52.105108 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-0778548e-a0aa-45ff-919d-a12e4e939a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:29:52.133233 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0778548e-a0aa-45ff-919d-a12e4e939a26 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:52.142934 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eac1a2-e466-4124-b92a-6c58303a5f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:52.143834 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eac1a2-e466-4124-b92a-6c58303a5f29 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:52.144114 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eac1a2-e466-4124-b92a-6c58303a5f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:52.144386 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eac1a2-e466-4124-b92a-6c58303a5f29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:52.145038 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eac1a2-e466-4124-b92a-6c58303a5f29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:52.146308 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f38456-2c60-4a04-9b1d-36239d76c562 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:52.146663 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eac1a2-e466-4124-b92a-6c58303a5f29 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:52.162529 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f38456-2c60-4a04-9b1d-36239d76c562 service neutron] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:52.174831 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 842/1682] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:29:52 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:29:52.175742 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eac1a2-e466-4124-b92a-6c58303a5f29 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:52.179957 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-32eac1a2-e466-4124-b92a-6c58303a5f29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:29:52.196330 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 841/1683] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:29:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:29:52.198020 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f38456-2c60-4a04-9b1d-36239d76c562 service neutron] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:52.206553 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eac1a2-e466-4124-b92a-6c58303a5f29 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:52.211834 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f38456-2c60-4a04-9b1d-36239d76c562 service neutron] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:52.214743 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06af4d0-7430-4f37-89d5-0062cba35274 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:52.215390 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06af4d0-7430-4f37-89d5-0062cba35274 service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:52.215657 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06af4d0-7430-4f37-89d5-0062cba35274 service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:52.215947 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06af4d0-7430-4f37-89d5-0062cba35274 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:52.218541 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bf49c9-0d6c-4229-b9a7-713fc891818e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:52.219567 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf49c9-0d6c-4229-b9a7-713fc891818e admin admin] REQUEST_METHOD: `PUT` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:52.220028 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf49c9-0d6c-4229-b9a7-713fc891818e admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:52.220461 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf49c9-0d6c-4229-b9a7-713fc891818e admin admin] PATH_INFO: `/v3/projects/e86417b3eb804955abdd1a391342b786/users/60c204e93e2c4cdca339752b69377009/roles/5b702713e40145b49e0b42abd0a5fba9` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:52.240632 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06af4d0-7430-4f37-89d5-0062cba35274 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:52.242118 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06af4d0-7430-4f37-89d5-0062cba35274 service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:52.253838 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bf49c9-0d6c-4229-b9a7-713fc891818e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e86417b3eb804955abdd1a391342b786, user_id=60c204e93e2c4cdca339752b69377009, role_id=5b702713e40145b49e0b42abd0a5fba9)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:52.262102 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bf49c9-0d6c-4229-b9a7-713fc891818e admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:52.282343 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 843/1684] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:29:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:29:52.306388 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 842/1685] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:29:52 2022] PUT /identity/v3/projects/e86417b3eb804955abdd1a391342b786/users/60c204e93e2c4cdca339752b69377009/roles/5b702713e40145b49e0b42abd0a5fba9 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:29:52.307466 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06af4d0-7430-4f37-89d5-0062cba35274 service neutron] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:52.324214 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06af4d0-7430-4f37-89d5-0062cba35274 service neutron] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:52.524252 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebf3bf3-717e-42cd-9457-a9d8a5e6deaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:52.524927 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebf3bf3-717e-42cd-9457-a9d8a5e6deaf admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:52.525185 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebf3bf3-717e-42cd-9457-a9d8a5e6deaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:52.525463 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebf3bf3-717e-42cd-9457-a9d8a5e6deaf admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:52.526118 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebf3bf3-717e-42cd-9457-a9d8a5e6deaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:52.532369 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebf3bf3-717e-42cd-9457-a9d8a5e6deaf admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:52.559085 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 844/1686] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:29:52 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:29:52.560397 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bf49c9-0d6c-4229-b9a7-713fc891818e admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:52.574841 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bf49c9-0d6c-4229-b9a7-713fc891818e admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:52.592846 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce6f1ea-9218-43df-9896-cb8a68b369b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:52.593422 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce6f1ea-9218-43df-9896-cb8a68b369b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:52.593700 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce6f1ea-9218-43df-9896-cb8a68b369b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:52.593972 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce6f1ea-9218-43df-9896-cb8a68b369b1 admin admin] PATH_INFO: `/v3/projects/e86417b3eb804955abdd1a391342b786/users/60c204e93e2c4cdca339752b69377009/roles/5b702713e40145b49e0b42abd0a5fba9` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:52.596133 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce6f1ea-9218-43df-9896-cb8a68b369b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e86417b3eb804955abdd1a391342b786, user_id=60c204e93e2c4cdca339752b69377009, role_id=5b702713e40145b49e0b42abd0a5fba9)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:52.598821 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce6f1ea-9218-43df-9896-cb8a68b369b1 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:52.645336 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 843/1687] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:29:52 2022] PUT /identity/v3/projects/e86417b3eb804955abdd1a391342b786/users/60c204e93e2c4cdca339752b69377009/roles/5b702713e40145b49e0b42abd0a5fba9 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:29:52.649435 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d85ef-f300-4112-9742-e618ffd333f3 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:52.650210 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d85ef-f300-4112-9742-e618ffd333f3 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:52.651022 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d85ef-f300-4112-9742-e618ffd333f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:52.707182 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-c20d85ef-f300-4112-9742-e618ffd333f3 None None] MFA Rules not processed for user `60c204e93e2c4cdca339752b69377009`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:29:52.710524 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-c20d85ef-f300-4112-9742-e618ffd333f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:29:52.848337 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:29:52.906946 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 845/1688] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:29:52 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:29:52.921141 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce6f1ea-9218-43df-9896-cb8a68b369b1 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:52.922896 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-dce6f1ea-9218-43df-9896-cb8a68b369b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:29:52.945829 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:29:53.041703 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce6f1ea-9218-43df-9896-cb8a68b369b1 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:53.046850 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00054cb1-5127-4a19-a98c-8b65cea50c9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a147e14b61d481db1cac02c58ac3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:53.047888 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00054cb1-5127-4a19-a98c-8b65cea50c9d service cinder] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:53.048332 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00054cb1-5127-4a19-a98c-8b65cea50c9d service cinder] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:53.048776 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00054cb1-5127-4a19-a98c-8b65cea50c9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:53.070233 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00054cb1-5127-4a19-a98c-8b65cea50c9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:53.075823 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00054cb1-5127-4a19-a98c-8b65cea50c9d service cinder] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:53.110027 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 844/1689] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:29:52 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:29:53.239478 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20d85ef-f300-4112-9742-e618ffd333f3 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:53.259384 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20d85ef-f300-4112-9742-e618ffd333f3 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:53.263413 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e735b236-82de-428c-a180-972a63e74261 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a147e14b61d481db1cac02c58ac3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:53.263927 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e735b236-82de-428c-a180-972a63e74261 service cinder] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:53.264271 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e735b236-82de-428c-a180-972a63e74261 service cinder] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:53.264547 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e735b236-82de-428c-a180-972a63e74261 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:53.273329 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-e735b236-82de-428c-a180-972a63e74261 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:29:53.385966 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e735b236-82de-428c-a180-972a63e74261 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:53.387770 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e735b236-82de-428c-a180-972a63e74261 service cinder] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:53.403880 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 846/1690] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:29:53 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:29:53.482961 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea7a2a9-5a5b-4017-ae21-878272230f1b None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:53.483397 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea7a2a9-5a5b-4017-ae21-878272230f1b None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:53.483806 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea7a2a9-5a5b-4017-ae21-878272230f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:53.567805 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-7ea7a2a9-5a5b-4017-ae21-878272230f1b None None] MFA Rules not processed for user `2733ccb746fd454b8e53bf6ae162f38e`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:29:53.569722 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-7ea7a2a9-5a5b-4017-ae21-878272230f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:29:53.822709 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e735b236-82de-428c-a180-972a63e74261 service cinder] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:53.828423 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-e735b236-82de-428c-a180-972a63e74261 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:29:53.915150 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 845/1691] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:29:53 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 434 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:29:53.930792 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea7a2a9-5a5b-4017-ae21-878272230f1b None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:53.932531 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-7ea7a2a9-5a5b-4017-ae21-878272230f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:29:54.024720 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e735b236-82de-428c-a180-972a63e74261 service cinder] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:54.063557 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e0794d-79d0-45a3-bfcb-7cdece267c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:54.068896 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e0794d-79d0-45a3-bfcb-7cdece267c87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:54.071084 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e0794d-79d0-45a3-bfcb-7cdece267c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:54.075104 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e0794d-79d0-45a3-bfcb-7cdece267c87 admin admin] PATH_INFO: `/v3/projects/2b550483f333457fa32c4987be88ef2e` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:54.078805 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e0794d-79d0-45a3-bfcb-7cdece267c87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b550483f333457fa32c4987be88ef2e)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:54.083045 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e0794d-79d0-45a3-bfcb-7cdece267c87 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:54.164531 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea7a2a9-5a5b-4017-ae21-878272230f1b None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:54.188368 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde57348-413d-46b4-8aa5-48baef3955e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cd6136036bd467c946cae90d5c29263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:54.189629 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde57348-413d-46b4-8aa5-48baef3955e6 service nova] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:54.189907 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde57348-413d-46b4-8aa5-48baef3955e6 service nova] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:54.190661 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde57348-413d-46b4-8aa5-48baef3955e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:54.219788 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde57348-413d-46b4-8aa5-48baef3955e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:54.221633 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde57348-413d-46b4-8aa5-48baef3955e6 service nova] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:54.232427 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-92e0794d-79d0-45a3-bfcb-7cdece267c87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b550483f333457fa32c4987be88ef2e', 'request_id': 'req-92e0794d-79d0-45a3-bfcb-7cdece267c87'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:29:54.264228 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-92e0794d-79d0-45a3-bfcb-7cdece267c87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b550483f333457fa32c4987be88ef2e', 'request_id': 'req-92e0794d-79d0-45a3-bfcb-7cdece267c87'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:29:54.265115 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 846/1692] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:29:53 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:29:54.281968 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-92e0794d-79d0-45a3-bfcb-7cdece267c87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b550483f333457fa32c4987be88ef2e', 'request_id': 'req-92e0794d-79d0-45a3-bfcb-7cdece267c87'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:29:54.313958 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-92e0794d-79d0-45a3-bfcb-7cdece267c87 admin admin] The token cache is being invalidate because project 2b550483f333457fa32c4987be88ef2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:29:54.318622 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-92e0794d-79d0-45a3-bfcb-7cdece267c87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:29:54.319473 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-92e0794d-79d0-45a3-bfcb-7cdece267c87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:29:54.322116 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 847/1693] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:29:53 2022] DELETE /identity/v3/projects/2b550483f333457fa32c4987be88ef2e => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:29:54.327593 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc9babb-8fb4-4e9a-8978-4579694cd6ed None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:54.327877 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc9babb-8fb4-4e9a-8978-4579694cd6ed None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:54.328118 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc9babb-8fb4-4e9a-8978-4579694cd6ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:54.336584 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e0794d-79d0-45a3-bfcb-7cdece267c87 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:54.337985 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-92e0794d-79d0-45a3-bfcb-7cdece267c87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:29:54.380473 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-2bc9babb-8fb4-4e9a-8978-4579694cd6ed None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:29:54.383498 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-2bc9babb-8fb4-4e9a-8978-4579694cd6ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:29:54.393889 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:29:54.445467 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:29:54.546431 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e0794d-79d0-45a3-bfcb-7cdece267c87 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:54.565251 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d60b7a0-25a7-4f3b-a948-1428a2ff5c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:54.565640 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d60b7a0-25a7-4f3b-a948-1428a2ff5c22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:54.565904 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d60b7a0-25a7-4f3b-a948-1428a2ff5c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:54.566352 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d60b7a0-25a7-4f3b-a948-1428a2ff5c22 admin admin] PATH_INFO: `/v3/projects/7a56876ea9194df5ad3a2a84988f81fd` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:54.567838 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d60b7a0-25a7-4f3b-a948-1428a2ff5c22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a56876ea9194df5ad3a2a84988f81fd)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:54.570660 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 847/1694] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:29:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:29:54.577945 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120f5795-2788-4d9f-b6e6-162ad9d2cb69 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:54.578238 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120f5795-2788-4d9f-b6e6-162ad9d2cb69 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:54.578426 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d60b7a0-25a7-4f3b-a948-1428a2ff5c22 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:54.578571 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120f5795-2788-4d9f-b6e6-162ad9d2cb69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:54.651200 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-120f5795-2788-4d9f-b6e6-162ad9d2cb69 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:29:54.654733 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-120f5795-2788-4d9f-b6e6-162ad9d2cb69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:29:54.675121 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 848/1695] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:29:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:29:54.677824 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120f5795-2788-4d9f-b6e6-162ad9d2cb69 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:54.712173 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120f5795-2788-4d9f-b6e6-162ad9d2cb69 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:54.747897 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-2d60b7a0-25a7-4f3b-a948-1428a2ff5c22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a56876ea9194df5ad3a2a84988f81fd', 'request_id': 'req-2d60b7a0-25a7-4f3b-a948-1428a2ff5c22'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:29:54.770531 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-2d60b7a0-25a7-4f3b-a948-1428a2ff5c22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a56876ea9194df5ad3a2a84988f81fd', 'request_id': 'req-2d60b7a0-25a7-4f3b-a948-1428a2ff5c22'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:29:54.813853 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-2d60b7a0-25a7-4f3b-a948-1428a2ff5c22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a56876ea9194df5ad3a2a84988f81fd', 'request_id': 'req-2d60b7a0-25a7-4f3b-a948-1428a2ff5c22'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:29:54.855823 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-2d60b7a0-25a7-4f3b-a948-1428a2ff5c22 admin admin] The token cache is being invalidate because project 7a56876ea9194df5ad3a2a84988f81fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:29:54.859806 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-2d60b7a0-25a7-4f3b-a948-1428a2ff5c22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:29:54.860718 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-2d60b7a0-25a7-4f3b-a948-1428a2ff5c22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:29:54.871131 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 848/1696] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:29:54 2022] DELETE /identity/v3/projects/7a56876ea9194df5ad3a2a84988f81fd => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 05:29:54.872243 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d60b7a0-25a7-4f3b-a948-1428a2ff5c22 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:54.878286 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-2d60b7a0-25a7-4f3b-a948-1428a2ff5c22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:29:54.958904 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57ba29a-bf24-4d84-add0-0680e7b60872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:54.959553 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ba29a-bf24-4d84-add0-0680e7b60872 admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:54.966598 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ba29a-bf24-4d84-add0-0680e7b60872 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:54.966998 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ba29a-bf24-4d84-add0-0680e7b60872 admin admin] PATH_INFO: `/v3/domains` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:54.968956 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57ba29a-bf24-4d84-add0-0680e7b60872 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:29:54.969370 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57ba29a-bf24-4d84-add0-0680e7b60872 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:54.981105 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57ba29a-bf24-4d84-add0-0680e7b60872 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:55.022777 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 849/1697] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 05:29:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:29:55.027743 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57ba29a-bf24-4d84-add0-0680e7b60872 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:55.030271 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-b57ba29a-bf24-4d84-add0-0680e7b60872 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:29:55.061014 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57ba29a-bf24-4d84-add0-0680e7b60872 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:55.079000 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c714110b-da81-4908-8693-c0c5adeb6410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:55.079801 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c714110b-da81-4908-8693-c0c5adeb6410 admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:55.080080 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c714110b-da81-4908-8693-c0c5adeb6410 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:55.080379 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c714110b-da81-4908-8693-c0c5adeb6410 admin admin] PATH_INFO: `/v3/projects` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:55.081001 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c714110b-da81-4908-8693-c0c5adeb6410 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:55.083201 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c714110b-da81-4908-8693-c0c5adeb6410 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:55.129347 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d60b7a0-25a7-4f3b-a948-1428a2ff5c22 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:55.145694 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 850/1698] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:29:55 2022] POST /identity/v3/projects => generated 377 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:29:55.150521 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332d5521-0b8f-408f-a960-54d66e980b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:55.151442 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d5521-0b8f-408f-a960-54d66e980b29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:55.151772 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d5521-0b8f-408f-a960-54d66e980b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:55.152051 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d5521-0b8f-408f-a960-54d66e980b29 admin admin] PATH_INFO: `/v3/users/cd765f37d0f842d49f87485c75bdd499` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:55.152228 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c714110b-da81-4908-8693-c0c5adeb6410 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:55.153352 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332d5521-0b8f-408f-a960-54d66e980b29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd765f37d0f842d49f87485c75bdd499)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:55.156014 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332d5521-0b8f-408f-a960-54d66e980b29 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:55.277691 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-332d5521-0b8f-408f-a960-54d66e980b29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd765f37d0f842d49f87485c75bdd499'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:29:55.297536 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:29:55.326456 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c714110b-da81-4908-8693-c0c5adeb6410 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:55.331441 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-332d5521-0b8f-408f-a960-54d66e980b29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd765f37d0f842d49f87485c75bdd499'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:29:55.337096 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a256d1b-8d5b-4de2-912f-d7e6bc0161dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:55.337850 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a256d1b-8d5b-4de2-912f-d7e6bc0161dd admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:55.338085 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a256d1b-8d5b-4de2-912f-d7e6bc0161dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:55.338286 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a256d1b-8d5b-4de2-912f-d7e6bc0161dd admin admin] PATH_INFO: `/v3/users` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:55.338967 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a256d1b-8d5b-4de2-912f-d7e6bc0161dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:55.341568 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a256d1b-8d5b-4de2-912f-d7e6bc0161dd admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:55.352234 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-332d5521-0b8f-408f-a960-54d66e980b29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd765f37d0f842d49f87485c75bdd499'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:29:55.378970 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-332d5521-0b8f-408f-a960-54d66e980b29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd765f37d0f842d49f87485c75bdd499'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:29:55.379914 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-332d5521-0b8f-408f-a960-54d66e980b29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd765f37d0f842d49f87485c75bdd499'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:29:55.392947 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 851/1699] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:29:55 2022] POST /identity/v3/users => generated 289 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:29:55.396295 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e71a9a-6033-4fb8-b4a7-415f152a074a None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:55.396968 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e71a9a-6033-4fb8-b4a7-415f152a074a None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:55.396968 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e71a9a-6033-4fb8-b4a7-415f152a074a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:55.398500 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 849/1700] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:29:54 2022] DELETE /identity/v3/users/cd765f37d0f842d49f87485c75bdd499 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:29:55.399635 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332d5521-0b8f-408f-a960-54d66e980b29 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:55.404113 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-332d5521-0b8f-408f-a960-54d66e980b29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:29:55.476413 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-c8e71a9a-6033-4fb8-b4a7-415f152a074a None None] MFA Rules not processed for user `dae006738da54b26a64097de95bef254`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:29:55.484746 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-c8e71a9a-6033-4fb8-b4a7-415f152a074a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:29:55.512377 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:29:55.602893 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332d5521-0b8f-408f-a960-54d66e980b29 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:55.617258 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1323bc7-afd2-4f68-bc72-4085eef77174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:55.618084 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1323bc7-afd2-4f68-bc72-4085eef77174 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:55.618367 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1323bc7-afd2-4f68-bc72-4085eef77174 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:55.618916 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1323bc7-afd2-4f68-bc72-4085eef77174 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:55.619930 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1323bc7-afd2-4f68-bc72-4085eef77174 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:55.626523 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1323bc7-afd2-4f68-bc72-4085eef77174 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:55.658219 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 850/1701] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:29:55 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:29:55.659221 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1323bc7-afd2-4f68-bc72-4085eef77174 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:55.661554 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 852/1702] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:29:55 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:29:55.675498 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341a4e5-6423-42bf-b1dc-6af84d70ec32 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:55.676439 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341a4e5-6423-42bf-b1dc-6af84d70ec32 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:55.676728 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341a4e5-6423-42bf-b1dc-6af84d70ec32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:55.687312 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1323bc7-afd2-4f68-bc72-4085eef77174 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:55.701903 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a4065e-70fe-4c91-aa73-fff9d20e5243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:55.704185 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a4065e-70fe-4c91-aa73-fff9d20e5243 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:55.704386 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a4065e-70fe-4c91-aa73-fff9d20e5243 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:55.704664 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a4065e-70fe-4c91-aa73-fff9d20e5243 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:55.706484 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a4065e-70fe-4c91-aa73-fff9d20e5243 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:55.715795 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a4065e-70fe-4c91-aa73-fff9d20e5243 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:55.722750 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-3341a4e5-6423-42bf-b1dc-6af84d70ec32 None None] MFA Rules not processed for user `dae006738da54b26a64097de95bef254`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:29:55.723945 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-3341a4e5-6423-42bf-b1dc-6af84d70ec32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:29:55.744640 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 853/1703] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:29:55 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:29:55.761216 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3341a4e5-6423-42bf-b1dc-6af84d70ec32 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:55.763600 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-3341a4e5-6423-42bf-b1dc-6af84d70ec32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:29:55.794797 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 851/1704] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:29:55 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:29:55.804203 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a4065e-70fe-4c91-aa73-fff9d20e5243 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:55.851117 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a4065e-70fe-4c91-aa73-fff9d20e5243 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:55.875455 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08071574-0749-414a-89ed-f3ddcc574542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:55.877200 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08071574-0749-414a-89ed-f3ddcc574542 admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:55.881133 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08071574-0749-414a-89ed-f3ddcc574542 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:55.881797 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08071574-0749-414a-89ed-f3ddcc574542 admin admin] PATH_INFO: `/v3/projects/bbd0e9ddffc14e338730620073cdaab9/users/c405e9ed18014ef1b125f679614f4022/roles/aa7ff8e0ec1e48e5811335b9eb38b448` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:55.929046 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08071574-0749-414a-89ed-f3ddcc574542 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbd0e9ddffc14e338730620073cdaab9, user_id=c405e9ed18014ef1b125f679614f4022, role_id=aa7ff8e0ec1e48e5811335b9eb38b448)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:55.934520 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08071574-0749-414a-89ed-f3ddcc574542 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:55.991408 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 852/1705] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:29:55 2022] PUT /identity/v3/projects/bbd0e9ddffc14e338730620073cdaab9/users/c405e9ed18014ef1b125f679614f4022/roles/aa7ff8e0ec1e48e5811335b9eb38b448 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:29:55.993262 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2105dc-b2a8-49d5-a139-a32a15b2e64a None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:55.993715 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2105dc-b2a8-49d5-a139-a32a15b2e64a None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:55.994140 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2105dc-b2a8-49d5-a139-a32a15b2e64a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:55.995238 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3341a4e5-6423-42bf-b1dc-6af84d70ec32 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:56.038386 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-ec2105dc-b2a8-49d5-a139-a32a15b2e64a None None] MFA Rules not processed for user `c405e9ed18014ef1b125f679614f4022`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:29:56.039941 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-ec2105dc-b2a8-49d5-a139-a32a15b2e64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:29:56.134693 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cac264b-1cf6-4f97-bf48-cf3ddd17774d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cd6136036bd467c946cae90d5c29263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:56.136757 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac264b-1cf6-4f97-bf48-cf3ddd17774d service nova] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:56.137167 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac264b-1cf6-4f97-bf48-cf3ddd17774d service nova] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:56.137531 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac264b-1cf6-4f97-bf48-cf3ddd17774d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:56.212876 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 853/1706] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:29:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:29:56.229427 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2105dc-b2a8-49d5-a139-a32a15b2e64a None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:56.232108 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-ec2105dc-b2a8-49d5-a139-a32a15b2e64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:29:56.261590 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:29:56.302581 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:29:56.316113 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cac264b-1cf6-4f97-bf48-cf3ddd17774d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:56.317900 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cac264b-1cf6-4f97-bf48-cf3ddd17774d service nova] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:56.356234 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 854/1707] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:29:55 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 589 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 05:29:56.357327 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df32bd80-7de2-4422-8afb-dfde45acb20d None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:56.357616 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df32bd80-7de2-4422-8afb-dfde45acb20d None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:56.358559 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df32bd80-7de2-4422-8afb-dfde45acb20d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:56.422854 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-df32bd80-7de2-4422-8afb-dfde45acb20d None None] MFA Rules not processed for user `d9af828f280445418f1462561b2081e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:29:56.425808 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-df32bd80-7de2-4422-8afb-dfde45acb20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:29:56.464796 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2105dc-b2a8-49d5-a139-a32a15b2e64a None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:56.491011 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b86eba-2212-46ca-b9bd-e9a3b2286618 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdd09106382447e9bf8b3a6a9ada89b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:56.492019 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b86eba-2212-46ca-b9bd-e9a3b2286618 service glance] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:56.492019 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b86eba-2212-46ca-b9bd-e9a3b2286618 service glance] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:56.492311 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b86eba-2212-46ca-b9bd-e9a3b2286618 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:56.531917 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b86eba-2212-46ca-b9bd-e9a3b2286618 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:56.533406 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b86eba-2212-46ca-b9bd-e9a3b2286618 service glance] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:56.585021 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 854/1708] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:29:56 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:29:56.586366 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa97ae-8512-42ea-a458-f8eaefd6ea5f None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:56.586657 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa97ae-8512-42ea-a458-f8eaefd6ea5f None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:56.586934 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa97ae-8512-42ea-a458-f8eaefd6ea5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:56.597441 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 855/1709] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:29:56 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:29:56.603612 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df32bd80-7de2-4422-8afb-dfde45acb20d None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:56.610504 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-df32bd80-7de2-4422-8afb-dfde45acb20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:29:56.647712 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-07fa97ae-8512-42ea-a458-f8eaefd6ea5f None None] MFA Rules not processed for user `72ae9b828c41476ca9414cd26163d384`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:29:56.649017 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-07fa97ae-8512-42ea-a458-f8eaefd6ea5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:29:56.801481 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 855/1710] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:29:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:29:56.802568 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fa97ae-8512-42ea-a458-f8eaefd6ea5f None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:56.804396 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-07fa97ae-8512-42ea-a458-f8eaefd6ea5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:29:56.915159 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df32bd80-7de2-4422-8afb-dfde45acb20d None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:56.956956 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b7da9e-013b-4232-ab05-89d898e4aaad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:56.958179 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b7da9e-013b-4232-ab05-89d898e4aaad admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:56.958179 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b7da9e-013b-4232-ab05-89d898e4aaad admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:56.958372 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b7da9e-013b-4232-ab05-89d898e4aaad admin admin] PATH_INFO: `/v3/projects` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:56.959434 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b7da9e-013b-4232-ab05-89d898e4aaad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:56.960884 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b7da9e-013b-4232-ab05-89d898e4aaad admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:57.036457 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fa97ae-8512-42ea-a458-f8eaefd6ea5f None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:57.052436 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971a5f0c-dfee-4b2d-b32a-7670f1b78a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:57.054663 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a5f0c-dfee-4b2d-b32a-7670f1b78a67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:57.055089 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a5f0c-dfee-4b2d-b32a-7670f1b78a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:57.056085 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a5f0c-dfee-4b2d-b32a-7670f1b78a67 admin admin] PATH_INFO: `/v3/projects/61bfd0dc5d884147aea841ca5ba0489d` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:57.059122 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971a5f0c-dfee-4b2d-b32a-7670f1b78a67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61bfd0dc5d884147aea841ca5ba0489d)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:57.064724 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971a5f0c-dfee-4b2d-b32a-7670f1b78a67 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:57.107776 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 856/1711] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:29:56 2022] POST /identity/v3/projects => generated 403 bytes in 492 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:29:57.108847 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b7da9e-013b-4232-ab05-89d898e4aaad admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:57.229263 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-971a5f0c-dfee-4b2d-b32a-7670f1b78a67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61bfd0dc5d884147aea841ca5ba0489d', 'request_id': 'req-971a5f0c-dfee-4b2d-b32a-7670f1b78a67'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:29:57.232827 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:29:57.257963 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-971a5f0c-dfee-4b2d-b32a-7670f1b78a67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61bfd0dc5d884147aea841ca5ba0489d', 'request_id': 'req-971a5f0c-dfee-4b2d-b32a-7670f1b78a67'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:29:57.261820 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:29:57.283077 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-971a5f0c-dfee-4b2d-b32a-7670f1b78a67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61bfd0dc5d884147aea841ca5ba0489d', 'request_id': 'req-971a5f0c-dfee-4b2d-b32a-7670f1b78a67'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:29:57.302348 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b7da9e-013b-4232-ab05-89d898e4aaad admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:57.320416 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-971a5f0c-dfee-4b2d-b32a-7670f1b78a67 admin admin] The token cache is being invalidate because project 61bfd0dc5d884147aea841ca5ba0489d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:29:57.320965 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-971a5f0c-dfee-4b2d-b32a-7670f1b78a67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:29:57.338797 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-971a5f0c-dfee-4b2d-b32a-7670f1b78a67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:29:57.343838 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 856/1712] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:29:56 2022] DELETE /identity/v3/projects/61bfd0dc5d884147aea841ca5ba0489d => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:29:57.355503 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff2fe1-1659-456b-a23c-3aaf71429e95 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:57.356216 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff2fe1-1659-456b-a23c-3aaf71429e95 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:57.358644 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff2fe1-1659-456b-a23c-3aaf71429e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:57.430113 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-21ff2fe1-1659-456b-a23c-3aaf71429e95 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:29:57.431608 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-21ff2fe1-1659-456b-a23c-3aaf71429e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:29:57.500379 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e3a4d9-5db6-490c-9e8b-94315ee75051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:57.501032 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e3a4d9-5db6-490c-9e8b-94315ee75051 admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:57.501316 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e3a4d9-5db6-490c-9e8b-94315ee75051 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:57.501590 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e3a4d9-5db6-490c-9e8b-94315ee75051 admin admin] PATH_INFO: `/v3/users` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:57.502838 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e3a4d9-5db6-490c-9e8b-94315ee75051 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:57.504881 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e3a4d9-5db6-490c-9e8b-94315ee75051 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:57.565823 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 857/1713] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:29:57 2022] POST /identity/v3/users => generated 308 bytes in 455 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:29:57.576449 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3395ca98-fc39-4784-92ee-bf502b799199 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:57.576739 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3395ca98-fc39-4784-92ee-bf502b799199 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:57.577018 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3395ca98-fc39-4784-92ee-bf502b799199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:57.597157 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 857/1714] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:29:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:29:57.598390 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ff2fe1-1659-456b-a23c-3aaf71429e95 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:57.600705 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-21ff2fe1-1659-456b-a23c-3aaf71429e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:29:57.634273 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ff2fe1-1659-456b-a23c-3aaf71429e95 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:57.641757 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beb6e86-6a5a-45ab-b755-1e1ab6b787a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:57.644372 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beb6e86-6a5a-45ab-b755-1e1ab6b787a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:57.644724 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beb6e86-6a5a-45ab-b755-1e1ab6b787a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:57.645007 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beb6e86-6a5a-45ab-b755-1e1ab6b787a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:57.647256 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beb6e86-6a5a-45ab-b755-1e1ab6b787a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:57.654063 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beb6e86-6a5a-45ab-b755-1e1ab6b787a2 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:57.684429 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 858/1715] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:29:57 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:29:57.687134 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ae1fd-77f5-4a77-8cb2-8bbcdf4c0a06 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:57.687134 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ae1fd-77f5-4a77-8cb2-8bbcdf4c0a06 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:57.687552 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ae1fd-77f5-4a77-8cb2-8bbcdf4c0a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:57.712314 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-3395ca98-fc39-4784-92ee-bf502b799199 None None] MFA Rules not processed for user `87ebd7f813984d42aa137de7e1090757`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:29:57.715201 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-3395ca98-fc39-4784-92ee-bf502b799199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:29:57.717086 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-2f1ae1fd-77f5-4a77-8cb2-8bbcdf4c0a06 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:29:57.719022 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-2f1ae1fd-77f5-4a77-8cb2-8bbcdf4c0a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:29:57.730473 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 859/1716] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:29:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:29:57.731618 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1ae1fd-77f5-4a77-8cb2-8bbcdf4c0a06 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:57.746323 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1ae1fd-77f5-4a77-8cb2-8bbcdf4c0a06 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:57.755967 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a7c382-a0f0-40dd-8e59-806c3e696adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:57.756839 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a7c382-a0f0-40dd-8e59-806c3e696adc admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:57.757122 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a7c382-a0f0-40dd-8e59-806c3e696adc admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:57.757488 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a7c382-a0f0-40dd-8e59-806c3e696adc admin admin] PATH_INFO: `/v3/projects/9a9a55191e74486a8698e0c641915712/users/7dd6776038e649d89f189a42e116e859/roles/5b702713e40145b49e0b42abd0a5fba9` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:57.813512 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a7c382-a0f0-40dd-8e59-806c3e696adc admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a9a55191e74486a8698e0c641915712, user_id=7dd6776038e649d89f189a42e116e859, role_id=5b702713e40145b49e0b42abd0a5fba9)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:57.819144 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a7c382-a0f0-40dd-8e59-806c3e696adc admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:57.856010 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 860/1717] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:29:57 2022] PUT /identity/v3/projects/9a9a55191e74486a8698e0c641915712/users/7dd6776038e649d89f189a42e116e859/roles/5b702713e40145b49e0b42abd0a5fba9 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:29:57.859569 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a7c382-a0f0-40dd-8e59-806c3e696adc admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:57.909223 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 858/1718] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:29:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:29:57.910692 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3395ca98-fc39-4784-92ee-bf502b799199 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:57.933090 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3395ca98-fc39-4784-92ee-bf502b799199 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:58.025601 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a7c382-a0f0-40dd-8e59-806c3e696adc admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:58.036630 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc274d2d-e09e-4608-9607-b2062e6c6fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:58.039010 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc274d2d-e09e-4608-9607-b2062e6c6fb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:58.040115 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc274d2d-e09e-4608-9607-b2062e6c6fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:58.040793 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc274d2d-e09e-4608-9607-b2062e6c6fb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:58.042975 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc274d2d-e09e-4608-9607-b2062e6c6fb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:29:58.043361 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc274d2d-e09e-4608-9607-b2062e6c6fb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:58.051128 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc274d2d-e09e-4608-9607-b2062e6c6fb0 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:58.092354 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 861/1719] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 05:29:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:29:58.093590 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec95735-4d11-43ba-9def-ab7434e91285 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:58.094072 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec95735-4d11-43ba-9def-ab7434e91285 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:58.094420 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec95735-4d11-43ba-9def-ab7434e91285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:58.102447 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fe5dd6-e9f9-46dd-91e4-41d0b5a54250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:58.103153 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe5dd6-e9f9-46dd-91e4-41d0b5a54250 admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:58.103511 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe5dd6-e9f9-46dd-91e4-41d0b5a54250 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:58.103877 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe5dd6-e9f9-46dd-91e4-41d0b5a54250 admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:58.104601 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fe5dd6-e9f9-46dd-91e4-41d0b5a54250 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:58.108130 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fe5dd6-e9f9-46dd-91e4-41d0b5a54250 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:58.133159 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-5ec95735-4d11-43ba-9def-ab7434e91285 None None] MFA Rules not processed for user `87ebd7f813984d42aa137de7e1090757`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:29:58.134102 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 859/1720] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:29:57 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:29:58.135587 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c972ffb1-9108-4513-9329-62dea7c483e8 None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:58.136955 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-5ec95735-4d11-43ba-9def-ab7434e91285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:29:58.142710 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c972ffb1-9108-4513-9329-62dea7c483e8 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:58.143759 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c972ffb1-9108-4513-9329-62dea7c483e8 None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:58.149399 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 860/1721] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 11 05:29:58 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:29:58.150054 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c972ffb1-9108-4513-9329-62dea7c483e8 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:58.181517 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c972ffb1-9108-4513-9329-62dea7c483e8 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:58.191662 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0829b3-d0aa-4ccf-a19c-052b55653560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:58.192342 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0829b3-d0aa-4ccf-a19c-052b55653560 admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:58.192628 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0829b3-d0aa-4ccf-a19c-052b55653560 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:58.192902 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0829b3-d0aa-4ccf-a19c-052b55653560 admin admin] PATH_INFO: `/v3/projects` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:58.193556 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0829b3-d0aa-4ccf-a19c-052b55653560 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:58.195551 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0829b3-d0aa-4ccf-a19c-052b55653560 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:58.206106 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:29:58.236613 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:29:58.271616 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 861/1722] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:29:58 2022] POST /identity/v3/projects => generated 369 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:29:58.272755 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0829b3-d0aa-4ccf-a19c-052b55653560 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:58.298154 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 862/1723] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:29:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:29:58.299738 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11d0dc9-1a81-40c8-be80-9364cd63e71d None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:58.300017 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11d0dc9-1a81-40c8-be80-9364cd63e71d None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:58.300346 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11d0dc9-1a81-40c8-be80-9364cd63e71d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:58.371345 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-f11d0dc9-1a81-40c8-be80-9364cd63e71d None None] MFA Rules not processed for user `72086abb4e0547dc96d76a44886805ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:29:58.373329 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-f11d0dc9-1a81-40c8-be80-9364cd63e71d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:29:58.420031 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0829b3-d0aa-4ccf-a19c-052b55653560 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:58.437421 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bc89c0-f6de-45f1-a8f9-c172371c31d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:58.438124 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc89c0-f6de-45f1-a8f9-c172371c31d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:58.438410 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc89c0-f6de-45f1-a8f9-c172371c31d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:58.438690 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc89c0-f6de-45f1-a8f9-c172371c31d0 admin admin] PATH_INFO: `/v3/projects/9a9a55191e74486a8698e0c641915712/users/7dd6776038e649d89f189a42e116e859/roles/5b702713e40145b49e0b42abd0a5fba9` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:58.444368 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bc89c0-f6de-45f1-a8f9-c172371c31d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a9a55191e74486a8698e0c641915712, user_id=7dd6776038e649d89f189a42e116e859, role_id=5b702713e40145b49e0b42abd0a5fba9)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:58.446969 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bc89c0-f6de-45f1-a8f9-c172371c31d0 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:58.475935 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 862/1724] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:29:58 2022] PUT /identity/v3/projects/9a9a55191e74486a8698e0c641915712/users/7dd6776038e649d89f189a42e116e859/roles/5b702713e40145b49e0b42abd0a5fba9 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:29:58.475935 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bc89c0-f6de-45f1-a8f9-c172371c31d0 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:58.509290 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 863/1725] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 05:29:58 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:29:58.513639 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467b1792-a236-42f5-8443-17700129814e None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:58.514770 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467b1792-a236-42f5-8443-17700129814e None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:58.515876 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467b1792-a236-42f5-8443-17700129814e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:58.621718 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bc89c0-f6de-45f1-a8f9-c172371c31d0 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:58.645484 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-467b1792-a236-42f5-8443-17700129814e None None] MFA Rules not processed for user `62fffbcf330a4bc183d0885c175f5a90`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:29:58.647167 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d25de04-e911-4de3-b7c5-c7a9dba21b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:58.649857 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-467b1792-a236-42f5-8443-17700129814e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:29:58.650208 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d25de04-e911-4de3-b7c5-c7a9dba21b04 admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:58.651309 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d25de04-e911-4de3-b7c5-c7a9dba21b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:58.651595 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d25de04-e911-4de3-b7c5-c7a9dba21b04 admin admin] PATH_INFO: `/v3/users` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:58.652351 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d25de04-e911-4de3-b7c5-c7a9dba21b04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:58.657969 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d25de04-e911-4de3-b7c5-c7a9dba21b04 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:58.716248 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 863/1726] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:29:58 2022] POST /identity/v3/users => generated 285 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:29:58.717720 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69187ce0-7459-48fa-a2c6-d86d1276e91c None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:58.718124 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69187ce0-7459-48fa-a2c6-d86d1276e91c None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:58.718331 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69187ce0-7459-48fa-a2c6-d86d1276e91c None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:58.722344 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 864/1727] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 11 05:29:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:29:58.723149 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69187ce0-7459-48fa-a2c6-d86d1276e91c None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:58.726393 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-69187ce0-7459-48fa-a2c6-d86d1276e91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:29:58.820447 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 864/1728] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 05:29:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:29:58.844620 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467b1792-a236-42f5-8443-17700129814e None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:58.883260 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467b1792-a236-42f5-8443-17700129814e None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:58.899295 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e961125f-fa16-4e57-9935-aff0f0108d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:58.900151 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e961125f-fa16-4e57-9935-aff0f0108d1e admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:58.900606 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e961125f-fa16-4e57-9935-aff0f0108d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:58.901301 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e961125f-fa16-4e57-9935-aff0f0108d1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:58.902641 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e961125f-fa16-4e57-9935-aff0f0108d1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:58.915784 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e961125f-fa16-4e57-9935-aff0f0108d1e admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:58.941879 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 865/1729] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:29:58 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:29:58.942244 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69187ce0-7459-48fa-a2c6-d86d1276e91c None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:58.943315 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e9b0c5-2c04-4f84-8419-e28fd220f777 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:58.945875 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e9b0c5-2c04-4f84-8419-e28fd220f777 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:58.946171 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e9b0c5-2c04-4f84-8419-e28fd220f777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:58.952832 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba9b3df-af89-4261-891a-fe71afb38aad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:58.953572 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba9b3df-af89-4261-891a-fe71afb38aad service neutron] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:58.953716 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba9b3df-af89-4261-891a-fe71afb38aad service neutron] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:58.953989 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba9b3df-af89-4261-891a-fe71afb38aad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:59.008063 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-65e9b0c5-2c04-4f84-8419-e28fd220f777 None None] MFA Rules not processed for user `72086abb4e0547dc96d76a44886805ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:29:59.016055 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-65e9b0c5-2c04-4f84-8419-e28fd220f777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:29:59.020893 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba9b3df-af89-4261-891a-fe71afb38aad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:59.023488 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba9b3df-af89-4261-891a-fe71afb38aad service neutron] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:59.036508 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 866/1730] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 05:29:58 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:29:59.038298 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e9b0c5-2c04-4f84-8419-e28fd220f777 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:59.055646 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 865/1731] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:29:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:29:59.056839 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba9b3df-af89-4261-891a-fe71afb38aad service neutron] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:59.058368 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-1ba9b3df-af89-4261-891a-fe71afb38aad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:29:59.072801 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e9b0c5-2c04-4f84-8419-e28fd220f777 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:59.088504 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dd6219-ee81-4b88-94bf-e97a56f3c536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:59.088966 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dd6219-ee81-4b88-94bf-e97a56f3c536 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:59.089254 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dd6219-ee81-4b88-94bf-e97a56f3c536 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:59.089535 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dd6219-ee81-4b88-94bf-e97a56f3c536 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:59.093051 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dd6219-ee81-4b88-94bf-e97a56f3c536 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:59.100564 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dd6219-ee81-4b88-94bf-e97a56f3c536 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:59.106729 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba9b3df-af89-4261-891a-fe71afb38aad service neutron] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:59.118346 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91851ff5-a809-49f4-ae17-ee8fdb554093 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:59.121250 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91851ff5-a809-49f4-ae17-ee8fdb554093 service neutron] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:59.121590 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91851ff5-a809-49f4-ae17-ee8fdb554093 service neutron] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:59.121915 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91851ff5-a809-49f4-ae17-ee8fdb554093 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:59.134848 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 867/1732] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:29:59 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:29:59.136609 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dd6219-ee81-4b88-94bf-e97a56f3c536 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:59.155633 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91851ff5-a809-49f4-ae17-ee8fdb554093 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:59.163799 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91851ff5-a809-49f4-ae17-ee8fdb554093 service neutron] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:59.185613 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dd6219-ee81-4b88-94bf-e97a56f3c536 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:59.186809 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 866/1733] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:29:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:29:59.188350 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91851ff5-a809-49f4-ae17-ee8fdb554093 service neutron] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:59.193262 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-91851ff5-a809-49f4-ae17-ee8fdb554093 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:29:59.204790 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aa6f6d-2551-4bcf-b5a5-18370e2b095a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:59.205628 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa6f6d-2551-4bcf-b5a5-18370e2b095a admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:59.205916 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa6f6d-2551-4bcf-b5a5-18370e2b095a admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:59.206194 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa6f6d-2551-4bcf-b5a5-18370e2b095a admin admin] PATH_INFO: `/v3/projects/5249bd6756ca43ff91501f3f7a41c22c/users/0c2430d707674f00a088f6d72259d855/roles/aa7ff8e0ec1e48e5811335b9eb38b448` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:59.213684 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:29:59.239568 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:29:59.253403 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aa6f6d-2551-4bcf-b5a5-18370e2b095a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5249bd6756ca43ff91501f3f7a41c22c, user_id=0c2430d707674f00a088f6d72259d855, role_id=aa7ff8e0ec1e48e5811335b9eb38b448)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:59.258086 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aa6f6d-2551-4bcf-b5a5-18370e2b095a admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:59.336351 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 868/1734] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:29:59 2022] PUT /identity/v3/projects/5249bd6756ca43ff91501f3f7a41c22c/users/0c2430d707674f00a088f6d72259d855/roles/aa7ff8e0ec1e48e5811335b9eb38b448 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:29:59.338087 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78074a81-2303-42c7-b5a3-01f17fc38b26 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:59.338822 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78074a81-2303-42c7-b5a3-01f17fc38b26 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:59.339104 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78074a81-2303-42c7-b5a3-01f17fc38b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:59.393867 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-78074a81-2303-42c7-b5a3-01f17fc38b26 None None] MFA Rules not processed for user `0c2430d707674f00a088f6d72259d855`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:29:59.396710 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-78074a81-2303-42c7-b5a3-01f17fc38b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:29:59.541902 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91851ff5-a809-49f4-ae17-ee8fdb554093 service neutron] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:59.551910 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 869/1735] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:29:59 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 05:29:59.556011 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78074a81-2303-42c7-b5a3-01f17fc38b26 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:29:59.702482 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78074a81-2303-42c7-b5a3-01f17fc38b26 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:29:59.716336 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf89ce7b-acc4-4380-a5ed-b424dcf5080c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:59.718628 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf89ce7b-acc4-4380-a5ed-b424dcf5080c admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:59.719372 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf89ce7b-acc4-4380-a5ed-b424dcf5080c admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:59.719913 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf89ce7b-acc4-4380-a5ed-b424dcf5080c admin admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:59.723535 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf89ce7b-acc4-4380-a5ed-b424dcf5080c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:29:59.727202 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf89ce7b-acc4-4380-a5ed-b424dcf5080c admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:29:59.777980 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db39b9ad-70cc-43f2-a927-9cd6ee59a106 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bbe4555380345e485572d2da8b78be1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:29:59.782643 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db39b9ad-70cc-43f2-a927-9cd6ee59a106 service swift] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:29:59.784035 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db39b9ad-70cc-43f2-a927-9cd6ee59a106 service swift] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:29:59.786478 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db39b9ad-70cc-43f2-a927-9cd6ee59a106 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:29:59.804634 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 870/1736] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:29:59 2022] POST /identity/v3/projects => generated 365 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 05:29:59.807954 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf89ce7b-acc4-4380-a5ed-b424dcf5080c admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:00.043481 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db39b9ad-70cc-43f2-a927-9cd6ee59a106 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:00.053942 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf89ce7b-acc4-4380-a5ed-b424dcf5080c admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:00.054703 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db39b9ad-70cc-43f2-a927-9cd6ee59a106 service swift] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:00.093157 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60caf91-500b-4670-8fd8-9654dab39049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:00.093818 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60caf91-500b-4670-8fd8-9654dab39049 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:00.094098 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60caf91-500b-4670-8fd8-9654dab39049 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:00.094376 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60caf91-500b-4670-8fd8-9654dab39049 admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:00.095034 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60caf91-500b-4670-8fd8-9654dab39049 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:00.097264 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60caf91-500b-4670-8fd8-9654dab39049 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:00.098291 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 867/1737] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 05:29:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 911 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 05:30:00.099598 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b21505-5d81-4cb1-a76f-2dc7b3ad570b None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:00.099916 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b21505-5d81-4cb1-a76f-2dc7b3ad570b None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:00.100197 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b21505-5d81-4cb1-a76f-2dc7b3ad570b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:00.139171 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:00.191651 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 871/1738] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:29:59 2022] POST /identity/v3/users => generated 289 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:30:00.196314 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60caf91-500b-4670-8fd8-9654dab39049 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:00.214415 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-77b21505-5d81-4cb1-a76f-2dc7b3ad570b None None] MFA Rules not processed for user `2733ccb746fd454b8e53bf6ae162f38e`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:30:00.216285 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-77b21505-5d81-4cb1-a76f-2dc7b3ad570b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:00.228347 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60caf91-500b-4670-8fd8-9654dab39049 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:00.271726 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648260bc-f602-4c83-a00c-153e359d02c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:00.272402 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648260bc-f602-4c83-a00c-153e359d02c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:00.272779 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648260bc-f602-4c83-a00c-153e359d02c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:00.273054 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648260bc-f602-4c83-a00c-153e359d02c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:00.273624 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648260bc-f602-4c83-a00c-153e359d02c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:00.280952 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648260bc-f602-4c83-a00c-153e359d02c6 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:00.316373 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 872/1739] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:30:00 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:30:00.321028 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648260bc-f602-4c83-a00c-153e359d02c6 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:00.342519 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648260bc-f602-4c83-a00c-153e359d02c6 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:00.347927 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:00.359613 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0461f8db-fd41-45e2-b571-ec637296b2e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:00.360630 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0461f8db-fd41-45e2-b571-ec637296b2e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:00.361073 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0461f8db-fd41-45e2-b571-ec637296b2e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:00.361731 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0461f8db-fd41-45e2-b571-ec637296b2e3 admin admin] PATH_INFO: `/v3/projects/3d42d03386e3418ab7f43681e3782b81/users/c0a25dbf870e4b28ac5d4d921ca99ce7/roles/5b702713e40145b49e0b42abd0a5fba9` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:00.415925 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0461f8db-fd41-45e2-b571-ec637296b2e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d42d03386e3418ab7f43681e3782b81, user_id=c0a25dbf870e4b28ac5d4d921ca99ce7, role_id=5b702713e40145b49e0b42abd0a5fba9)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:00.419035 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0461f8db-fd41-45e2-b571-ec637296b2e3 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:00.452850 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 868/1740] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:30:00 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:30:00.488493 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 873/1741] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:30:00 2022] PUT /identity/v3/projects/3d42d03386e3418ab7f43681e3782b81/users/c0a25dbf870e4b28ac5d4d921ca99ce7/roles/5b702713e40145b49e0b42abd0a5fba9 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 05:30:00.491649 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b21505-5d81-4cb1-a76f-2dc7b3ad570b None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:00.508782 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0461f8db-fd41-45e2-b571-ec637296b2e3 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:00.510654 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-0461f8db-fd41-45e2-b571-ec637296b2e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:00.538928 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b21505-5d81-4cb1-a76f-2dc7b3ad570b None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:00.750359 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0461f8db-fd41-45e2-b571-ec637296b2e3 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:00.803186 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598f7579-45a6-4236-935d-96a4ab1ed2a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cd6136036bd467c946cae90d5c29263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:00.805518 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f7579-45a6-4236-935d-96a4ab1ed2a8 service nova] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:00.808652 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f7579-45a6-4236-935d-96a4ab1ed2a8 service nova] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:00.809253 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f7579-45a6-4236-935d-96a4ab1ed2a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:00.820567 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ea3835-d0b8-4000-9f94-dcbf35e3d06d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:00.823506 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea3835-d0b8-4000-9f94-dcbf35e3d06d admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:00.824430 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea3835-d0b8-4000-9f94-dcbf35e3d06d admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:00.824866 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea3835-d0b8-4000-9f94-dcbf35e3d06d admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:00.827356 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ea3835-d0b8-4000-9f94-dcbf35e3d06d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:00.830675 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ea3835-d0b8-4000-9f94-dcbf35e3d06d admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:00.855378 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 869/1742] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:30:00 2022] GET /identity/v3/roles => generated 1420 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:30:00.860061 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef07f4e1-7ad2-4717-abaa-00b907388d5d None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:00.862003 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef07f4e1-7ad2-4717-abaa-00b907388d5d None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:00.862767 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef07f4e1-7ad2-4717-abaa-00b907388d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:00.935092 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-ef07f4e1-7ad2-4717-abaa-00b907388d5d None None] MFA Rules not processed for user `7dd6776038e649d89f189a42e116e859`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:30:00.936969 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-ef07f4e1-7ad2-4717-abaa-00b907388d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:01.021058 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598f7579-45a6-4236-935d-96a4ab1ed2a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:01.025271 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598f7579-45a6-4236-935d-96a4ab1ed2a8 service nova] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:01.097731 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 874/1743] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:30:00 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 589 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 05:30:01.100029 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598f7579-45a6-4236-935d-96a4ab1ed2a8 service nova] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:01.104381 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-598f7579-45a6-4236-935d-96a4ab1ed2a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:01.239493 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 870/1744] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:30:00 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:30:01.240801 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef07f4e1-7ad2-4717-abaa-00b907388d5d None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:01.280075 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef07f4e1-7ad2-4717-abaa-00b907388d5d None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:01.286043 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6e36bd-40fc-4883-8096-68e604925f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:01.286889 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6e36bd-40fc-4883-8096-68e604925f29 admin admin] REQUEST_METHOD: `PUT` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:01.287177 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6e36bd-40fc-4883-8096-68e604925f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:01.288385 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6e36bd-40fc-4883-8096-68e604925f29 admin admin] PATH_INFO: `/v3/projects/3d42d03386e3418ab7f43681e3782b81/users/c0a25dbf870e4b28ac5d4d921ca99ce7/roles/5b702713e40145b49e0b42abd0a5fba9` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:01.293962 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6e36bd-40fc-4883-8096-68e604925f29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d42d03386e3418ab7f43681e3782b81, user_id=c0a25dbf870e4b28ac5d4d921ca99ce7, role_id=5b702713e40145b49e0b42abd0a5fba9)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:01.296826 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:01.302709 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6e36bd-40fc-4883-8096-68e604925f29 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:01.317290 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598f7579-45a6-4236-935d-96a4ab1ed2a8 service nova] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:01.365270 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 871/1745] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:30:01 2022] PUT /identity/v3/projects/3d42d03386e3418ab7f43681e3782b81/users/c0a25dbf870e4b28ac5d4d921ca99ce7/roles/5b702713e40145b49e0b42abd0a5fba9 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:30:01.369821 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0159dbe-c74f-4c86-89d1-fe3a5d12c3ce None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:01.370295 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0159dbe-c74f-4c86-89d1-fe3a5d12c3ce None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:01.371806 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0159dbe-c74f-4c86-89d1-fe3a5d12c3ce None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:01.377916 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 872/1746] 10.222.0.16 () {54 vars in 961 bytes} [Sun Sep 11 05:30:01 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:30:01.379530 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a232c-b55c-4d1a-8c70-2a11fd65f77f None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:01.381709 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a232c-b55c-4d1a-8c70-2a11fd65f77f None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:01.382056 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a232c-b55c-4d1a-8c70-2a11fd65f77f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:01.516989 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-e13a232c-b55c-4d1a-8c70-2a11fd65f77f None None] MFA Rules not processed for user `c0a25dbf870e4b28ac5d4d921ca99ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:30:01.518512 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-e13a232c-b55c-4d1a-8c70-2a11fd65f77f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:01.569698 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11257070-fbe5-41a0-9b60-004d3c7829ab service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72e1d7dd79ff43e7b585b5090762465f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:01.570590 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11257070-fbe5-41a0-9b60-004d3c7829ab service placement] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:01.570854 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11257070-fbe5-41a0-9b60-004d3c7829ab service placement] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:01.575900 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11257070-fbe5-41a0-9b60-004d3c7829ab service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:01.587881 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-11257070-fbe5-41a0-9b60-004d3c7829ab service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:01.636431 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11257070-fbe5-41a0-9b60-004d3c7829ab service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:01.643518 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11257070-fbe5-41a0-9b60-004d3c7829ab service placement] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:01.664298 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:01.670566 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 875/1747] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:30:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 570 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:30:01.672018 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a23e0-2aa1-4559-a8e7-f2bce0bbb74d None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:01.672283 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a23e0-2aa1-4559-a8e7-f2bce0bbb74d None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:01.678592 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a23e0-2aa1-4559-a8e7-f2bce0bbb74d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:01.727866 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-de0a23e0-2aa1-4559-a8e7-f2bce0bbb74d None None] MFA Rules not processed for user `72e1d7dd79ff43e7b585b5090762465f`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:30:01.733086 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-de0a23e0-2aa1-4559-a8e7-f2bce0bbb74d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:01.801366 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 876/1748] 10.222.0.16 () {58 vars in 1058 bytes} [Sun Sep 11 05:30:01 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:30:01.814188 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0a23e0-2aa1-4559-a8e7-f2bce0bbb74d None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:01.835478 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0a23e0-2aa1-4559-a8e7-f2bce0bbb74d None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:01.835769 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 873/1749] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:30:01 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 457 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:30:01.841672 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a232c-b55c-4d1a-8c70-2a11fd65f77f None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:01.851861 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-e13a232c-b55c-4d1a-8c70-2a11fd65f77f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:01.857311 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82407062-cce2-45e0-bdf5-2606c1661c5c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72e1d7dd79ff43e7b585b5090762465f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:01.857949 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82407062-cce2-45e0-bdf5-2606c1661c5c service placement] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:01.860610 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82407062-cce2-45e0-bdf5-2606c1661c5c service placement] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:01.864811 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82407062-cce2-45e0-bdf5-2606c1661c5c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:01.887090 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82407062-cce2-45e0-bdf5-2606c1661c5c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:01.903503 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82407062-cce2-45e0-bdf5-2606c1661c5c service placement] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:01.935117 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 877/1750] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:30:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:30:02.075171 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a232c-b55c-4d1a-8c70-2a11fd65f77f None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:02.098508 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013ee39d-fa24-4d5e-8f13-bed7eec00766 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a147e14b61d481db1cac02c58ac3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:02.102960 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013ee39d-fa24-4d5e-8f13-bed7eec00766 service cinder] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:02.106158 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013ee39d-fa24-4d5e-8f13-bed7eec00766 service cinder] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:02.109808 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013ee39d-fa24-4d5e-8f13-bed7eec00766 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:02.134771 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013ee39d-fa24-4d5e-8f13-bed7eec00766 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:02.137055 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013ee39d-fa24-4d5e-8f13-bed7eec00766 service cinder] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:02.161164 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 874/1751] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:30:01 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:30:02.233906 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82407062-cce2-45e0-bdf5-2606c1661c5c service placement] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:02.252853 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82407062-cce2-45e0-bdf5-2606c1661c5c service placement] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:02.257880 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c22d3d-f921-4176-a2ed-642a10184642 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a147e14b61d481db1cac02c58ac3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:02.258670 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c22d3d-f921-4176-a2ed-642a10184642 service cinder] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:02.260023 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c22d3d-f921-4176-a2ed-642a10184642 service cinder] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:02.260461 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c22d3d-f921-4176-a2ed-642a10184642 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:02.503519 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c22d3d-f921-4176-a2ed-642a10184642 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:02.505382 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c22d3d-f921-4176-a2ed-642a10184642 service cinder] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:02.522392 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 878/1752] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:30:02 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:30:02.771191 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013ee39d-fa24-4d5e-8f13-bed7eec00766 service cinder] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:02.773086 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-013ee39d-fa24-4d5e-8f13-bed7eec00766 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:02.885282 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62781a95-65d4-474b-905d-a49f6c0548bd None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:02.885711 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62781a95-65d4-474b-905d-a49f6c0548bd None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:02.886086 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62781a95-65d4-474b-905d-a49f6c0548bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:02.913919 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-62781a95-65d4-474b-905d-a49f6c0548bd None None] MFA Rules not processed for user `dae006738da54b26a64097de95bef254`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:30:02.916704 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-62781a95-65d4-474b-905d-a49f6c0548bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:03.048410 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013ee39d-fa24-4d5e-8f13-bed7eec00766 service cinder] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:03.057538 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3c1917-b8c9-4e7a-b2e0-e40d6fa378ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:03.058255 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c1917-b8c9-4e7a-b2e0-e40d6fa378ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:03.058717 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c1917-b8c9-4e7a-b2e0-e40d6fa378ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:03.059121 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c1917-b8c9-4e7a-b2e0-e40d6fa378ab admin admin] PATH_INFO: `/v3/users/99329dd81c044f4fb6ad025325f18f73` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:03.061203 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3c1917-b8c9-4e7a-b2e0-e40d6fa378ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=99329dd81c044f4fb6ad025325f18f73)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:03.065217 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3c1917-b8c9-4e7a-b2e0-e40d6fa378ab admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:03.124410 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 879/1753] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:30:02 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 05:30:03.193410 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-9d3c1917-b8c9-4e7a-b2e0-e40d6fa378ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99329dd81c044f4fb6ad025325f18f73'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:03.226427 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-9d3c1917-b8c9-4e7a-b2e0-e40d6fa378ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99329dd81c044f4fb6ad025325f18f73'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:03.239304 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-9d3c1917-b8c9-4e7a-b2e0-e40d6fa378ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99329dd81c044f4fb6ad025325f18f73'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:03.246623 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:03.261340 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-9d3c1917-b8c9-4e7a-b2e0-e40d6fa378ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99329dd81c044f4fb6ad025325f18f73'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:03.262015 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-9d3c1917-b8c9-4e7a-b2e0-e40d6fa378ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99329dd81c044f4fb6ad025325f18f73'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:03.290580 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 875/1754] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:30:02 2022] DELETE /identity/v3/users/99329dd81c044f4fb6ad025325f18f73 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:30:03.295128 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c98be-d73f-4db5-966b-ed7734ade2dc None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:03.295901 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c98be-d73f-4db5-966b-ed7734ade2dc None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:03.295901 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c98be-d73f-4db5-966b-ed7734ade2dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:03.347361 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-a52c98be-d73f-4db5-966b-ed7734ade2dc None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:30:03.348687 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-a52c98be-d73f-4db5-966b-ed7734ade2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:03.392588 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:03.639760 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 880/1755] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:30:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:30:03.682368 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3c1917-b8c9-4e7a-b2e0-e40d6fa378ab admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:03.685845 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-9d3c1917-b8c9-4e7a-b2e0-e40d6fa378ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:03.791086 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3c1917-b8c9-4e7a-b2e0-e40d6fa378ab admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:03.799772 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391eb50a-beb0-48ea-92dd-c93dc3b600e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:03.800961 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391eb50a-beb0-48ea-92dd-c93dc3b600e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:03.801561 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391eb50a-beb0-48ea-92dd-c93dc3b600e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:03.820280 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391eb50a-beb0-48ea-92dd-c93dc3b600e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:03.858281 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391eb50a-beb0-48ea-92dd-c93dc3b600e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:03.860209 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391eb50a-beb0-48ea-92dd-c93dc3b600e6 service neutron] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:03.877095 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 876/1756] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:30:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:30:04.748645 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2791eb0-0be1-455e-b991-19782af4143f None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:04.749164 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2791eb0-0be1-455e-b991-19782af4143f None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:04.749349 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2791eb0-0be1-455e-b991-19782af4143f None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:04.756921 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 881/1757] 10.222.0.16 () {54 vars in 921 bytes} [Sun Sep 11 05:30:04 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:30:04.815304 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea00270-7532-4f89-873d-41246530ae39 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:04.816827 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea00270-7532-4f89-873d-41246530ae39 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:04.817142 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea00270-7532-4f89-873d-41246530ae39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:04.875039 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-9ea00270-7532-4f89-873d-41246530ae39 None None] MFA Rules not processed for user `72e1d7dd79ff43e7b585b5090762465f`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:30:04.876905 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-9ea00270-7532-4f89-873d-41246530ae39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:04.999090 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 877/1758] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 11 05:30:04 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:30:05.019823 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2791eb0-0be1-455e-b991-19782af4143f None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:05.022061 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-a2791eb0-0be1-455e-b991-19782af4143f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:05.064383 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2791eb0-0be1-455e-b991-19782af4143f None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:05.076653 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1e71e9-021e-434d-9fe6-d86e43348966 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72e1d7dd79ff43e7b585b5090762465f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:05.077286 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1e71e9-021e-434d-9fe6-d86e43348966 service placement] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:05.077565 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1e71e9-021e-434d-9fe6-d86e43348966 service placement] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:05.078106 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1e71e9-021e-434d-9fe6-d86e43348966 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:05.117240 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1e71e9-021e-434d-9fe6-d86e43348966 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:05.119327 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1e71e9-021e-434d-9fe6-d86e43348966 service placement] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:05.164892 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 882/1759] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:30:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:30:05.188719 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea00270-7532-4f89-873d-41246530ae39 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:05.190330 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-9ea00270-7532-4f89-873d-41246530ae39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:05.215949 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea00270-7532-4f89-873d-41246530ae39 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:05.230385 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af0bc23-073d-4675-abae-3385e3dc6733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:05.231140 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0bc23-073d-4675-abae-3385e3dc6733 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:05.231430 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0bc23-073d-4675-abae-3385e3dc6733 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:05.231742 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0bc23-073d-4675-abae-3385e3dc6733 admin admin] PATH_INFO: `/v3/projects/ac143326d2f946ae9fb6b64d06ef6b7e` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:05.233261 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af0bc23-073d-4675-abae-3385e3dc6733 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac143326d2f946ae9fb6b64d06ef6b7e)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:05.235073 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af0bc23-073d-4675-abae-3385e3dc6733 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:05.415999 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-4af0bc23-073d-4675-abae-3385e3dc6733 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac143326d2f946ae9fb6b64d06ef6b7e', 'request_id': 'req-4af0bc23-073d-4675-abae-3385e3dc6733'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:05.435986 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-4af0bc23-073d-4675-abae-3385e3dc6733 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac143326d2f946ae9fb6b64d06ef6b7e', 'request_id': 'req-4af0bc23-073d-4675-abae-3385e3dc6733'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:05.457823 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-4af0bc23-073d-4675-abae-3385e3dc6733 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac143326d2f946ae9fb6b64d06ef6b7e', 'request_id': 'req-4af0bc23-073d-4675-abae-3385e3dc6733'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:05.527530 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-4af0bc23-073d-4675-abae-3385e3dc6733 admin admin] The token cache is being invalidate because project ac143326d2f946ae9fb6b64d06ef6b7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81383) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:30:05.527872 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-4af0bc23-073d-4675-abae-3385e3dc6733 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:05.532108 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-4af0bc23-073d-4675-abae-3385e3dc6733 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:05.533898 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 878/1760] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:30:05 2022] DELETE /identity/v3/projects/ac143326d2f946ae9fb6b64d06ef6b7e => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:30:05.538141 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1e71e9-021e-434d-9fe6-d86e43348966 service placement] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:05.557018 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1e71e9-021e-434d-9fe6-d86e43348966 service placement] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:05.810044 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f801b301-6e48-45f3-ae54-b7bbfa3a7c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:05.810743 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f801b301-6e48-45f3-ae54-b7bbfa3a7c78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:05.810954 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f801b301-6e48-45f3-ae54-b7bbfa3a7c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:05.811460 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f801b301-6e48-45f3-ae54-b7bbfa3a7c78 admin admin] PATH_INFO: `/v3/users/60c204e93e2c4cdca339752b69377009` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:05.814288 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f801b301-6e48-45f3-ae54-b7bbfa3a7c78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60c204e93e2c4cdca339752b69377009)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:05.817652 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f801b301-6e48-45f3-ae54-b7bbfa3a7c78 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:05.978107 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-f801b301-6e48-45f3-ae54-b7bbfa3a7c78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60c204e93e2c4cdca339752b69377009'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:06.016331 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-f801b301-6e48-45f3-ae54-b7bbfa3a7c78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60c204e93e2c4cdca339752b69377009'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:06.040287 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-f801b301-6e48-45f3-ae54-b7bbfa3a7c78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60c204e93e2c4cdca339752b69377009'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:06.060323 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-f801b301-6e48-45f3-ae54-b7bbfa3a7c78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60c204e93e2c4cdca339752b69377009'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:06.061034 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-f801b301-6e48-45f3-ae54-b7bbfa3a7c78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60c204e93e2c4cdca339752b69377009'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:06.078614 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 883/1761] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:30:05 2022] DELETE /identity/v3/users/60c204e93e2c4cdca339752b69377009 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:30:06.347581 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b5a4e-935f-47bc-af8a-46baab71561d None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:06.348200 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b5a4e-935f-47bc-af8a-46baab71561d None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:06.348295 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b5a4e-935f-47bc-af8a-46baab71561d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:06.380567 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-883b5a4e-935f-47bc-af8a-46baab71561d None None] MFA Rules not processed for user `62fffbcf330a4bc183d0885c175f5a90`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:30:06.382201 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-883b5a4e-935f-47bc-af8a-46baab71561d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:06.426264 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=90 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:06.617215 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 879/1762] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 05:30:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:30:06.635838 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f801b301-6e48-45f3-ae54-b7bbfa3a7c78 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:06.637483 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-f801b301-6e48-45f3-ae54-b7bbfa3a7c78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:06.669988 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:06.799994 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f801b301-6e48-45f3-ae54-b7bbfa3a7c78 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:06.832966 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f099ef-13b8-472f-a851-66355f183439 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bbe4555380345e485572d2da8b78be1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:06.834888 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f099ef-13b8-472f-a851-66355f183439 service swift] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:06.836607 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f099ef-13b8-472f-a851-66355f183439 service swift] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:06.837531 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f099ef-13b8-472f-a851-66355f183439 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:06.853965 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f099ef-13b8-472f-a851-66355f183439 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:06.857461 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f099ef-13b8-472f-a851-66355f183439 service swift] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:06.875193 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 884/1763] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 05:30:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 05:30:08.748455 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d42d479-5eb2-413c-9cca-7843635331e8 None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:08.749673 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d42d479-5eb2-413c-9cca-7843635331e8 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:08.750139 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d42d479-5eb2-413c-9cca-7843635331e8 None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:08.751755 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 880/1764] 10.222.0.16 () {54 vars in 921 bytes} [Sun Sep 11 05:30:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:30:08.858233 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f099ef-13b8-472f-a851-66355f183439 service swift] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:08.860133 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-73f099ef-13b8-472f-a851-66355f183439 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:09.013874 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da8e7b2-4d19-468e-a274-8e7eba739261 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:09.014585 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da8e7b2-4d19-468e-a274-8e7eba739261 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:09.017412 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da8e7b2-4d19-468e-a274-8e7eba739261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:09.094830 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-5da8e7b2-4d19-468e-a274-8e7eba739261 None None] MFA Rules not processed for user `72e1d7dd79ff43e7b585b5090762465f`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:30:09.099501 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-5da8e7b2-4d19-468e-a274-8e7eba739261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:09.132851 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f099ef-13b8-472f-a851-66355f183439 service swift] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:09.145326 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49a6904-aaa3-4e73-8411-80a26663cad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:09.146235 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a6904-aaa3-4e73-8411-80a26663cad5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:09.148599 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a6904-aaa3-4e73-8411-80a26663cad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:09.153187 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a6904-aaa3-4e73-8411-80a26663cad5 admin admin] PATH_INFO: `/v3/users/0c2430d707674f00a088f6d72259d855` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:09.158495 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49a6904-aaa3-4e73-8411-80a26663cad5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c2430d707674f00a088f6d72259d855)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:09.164770 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49a6904-aaa3-4e73-8411-80a26663cad5 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:09.422392 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 881/1765] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 11 05:30:09 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 414 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:30:09.427161 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50c68b-d072-41eb-a786-6360123388f9 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:09.430492 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50c68b-d072-41eb-a786-6360123388f9 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:09.430778 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50c68b-d072-41eb-a786-6360123388f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:09.445988 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-c49a6904-aaa3-4e73-8411-80a26663cad5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c2430d707674f00a088f6d72259d855'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:09.554366 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-c49a6904-aaa3-4e73-8411-80a26663cad5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c2430d707674f00a088f6d72259d855'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:09.592522 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-9c50c68b-d072-41eb-a786-6360123388f9 None None] MFA Rules not processed for user `72086abb4e0547dc96d76a44886805ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:30:09.609030 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-9c50c68b-d072-41eb-a786-6360123388f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:09.627713 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-c49a6904-aaa3-4e73-8411-80a26663cad5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c2430d707674f00a088f6d72259d855'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:09.663028 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-c49a6904-aaa3-4e73-8411-80a26663cad5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c2430d707674f00a088f6d72259d855'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:09.664794 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-c49a6904-aaa3-4e73-8411-80a26663cad5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c2430d707674f00a088f6d72259d855'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:09.690375 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 885/1766] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:30:08 2022] DELETE /identity/v3/users/0c2430d707674f00a088f6d72259d855 => generated 0 bytes in 829 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:30:09.695002 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49a6904-aaa3-4e73-8411-80a26663cad5 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:09.697700 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-c49a6904-aaa3-4e73-8411-80a26663cad5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:09.824081 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:09.885684 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49a6904-aaa3-4e73-8411-80a26663cad5 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:09.914218 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3199f1b-d0c1-4d58-9a7e-21fac745e045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:09.915051 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3199f1b-d0c1-4d58-9a7e-21fac745e045 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:09.915453 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3199f1b-d0c1-4d58-9a7e-21fac745e045 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:09.915881 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3199f1b-d0c1-4d58-9a7e-21fac745e045 admin admin] PATH_INFO: `/v3/users/d9af828f280445418f1462561b2081e1` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:09.919497 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3199f1b-d0c1-4d58-9a7e-21fac745e045 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9af828f280445418f1462561b2081e1)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:09.922114 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3199f1b-d0c1-4d58-9a7e-21fac745e045 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:09.959304 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 882/1767] 10.222.0.43 () {58 vars in 1015 bytes} [Sun Sep 11 05:30:09 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 536 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:30:09.969150 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c50c68b-d072-41eb-a786-6360123388f9 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:09.976043 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-9c50c68b-d072-41eb-a786-6360123388f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:10.007496 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c50c68b-d072-41eb-a786-6360123388f9 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:10.023165 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-f3199f1b-d0c1-4d58-9a7e-21fac745e045 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9af828f280445418f1462561b2081e1'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:10.051399 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-f3199f1b-d0c1-4d58-9a7e-21fac745e045 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9af828f280445418f1462561b2081e1'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:10.069141 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-f3199f1b-d0c1-4d58-9a7e-21fac745e045 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9af828f280445418f1462561b2081e1'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:10.088655 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-f3199f1b-d0c1-4d58-9a7e-21fac745e045 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9af828f280445418f1462561b2081e1'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:10.089722 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-f3199f1b-d0c1-4d58-9a7e-21fac745e045 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9af828f280445418f1462561b2081e1'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:10.100496 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 886/1768] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:30:09 2022] DELETE /identity/v3/users/d9af828f280445418f1462561b2081e1 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:30:10.100496 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f40d1-09cb-4a17-8124-590e583ad576 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:10.100496 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f40d1-09cb-4a17-8124-590e583ad576 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:10.100496 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f40d1-09cb-4a17-8124-590e583ad576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:10.160893 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-1d6f40d1-09cb-4a17-8124-590e583ad576 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:30:10.167708 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-1d6f40d1-09cb-4a17-8124-590e583ad576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:10.292516 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785faff3-930c-4e95-a53d-920f284cddd4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72e1d7dd79ff43e7b585b5090762465f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:10.294167 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785faff3-930c-4e95-a53d-920f284cddd4 service placement] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:10.294461 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785faff3-930c-4e95-a53d-920f284cddd4 service placement] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:10.294735 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785faff3-930c-4e95-a53d-920f284cddd4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:10.298027 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-785faff3-930c-4e95-a53d-920f284cddd4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:10.318713 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:10.336423 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785faff3-930c-4e95-a53d-920f284cddd4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:10.354070 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785faff3-930c-4e95-a53d-920f284cddd4 service placement] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:10.382093 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 883/1769] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:30:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:30:10.399823 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 887/1770] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:30:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:30:10.816443 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785faff3-930c-4e95-a53d-920f284cddd4 service placement] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:10.818214 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-785faff3-930c-4e95-a53d-920f284cddd4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:10.853187 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6f40d1-09cb-4a17-8124-590e583ad576 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:10.854835 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-1d6f40d1-09cb-4a17-8124-590e583ad576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:11.065276 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785faff3-930c-4e95-a53d-920f284cddd4 service placement] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:11.068597 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:11.072375 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3165cf-8e17-4837-8a25-4eb77f31de9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:11.073682 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3165cf-8e17-4837-8a25-4eb77f31de9d service neutron] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:11.074274 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3165cf-8e17-4837-8a25-4eb77f31de9d service neutron] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:11.075043 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3165cf-8e17-4837-8a25-4eb77f31de9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:11.078025 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-1a3165cf-8e17-4837-8a25-4eb77f31de9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:11.080946 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6f40d1-09cb-4a17-8124-590e583ad576 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:11.094365 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3165cf-8e17-4837-8a25-4eb77f31de9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:11.096828 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ffdfe0-fbc1-429d-91fc-bfcb55bc58cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:11.097510 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ffdfe0-fbc1-429d-91fc-bfcb55bc58cc service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:11.097794 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ffdfe0-fbc1-429d-91fc-bfcb55bc58cc service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:11.098086 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ffdfe0-fbc1-429d-91fc-bfcb55bc58cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:11.105379 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3165cf-8e17-4837-8a25-4eb77f31de9d service neutron] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:11.122971 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 884/1771] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:30:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:30:11.136487 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ffdfe0-fbc1-429d-91fc-bfcb55bc58cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:11.138224 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ffdfe0-fbc1-429d-91fc-bfcb55bc58cc service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:11.155508 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3165cf-8e17-4837-8a25-4eb77f31de9d service neutron] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:11.157388 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-1a3165cf-8e17-4837-8a25-4eb77f31de9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:11.179440 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 888/1772] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:30:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:30:11.251595 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3165cf-8e17-4837-8a25-4eb77f31de9d service neutron] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:11.288364 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d067c699-c506-4dae-9e24-6cbba871b00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:11.291203 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d067c699-c506-4dae-9e24-6cbba871b00f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:11.291517 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d067c699-c506-4dae-9e24-6cbba871b00f admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:11.291832 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d067c699-c506-4dae-9e24-6cbba871b00f admin admin] PATH_INFO: `/v3/projects/e86417b3eb804955abdd1a391342b786` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:11.298385 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d067c699-c506-4dae-9e24-6cbba871b00f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e86417b3eb804955abdd1a391342b786)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:11.311958 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d067c699-c506-4dae-9e24-6cbba871b00f admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:11.491449 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-d067c699-c506-4dae-9e24-6cbba871b00f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e86417b3eb804955abdd1a391342b786', 'request_id': 'req-d067c699-c506-4dae-9e24-6cbba871b00f'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:11.508172 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-d067c699-c506-4dae-9e24-6cbba871b00f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e86417b3eb804955abdd1a391342b786', 'request_id': 'req-d067c699-c506-4dae-9e24-6cbba871b00f'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:11.534358 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-d067c699-c506-4dae-9e24-6cbba871b00f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e86417b3eb804955abdd1a391342b786', 'request_id': 'req-d067c699-c506-4dae-9e24-6cbba871b00f'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:11.589308 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-d067c699-c506-4dae-9e24-6cbba871b00f admin admin] The token cache is being invalidate because project e86417b3eb804955abdd1a391342b786 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81383) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:30:11.590785 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-d067c699-c506-4dae-9e24-6cbba871b00f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:11.593037 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-d067c699-c506-4dae-9e24-6cbba871b00f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:11.600787 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 885/1773] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:30:11 2022] DELETE /identity/v3/projects/e86417b3eb804955abdd1a391342b786 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:30:11.605657 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d4dd92-7f23-4324-a104-7e16eb91042e None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:11.607195 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d4dd92-7f23-4324-a104-7e16eb91042e None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:11.607854 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d4dd92-7f23-4324-a104-7e16eb91042e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:11.663107 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-f1d4dd92-7f23-4324-a104-7e16eb91042e None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:30:11.692603 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-f1d4dd92-7f23-4324-a104-7e16eb91042e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:11.916713 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 889/1774] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:30:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:30:11.925057 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af2243-b925-44f8-8ba8-b00512f95e13 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:11.925611 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af2243-b925-44f8-8ba8-b00512f95e13 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:11.926041 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af2243-b925-44f8-8ba8-b00512f95e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:11.969431 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-54af2243-b925-44f8-8ba8-b00512f95e13 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:30:11.970969 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-54af2243-b925-44f8-8ba8-b00512f95e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:11.989243 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 886/1775] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:30:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:30:11.993834 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d4dd92-7f23-4324-a104-7e16eb91042e None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:12.008517 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d4dd92-7f23-4324-a104-7e16eb91042e None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:12.015822 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c0a109-2d83-44c0-8c75-57da4c7a7c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:12.016718 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c0a109-2d83-44c0-8c75-57da4c7a7c75 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:12.017159 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c0a109-2d83-44c0-8c75-57da4c7a7c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:12.017603 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c0a109-2d83-44c0-8c75-57da4c7a7c75 admin admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:12.018425 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c0a109-2d83-44c0-8c75-57da4c7a7c75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:30:12.018878 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c0a109-2d83-44c0-8c75-57da4c7a7c75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:12.020703 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c0a109-2d83-44c0-8c75-57da4c7a7c75 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:12.049206 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 890/1776] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 05:30:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:30:12.053112 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54af2243-b925-44f8-8ba8-b00512f95e13 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:12.063768 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54af2243-b925-44f8-8ba8-b00512f95e13 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:12.071923 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34de659f-1c8c-4654-a5e3-a00d24cab539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:12.073420 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de659f-1c8c-4654-a5e3-a00d24cab539 admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:12.073895 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de659f-1c8c-4654-a5e3-a00d24cab539 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:12.074400 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de659f-1c8c-4654-a5e3-a00d24cab539 admin admin] PATH_INFO: `/v3/projects` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:12.075857 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34de659f-1c8c-4654-a5e3-a00d24cab539 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:12.078166 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34de659f-1c8c-4654-a5e3-a00d24cab539 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:12.142246 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 887/1777] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:30:12 2022] POST /identity/v3/projects => generated 363 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:30:12.144645 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c0a109-2d83-44c0-8c75-57da4c7a7c75 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:12.193466 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c0a109-2d83-44c0-8c75-57da4c7a7c75 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:12.359613 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a81c94-59f1-4f6c-a58a-4c4833a62824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:12.360734 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a81c94-59f1-4f6c-a58a-4c4833a62824 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:12.361057 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a81c94-59f1-4f6c-a58a-4c4833a62824 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:12.364299 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a81c94-59f1-4f6c-a58a-4c4833a62824 admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:12.365377 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a81c94-59f1-4f6c-a58a-4c4833a62824 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:12.367749 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a81c94-59f1-4f6c-a58a-4c4833a62824 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:12.437810 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 891/1778] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:30:12 2022] POST /identity/v3/users => generated 282 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:30:12.454624 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34de659f-1c8c-4654-a5e3-a00d24cab539 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:12.519606 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34de659f-1c8c-4654-a5e3-a00d24cab539 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:12.565069 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11c27d0-6a91-42b1-89b2-eb0c905a4332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:12.568216 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c27d0-6a91-42b1-89b2-eb0c905a4332 admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:12.569839 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c27d0-6a91-42b1-89b2-eb0c905a4332 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:12.570170 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c27d0-6a91-42b1-89b2-eb0c905a4332 admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:12.578138 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11c27d0-6a91-42b1-89b2-eb0c905a4332 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:12.591720 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11c27d0-6a91-42b1-89b2-eb0c905a4332 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:12.729471 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 888/1779] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:30:12 2022] GET /identity/v3/roles => generated 1420 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:30:12.731258 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a81c94-59f1-4f6c-a58a-4c4833a62824 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:12.775306 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a81c94-59f1-4f6c-a58a-4c4833a62824 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:12.793195 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f278cd73-44b5-4d40-ac47-3c2effa111a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:12.794428 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f278cd73-44b5-4d40-ac47-3c2effa111a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:12.795071 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f278cd73-44b5-4d40-ac47-3c2effa111a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:12.799808 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f278cd73-44b5-4d40-ac47-3c2effa111a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:12.799808 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f278cd73-44b5-4d40-ac47-3c2effa111a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:12.814932 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f278cd73-44b5-4d40-ac47-3c2effa111a7 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:12.856522 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 892/1780] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:30:12 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:30:12.859106 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11c27d0-6a91-42b1-89b2-eb0c905a4332 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:12.880215 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11c27d0-6a91-42b1-89b2-eb0c905a4332 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:12.915322 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f86f7b-0239-47a7-9f4f-1d6fa3ef8b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:12.915706 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f86f7b-0239-47a7-9f4f-1d6fa3ef8b14 admin admin] REQUEST_METHOD: `PUT` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:12.917030 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f86f7b-0239-47a7-9f4f-1d6fa3ef8b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:12.917030 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f86f7b-0239-47a7-9f4f-1d6fa3ef8b14 admin admin] PATH_INFO: `/v3/projects/6b38c25e8b8740e6a81a29c58c7e9cf4/users/eb6d71febb3b4f4fa7b3293f1570803b/roles/aa7ff8e0ec1e48e5811335b9eb38b448` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:13.019655 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f86f7b-0239-47a7-9f4f-1d6fa3ef8b14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b38c25e8b8740e6a81a29c58c7e9cf4, user_id=eb6d71febb3b4f4fa7b3293f1570803b, role_id=aa7ff8e0ec1e48e5811335b9eb38b448)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:13.037667 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f86f7b-0239-47a7-9f4f-1d6fa3ef8b14 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:13.073666 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 889/1781] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:30:12 2022] PUT /identity/v3/projects/6b38c25e8b8740e6a81a29c58c7e9cf4/users/eb6d71febb3b4f4fa7b3293f1570803b/roles/aa7ff8e0ec1e48e5811335b9eb38b448 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:30:13.086025 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefcb5c4-91ab-4d42-b0ed-d7ea82903de8 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:13.086314 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefcb5c4-91ab-4d42-b0ed-d7ea82903de8 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:13.086661 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefcb5c4-91ab-4d42-b0ed-d7ea82903de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:13.243817 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-cefcb5c4-91ab-4d42-b0ed-d7ea82903de8 None None] MFA Rules not processed for user `eb6d71febb3b4f4fa7b3293f1570803b`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:30:13.249748 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-cefcb5c4-91ab-4d42-b0ed-d7ea82903de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:13.425611 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:13.504351 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f86f7b-0239-47a7-9f4f-1d6fa3ef8b14 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:13.507332 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 893/1782] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:30:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 422 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:30:13.554165 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:13.757421 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f86f7b-0239-47a7-9f4f-1d6fa3ef8b14 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:13.767372 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11631855-636b-4f25-a870-2bec9b6cc2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:13.769961 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11631855-636b-4f25-a870-2bec9b6cc2eb admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:13.770597 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11631855-636b-4f25-a870-2bec9b6cc2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:13.771271 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11631855-636b-4f25-a870-2bec9b6cc2eb admin admin] PATH_INFO: `/v3/projects` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:13.773218 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11631855-636b-4f25-a870-2bec9b6cc2eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:13.780062 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11631855-636b-4f25-a870-2bec9b6cc2eb admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:13.886106 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 890/1783] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:30:13 2022] POST /identity/v3/projects => generated 363 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:30:13.888277 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefcb5c4-91ab-4d42-b0ed-d7ea82903de8 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:13.952282 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefcb5c4-91ab-4d42-b0ed-d7ea82903de8 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:14.404797 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f64e11-94b8-4583-abd4-1be30ca24dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:14.405526 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f64e11-94b8-4583-abd4-1be30ca24dde admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:14.405777 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f64e11-94b8-4583-abd4-1be30ca24dde admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:14.406057 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f64e11-94b8-4583-abd4-1be30ca24dde admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:14.406918 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f64e11-94b8-4583-abd4-1be30ca24dde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:14.409477 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f64e11-94b8-4583-abd4-1be30ca24dde admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:14.446551 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 894/1784] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:30:13 2022] POST /identity/v3/users => generated 288 bytes in 559 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 05:30:14.450920 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11631855-636b-4f25-a870-2bec9b6cc2eb admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:14.470875 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11631855-636b-4f25-a870-2bec9b6cc2eb admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:14.481360 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf39505-cd64-4253-976a-d518a9ddf841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:14.483063 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf39505-cd64-4253-976a-d518a9ddf841 admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:14.483350 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf39505-cd64-4253-976a-d518a9ddf841 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:14.483932 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf39505-cd64-4253-976a-d518a9ddf841 admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:14.489500 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf39505-cd64-4253-976a-d518a9ddf841 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:14.491577 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf39505-cd64-4253-976a-d518a9ddf841 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:14.546131 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 891/1785] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:30:14 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:30:14.547423 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f64e11-94b8-4583-abd4-1be30ca24dde admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:14.561880 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f64e11-94b8-4583-abd4-1be30ca24dde admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:14.576456 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24e942a-2b3b-4afc-8768-36a1e9fc62ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:14.577219 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24e942a-2b3b-4afc-8768-36a1e9fc62ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:14.577501 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24e942a-2b3b-4afc-8768-36a1e9fc62ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:14.581255 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24e942a-2b3b-4afc-8768-36a1e9fc62ff admin admin] PATH_INFO: `/v3/projects/83d282e9e8624d16bb34946f9e56b57e/users/30d34022ec6b471094f34f9d0c919ccc/roles/5b702713e40145b49e0b42abd0a5fba9` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:14.640767 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24e942a-2b3b-4afc-8768-36a1e9fc62ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=83d282e9e8624d16bb34946f9e56b57e, user_id=30d34022ec6b471094f34f9d0c919ccc, role_id=5b702713e40145b49e0b42abd0a5fba9)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:14.644084 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24e942a-2b3b-4afc-8768-36a1e9fc62ff admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:14.684515 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 895/1786] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:30:14 2022] PUT /identity/v3/projects/83d282e9e8624d16bb34946f9e56b57e/users/30d34022ec6b471094f34f9d0c919ccc/roles/5b702713e40145b49e0b42abd0a5fba9 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:30:14.685755 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf39505-cd64-4253-976a-d518a9ddf841 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:14.708426 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf39505-cd64-4253-976a-d518a9ddf841 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:15.020279 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ad21f-5ee5-4bfb-abea-328ad7615577 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:15.020965 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ad21f-5ee5-4bfb-abea-328ad7615577 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:15.021443 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ad21f-5ee5-4bfb-abea-328ad7615577 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:15.023460 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 896/1787] 10.222.0.16 () {54 vars in 921 bytes} [Sun Sep 11 05:30:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:30:15.059200 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b0c505-e7ec-4ce2-a2a6-a2760dc0542c None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:15.060426 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b0c505-e7ec-4ce2-a2a6-a2760dc0542c None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:15.061004 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b0c505-e7ec-4ce2-a2a6-a2760dc0542c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:15.099451 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b43a1a4-4a6a-4811-921d-59d4a1569315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:15.100148 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43a1a4-4a6a-4811-921d-59d4a1569315 admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:15.100480 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43a1a4-4a6a-4811-921d-59d4a1569315 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:15.100758 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43a1a4-4a6a-4811-921d-59d4a1569315 admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:15.101595 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b43a1a4-4a6a-4811-921d-59d4a1569315 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:15.103555 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b43a1a4-4a6a-4811-921d-59d4a1569315 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:15.115760 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-a0b0c505-e7ec-4ce2-a2a6-a2760dc0542c None None] MFA Rules not processed for user `6cd6136036bd467c946cae90d5c29263`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:30:15.121910 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-a0b0c505-e7ec-4ce2-a2a6-a2760dc0542c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:15.134164 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 892/1788] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:30:14 2022] GET /identity/v3/roles => generated 1420 bytes in 449 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:30:15.138840 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b43a1a4-4a6a-4811-921d-59d4a1569315 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:15.173104 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b43a1a4-4a6a-4811-921d-59d4a1569315 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:15.198133 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dbc646-9898-4474-821f-820ed4f9949a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:15.202751 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dbc646-9898-4474-821f-820ed4f9949a admin admin] REQUEST_METHOD: `PUT` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:15.203207 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dbc646-9898-4474-821f-820ed4f9949a admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:15.204189 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dbc646-9898-4474-821f-820ed4f9949a admin admin] PATH_INFO: `/v3/projects/83d282e9e8624d16bb34946f9e56b57e/users/30d34022ec6b471094f34f9d0c919ccc/roles/5b702713e40145b49e0b42abd0a5fba9` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:15.210390 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dbc646-9898-4474-821f-820ed4f9949a admin admin] RBAC: Authorizing `identity:create_grant(project_id=83d282e9e8624d16bb34946f9e56b57e, user_id=30d34022ec6b471094f34f9d0c919ccc, role_id=5b702713e40145b49e0b42abd0a5fba9)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:15.219909 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dbc646-9898-4474-821f-820ed4f9949a admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:15.245288 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 893/1789] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:30:15 2022] PUT /identity/v3/projects/83d282e9e8624d16bb34946f9e56b57e/users/30d34022ec6b471094f34f9d0c919ccc/roles/5b702713e40145b49e0b42abd0a5fba9 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 05:30:15.260032 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6e0e8c-26d6-4dbd-8575-e517136f9323 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:15.262434 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6e0e8c-26d6-4dbd-8575-e517136f9323 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:15.264823 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6e0e8c-26d6-4dbd-8575-e517136f9323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:15.337369 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-8a6e0e8c-26d6-4dbd-8575-e517136f9323 None None] MFA Rules not processed for user `30d34022ec6b471094f34f9d0c919ccc`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:30:15.338868 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-8a6e0e8c-26d6-4dbd-8575-e517136f9323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:15.373525 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 897/1790] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 11 05:30:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 05:30:15.490650 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:15.519265 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 894/1791] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:30:15 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:30:15.525362 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b0c505-e7ec-4ce2-a2a6-a2760dc0542c None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:15.528289 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-a0b0c505-e7ec-4ce2-a2a6-a2760dc0542c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:15.532040 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6e0e8c-26d6-4dbd-8575-e517136f9323 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:15.533512 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-8a6e0e8c-26d6-4dbd-8575-e517136f9323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:15.571025 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b0c505-e7ec-4ce2-a2a6-a2760dc0542c None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:15.703755 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6e0e8c-26d6-4dbd-8575-e517136f9323 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:15.704942 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:15.716980 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a111cc6d-50af-431c-858c-e633d20c3bf4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a147e14b61d481db1cac02c58ac3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:15.717745 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a111cc6d-50af-431c-858c-e633d20c3bf4 service cinder] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:15.718228 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a111cc6d-50af-431c-858c-e633d20c3bf4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:15.719747 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a111cc6d-50af-431c-858c-e633d20c3bf4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:15.730013 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070e3091-c65f-4528-a324-2299f8a5d2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:15.730779 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e3091-c65f-4528-a324-2299f8a5d2d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:15.731057 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e3091-c65f-4528-a324-2299f8a5d2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:15.731335 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e3091-c65f-4528-a324-2299f8a5d2d4 admin admin] PATH_INFO: `/v3/projects/0a2220665a7645cca4b167a732a5da34` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:15.732748 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070e3091-c65f-4528-a324-2299f8a5d2d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a2220665a7645cca4b167a732a5da34)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:15.736043 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070e3091-c65f-4528-a324-2299f8a5d2d4 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:15.752491 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a111cc6d-50af-431c-858c-e633d20c3bf4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:15.754979 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a111cc6d-50af-431c-858c-e633d20c3bf4 service cinder] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:15.796204 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 895/1792] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:30:15 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 05:30:15.799021 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a111cc6d-50af-431c-858c-e633d20c3bf4 service cinder] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:15.801970 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-a111cc6d-50af-431c-858c-e633d20c3bf4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:15.857370 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a111cc6d-50af-431c-858c-e633d20c3bf4 service cinder] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:15.881528 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-070e3091-c65f-4528-a324-2299f8a5d2d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a2220665a7645cca4b167a732a5da34', 'request_id': 'req-070e3091-c65f-4528-a324-2299f8a5d2d4'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:15.898276 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-070e3091-c65f-4528-a324-2299f8a5d2d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a2220665a7645cca4b167a732a5da34', 'request_id': 'req-070e3091-c65f-4528-a324-2299f8a5d2d4'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:15.916772 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-070e3091-c65f-4528-a324-2299f8a5d2d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a2220665a7645cca4b167a732a5da34', 'request_id': 'req-070e3091-c65f-4528-a324-2299f8a5d2d4'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:15.949752 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-070e3091-c65f-4528-a324-2299f8a5d2d4 admin admin] The token cache is being invalidate because project 0a2220665a7645cca4b167a732a5da34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:30:15.950206 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-070e3091-c65f-4528-a324-2299f8a5d2d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:15.950791 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-070e3091-c65f-4528-a324-2299f8a5d2d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:15.955259 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 898/1793] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:30:15 2022] DELETE /identity/v3/projects/0a2220665a7645cca4b167a732a5da34 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:30:15.959630 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070e3091-c65f-4528-a324-2299f8a5d2d4 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:15.970274 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-070e3091-c65f-4528-a324-2299f8a5d2d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:16.044457 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91292d2-35c3-4942-b0eb-05e93b7d05b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:16.045644 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91292d2-35c3-4942-b0eb-05e93b7d05b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:16.049865 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91292d2-35c3-4942-b0eb-05e93b7d05b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:16.050290 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91292d2-35c3-4942-b0eb-05e93b7d05b9 admin admin] PATH_INFO: `/v3/projects/5249bd6756ca43ff91501f3f7a41c22c` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:16.052360 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91292d2-35c3-4942-b0eb-05e93b7d05b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5249bd6756ca43ff91501f3f7a41c22c)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:16.058225 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91292d2-35c3-4942-b0eb-05e93b7d05b9 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:16.173675 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070e3091-c65f-4528-a324-2299f8a5d2d4 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:16.196600 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-f91292d2-35c3-4942-b0eb-05e93b7d05b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5249bd6756ca43ff91501f3f7a41c22c', 'request_id': 'req-f91292d2-35c3-4942-b0eb-05e93b7d05b9'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:16.270690 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-f91292d2-35c3-4942-b0eb-05e93b7d05b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5249bd6756ca43ff91501f3f7a41c22c', 'request_id': 'req-f91292d2-35c3-4942-b0eb-05e93b7d05b9'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:16.283720 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-f91292d2-35c3-4942-b0eb-05e93b7d05b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5249bd6756ca43ff91501f3f7a41c22c', 'request_id': 'req-f91292d2-35c3-4942-b0eb-05e93b7d05b9'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:16.303698 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-f91292d2-35c3-4942-b0eb-05e93b7d05b9 admin admin] The token cache is being invalidate because project 5249bd6756ca43ff91501f3f7a41c22c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81383) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:30:16.304151 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-f91292d2-35c3-4942-b0eb-05e93b7d05b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:16.304926 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-f91292d2-35c3-4942-b0eb-05e93b7d05b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:16.306604 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 896/1794] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:30:15 2022] DELETE /identity/v3/projects/5249bd6756ca43ff91501f3f7a41c22c => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:30:16.320811 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c803a155-ff70-46ef-a0da-1067eb6b0504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:16.321518 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91292d2-35c3-4942-b0eb-05e93b7d05b9 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:16.322097 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c803a155-ff70-46ef-a0da-1067eb6b0504 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:16.322727 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c803a155-ff70-46ef-a0da-1067eb6b0504 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:16.323196 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c803a155-ff70-46ef-a0da-1067eb6b0504 admin admin] PATH_INFO: `/v3/users/7dd6776038e649d89f189a42e116e859` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:16.323432 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-f91292d2-35c3-4942-b0eb-05e93b7d05b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:16.325152 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c803a155-ff70-46ef-a0da-1067eb6b0504 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dd6776038e649d89f189a42e116e859)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:16.327586 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c803a155-ff70-46ef-a0da-1067eb6b0504 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:16.397610 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:16.403410 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:16.472103 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91292d2-35c3-4942-b0eb-05e93b7d05b9 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:16.477816 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b9cd3d-c9d1-4875-abf0-ea0a262ac3b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a147e14b61d481db1cac02c58ac3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:16.478608 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9cd3d-c9d1-4875-abf0-ea0a262ac3b2 service cinder] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:16.478889 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9cd3d-c9d1-4875-abf0-ea0a262ac3b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:16.479625 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9cd3d-c9d1-4875-abf0-ea0a262ac3b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:16.479923 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-c803a155-ff70-46ef-a0da-1067eb6b0504 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dd6776038e649d89f189a42e116e859'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:16.483593 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-46b9cd3d-c9d1-4875-abf0-ea0a262ac3b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:16.509274 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-c803a155-ff70-46ef-a0da-1067eb6b0504 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dd6776038e649d89f189a42e116e859'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:16.541046 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-c803a155-ff70-46ef-a0da-1067eb6b0504 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dd6776038e649d89f189a42e116e859'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:16.561823 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-c803a155-ff70-46ef-a0da-1067eb6b0504 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dd6776038e649d89f189a42e116e859'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:16.565352 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-c803a155-ff70-46ef-a0da-1067eb6b0504 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dd6776038e649d89f189a42e116e859'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:16.568666 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b9cd3d-c9d1-4875-abf0-ea0a262ac3b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:16.570116 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b9cd3d-c9d1-4875-abf0-ea0a262ac3b2 service cinder] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:16.606265 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 899/1795] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:30:15 2022] DELETE /identity/v3/users/7dd6776038e649d89f189a42e116e859 => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:30:16.607355 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c803a155-ff70-46ef-a0da-1067eb6b0504 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:16.607936 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 897/1796] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:30:16 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:30:16.610005 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-c803a155-ff70-46ef-a0da-1067eb6b0504 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:16.611001 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b9cd3d-c9d1-4875-abf0-ea0a262ac3b2 service cinder] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:16.616542 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-46b9cd3d-c9d1-4875-abf0-ea0a262ac3b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:16.669258 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b9cd3d-c9d1-4875-abf0-ea0a262ac3b2 service cinder] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:16.729137 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c803a155-ff70-46ef-a0da-1067eb6b0504 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:16.744559 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479e52fe-a325-4dd9-b251-c56fb4aca628 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cd6136036bd467c946cae90d5c29263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:16.745310 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479e52fe-a325-4dd9-b251-c56fb4aca628 service nova] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:16.747580 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479e52fe-a325-4dd9-b251-c56fb4aca628 service nova] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:16.747911 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479e52fe-a325-4dd9-b251-c56fb4aca628 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:16.759243 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-479e52fe-a325-4dd9-b251-c56fb4aca628 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:16.805776 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479e52fe-a325-4dd9-b251-c56fb4aca628 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:16.809203 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479e52fe-a325-4dd9-b251-c56fb4aca628 service nova] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:16.844027 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 900/1797] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:30:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:30:16.891428 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b87efe-9ce2-4c84-b964-b0e3ef918bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:16.892385 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b87efe-9ce2-4c84-b964-b0e3ef918bc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:16.892892 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b87efe-9ce2-4c84-b964-b0e3ef918bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:16.893385 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b87efe-9ce2-4c84-b964-b0e3ef918bc1 admin admin] PATH_INFO: `/v3/users/c0a25dbf870e4b28ac5d4d921ca99ce7` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:16.897111 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b87efe-9ce2-4c84-b964-b0e3ef918bc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0a25dbf870e4b28ac5d4d921ca99ce7)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:16.899625 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b87efe-9ce2-4c84-b964-b0e3ef918bc1 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:17.049199 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-63b87efe-9ce2-4c84-b964-b0e3ef918bc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0a25dbf870e4b28ac5d4d921ca99ce7'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:17.078235 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-63b87efe-9ce2-4c84-b964-b0e3ef918bc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0a25dbf870e4b28ac5d4d921ca99ce7'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:17.089314 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-63b87efe-9ce2-4c84-b964-b0e3ef918bc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0a25dbf870e4b28ac5d4d921ca99ce7'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:17.107916 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-63b87efe-9ce2-4c84-b964-b0e3ef918bc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0a25dbf870e4b28ac5d4d921ca99ce7'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:17.108696 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-63b87efe-9ce2-4c84-b964-b0e3ef918bc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0a25dbf870e4b28ac5d4d921ca99ce7'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:17.123506 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 898/1798] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:30:16 2022] DELETE /identity/v3/users/c0a25dbf870e4b28ac5d4d921ca99ce7 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:30:17.828343 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479e52fe-a325-4dd9-b251-c56fb4aca628 service nova] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:17.829797 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-479e52fe-a325-4dd9-b251-c56fb4aca628 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:17.855256 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479e52fe-a325-4dd9-b251-c56fb4aca628 service nova] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:18.060799 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cd686a-a9d1-4058-9035-a95022b4bccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:18.062779 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cd686a-a9d1-4058-9035-a95022b4bccf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:18.063221 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cd686a-a9d1-4058-9035-a95022b4bccf admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:18.063605 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cd686a-a9d1-4058-9035-a95022b4bccf admin admin] PATH_INFO: `/v3/projects/9a9a55191e74486a8698e0c641915712` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:18.066111 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cd686a-a9d1-4058-9035-a95022b4bccf admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a9a55191e74486a8698e0c641915712)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:18.070928 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cd686a-a9d1-4058-9035-a95022b4bccf admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:18.156819 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:18.248504 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-92cd686a-a9d1-4058-9035-a95022b4bccf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a9a55191e74486a8698e0c641915712', 'request_id': 'req-92cd686a-a9d1-4058-9035-a95022b4bccf'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:18.284879 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-92cd686a-a9d1-4058-9035-a95022b4bccf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a9a55191e74486a8698e0c641915712', 'request_id': 'req-92cd686a-a9d1-4058-9035-a95022b4bccf'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:18.330201 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-92cd686a-a9d1-4058-9035-a95022b4bccf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a9a55191e74486a8698e0c641915712', 'request_id': 'req-92cd686a-a9d1-4058-9035-a95022b4bccf'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:18.380849 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b87efe-9ce2-4c84-b964-b0e3ef918bc1 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:18.382322 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-63b87efe-9ce2-4c84-b964-b0e3ef918bc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:18.403827 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-92cd686a-a9d1-4058-9035-a95022b4bccf admin admin] The token cache is being invalidate because project 9a9a55191e74486a8698e0c641915712 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:30:18.404295 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-92cd686a-a9d1-4058-9035-a95022b4bccf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:18.405152 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-92cd686a-a9d1-4058-9035-a95022b4bccf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:18.410608 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 901/1799] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:30:17 2022] DELETE /identity/v3/projects/9a9a55191e74486a8698e0c641915712 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:30:18.414784 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:18.417242 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc50cc2-91ce-4638-a64a-f696ea0d1b3a None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:18.418878 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc50cc2-91ce-4638-a64a-f696ea0d1b3a None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:18.420699 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc50cc2-91ce-4638-a64a-f696ea0d1b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:18.426935 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b87efe-9ce2-4c84-b964-b0e3ef918bc1 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:18.535944 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-fbc50cc2-91ce-4638-a64a-f696ea0d1b3a None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:30:18.544611 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-fbc50cc2-91ce-4638-a64a-f696ea0d1b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:18.584675 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd1610b-11fc-49ed-a882-7c8cdb23b82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:18.585346 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd1610b-11fc-49ed-a882-7c8cdb23b82d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:18.585633 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd1610b-11fc-49ed-a882-7c8cdb23b82d admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:18.585912 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd1610b-11fc-49ed-a882-7c8cdb23b82d admin admin] PATH_INFO: `/v3/projects/3d42d03386e3418ab7f43681e3782b81` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:18.587143 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd1610b-11fc-49ed-a882-7c8cdb23b82d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d42d03386e3418ab7f43681e3782b81)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:18.589115 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd1610b-11fc-49ed-a882-7c8cdb23b82d admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:18.798959 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-6cd1610b-11fc-49ed-a882-7c8cdb23b82d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d42d03386e3418ab7f43681e3782b81', 'request_id': 'req-6cd1610b-11fc-49ed-a882-7c8cdb23b82d'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:18.817810 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-6cd1610b-11fc-49ed-a882-7c8cdb23b82d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d42d03386e3418ab7f43681e3782b81', 'request_id': 'req-6cd1610b-11fc-49ed-a882-7c8cdb23b82d'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:18.828914 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-6cd1610b-11fc-49ed-a882-7c8cdb23b82d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d42d03386e3418ab7f43681e3782b81', 'request_id': 'req-6cd1610b-11fc-49ed-a882-7c8cdb23b82d'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:18.857352 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-6cd1610b-11fc-49ed-a882-7c8cdb23b82d admin admin] The token cache is being invalidate because project 3d42d03386e3418ab7f43681e3782b81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81383) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:30:18.857656 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-6cd1610b-11fc-49ed-a882-7c8cdb23b82d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:18.858884 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 902/1800] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:30:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 444 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:30:18.860074 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-6cd1610b-11fc-49ed-a882-7c8cdb23b82d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:18.861979 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd2a02-db1d-4523-aec4-4d42e2269151 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:18.865568 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 899/1801] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:30:18 2022] DELETE /identity/v3/projects/3d42d03386e3418ab7f43681e3782b81 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 05:30:18.865726 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd2a02-db1d-4523-aec4-4d42e2269151 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:18.865919 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd2a02-db1d-4523-aec4-4d42e2269151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:18.867046 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e043016-be8a-4573-9628-0357c61de967 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:18.867330 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e043016-be8a-4573-9628-0357c61de967 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:18.867798 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e043016-be8a-4573-9628-0357c61de967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:18.916208 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-4e043016-be8a-4573-9628-0357c61de967 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:30:18.917452 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-4e043016-be8a-4573-9628-0357c61de967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:18.927644 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-40fd2a02-db1d-4523-aec4-4d42e2269151 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:30:18.928942 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-40fd2a02-db1d-4523-aec4-4d42e2269151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:19.164377 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 900/1802] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:30:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:30:19.166169 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d759928f-65a4-4a3b-acae-3767ba8836c3 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:19.166478 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d759928f-65a4-4a3b-acae-3767ba8836c3 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:19.166730 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d759928f-65a4-4a3b-acae-3767ba8836c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:19.185030 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 903/1803] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:30:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:30:19.190253 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fd2a02-db1d-4523-aec4-4d42e2269151 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:19.243957 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fd2a02-db1d-4523-aec4-4d42e2269151 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:19.266581 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-d759928f-65a4-4a3b-acae-3767ba8836c3 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:30:19.267880 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-d759928f-65a4-4a3b-acae-3767ba8836c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:19.276533 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e598fd94-b686-473b-89b2-03b8c5b246a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:19.277862 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e598fd94-b686-473b-89b2-03b8c5b246a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:19.278112 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e598fd94-b686-473b-89b2-03b8c5b246a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:19.278429 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e598fd94-b686-473b-89b2-03b8c5b246a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:19.279244 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e598fd94-b686-473b-89b2-03b8c5b246a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:30:19.279610 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e598fd94-b686-473b-89b2-03b8c5b246a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:19.281269 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e598fd94-b686-473b-89b2-03b8c5b246a1 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:19.293661 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 901/1804] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:30:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:30:19.306959 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d759928f-65a4-4a3b-acae-3767ba8836c3 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:19.320610 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d759928f-65a4-4a3b-acae-3767ba8836c3 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:19.329133 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2810d576-5e03-48fd-abe7-55c96b4d124e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:19.330424 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2810d576-5e03-48fd-abe7-55c96b4d124e admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:19.330424 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2810d576-5e03-48fd-abe7-55c96b4d124e admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:19.330704 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2810d576-5e03-48fd-abe7-55c96b4d124e admin admin] PATH_INFO: `/v3/domains` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:19.331398 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 904/1805] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 05:30:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:30:19.332365 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e598fd94-b686-473b-89b2-03b8c5b246a1 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:19.332527 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2810d576-5e03-48fd-abe7-55c96b4d124e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:30:19.333077 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2810d576-5e03-48fd-abe7-55c96b4d124e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:19.334937 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2810d576-5e03-48fd-abe7-55c96b4d124e admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:19.345011 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e598fd94-b686-473b-89b2-03b8c5b246a1 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:19.352221 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f140a3f9-bca5-43ca-925e-beb3c66ed58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:19.352849 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f140a3f9-bca5-43ca-925e-beb3c66ed58b admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:19.353135 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f140a3f9-bca5-43ca-925e-beb3c66ed58b admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:19.353410 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f140a3f9-bca5-43ca-925e-beb3c66ed58b admin admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:19.357972 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f140a3f9-bca5-43ca-925e-beb3c66ed58b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:19.359976 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f140a3f9-bca5-43ca-925e-beb3c66ed58b admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:19.367441 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 902/1806] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 05:30:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:30:19.373539 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2810d576-5e03-48fd-abe7-55c96b4d124e admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:19.412236 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 905/1807] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:30:19 2022] POST /identity/v3/projects => generated 387 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:30:19.412745 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2810d576-5e03-48fd-abe7-55c96b4d124e admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:19.415040 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f140a3f9-bca5-43ca-925e-beb3c66ed58b admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:19.442909 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:19.458370 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:19.522283 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f140a3f9-bca5-43ca-925e-beb3c66ed58b admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:19.529471 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8e7a19-cf18-4b1a-b24c-bb3c4b302089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:19.530416 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6167f127-8126-433b-8670-d8758d360c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:19.531244 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e7a19-cf18-4b1a-b24c-bb3c4b302089 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:19.531244 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e7a19-cf18-4b1a-b24c-bb3c4b302089 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:19.531454 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6167f127-8126-433b-8670-d8758d360c7a admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:19.531548 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e7a19-cf18-4b1a-b24c-bb3c4b302089 admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:19.531651 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6167f127-8126-433b-8670-d8758d360c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:19.532052 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6167f127-8126-433b-8670-d8758d360c7a admin admin] PATH_INFO: `/v3/projects` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:19.532462 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8e7a19-cf18-4b1a-b24c-bb3c4b302089 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:19.533428 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6167f127-8126-433b-8670-d8758d360c7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:19.536230 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8e7a19-cf18-4b1a-b24c-bb3c4b302089 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:19.540130 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6167f127-8126-433b-8670-d8758d360c7a admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:19.566724 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 906/1808] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:30:19 2022] POST /identity/v3/users => generated 294 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:30:19.568114 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b70ab-004e-4ce2-8050-d9b9e32d6a0f None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:19.568366 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b70ab-004e-4ce2-8050-d9b9e32d6a0f None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:19.568646 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b70ab-004e-4ce2-8050-d9b9e32d6a0f None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:19.571272 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 907/1809] 10.222.0.16 () {54 vars in 921 bytes} [Sun Sep 11 05:30:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:30:19.571272 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b70ab-004e-4ce2-8050-d9b9e32d6a0f None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:19.584134 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 903/1810] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:30:19 2022] POST /identity/v3/projects => generated 399 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:30:19.586661 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a75863d-0c2d-4e82-9b06-ca9a7a88e07a None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:19.587630 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a75863d-0c2d-4e82-9b06-ca9a7a88e07a None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:19.588278 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a75863d-0c2d-4e82-9b06-ca9a7a88e07a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:19.590713 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b70ab-004e-4ce2-8050-d9b9e32d6a0f None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:19.617158 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-3a75863d-0c2d-4e82-9b06-ca9a7a88e07a None None] MFA Rules not processed for user `6cd6136036bd467c946cae90d5c29263`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:30:19.618618 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-3a75863d-0c2d-4e82-9b06-ca9a7a88e07a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:19.673070 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bf0ecf-1f10-4af3-b3a1-5c5ea278dfd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:19.673873 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf0ecf-1f10-4af3-b3a1-5c5ea278dfd2 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:19.674324 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf0ecf-1f10-4af3-b3a1-5c5ea278dfd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:19.674769 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf0ecf-1f10-4af3-b3a1-5c5ea278dfd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:19.676260 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bf0ecf-1f10-4af3-b3a1-5c5ea278dfd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:19.677951 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bf0ecf-1f10-4af3-b3a1-5c5ea278dfd2 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:19.702849 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 908/1811] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:30:19 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:30:19.704283 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bf0ecf-1f10-4af3-b3a1-5c5ea278dfd2 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:19.720277 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bf0ecf-1f10-4af3-b3a1-5c5ea278dfd2 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:19.726355 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91696a69-7923-4468-bb57-9a5f563304e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:19.727032 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91696a69-7923-4468-bb57-9a5f563304e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:19.727170 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91696a69-7923-4468-bb57-9a5f563304e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:19.727463 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91696a69-7923-4468-bb57-9a5f563304e7 admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:19.728267 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91696a69-7923-4468-bb57-9a5f563304e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:19.730215 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91696a69-7923-4468-bb57-9a5f563304e7 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:19.796278 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 909/1812] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:30:19 2022] POST /identity/v3/users => generated 300 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:30:19.796278 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91696a69-7923-4468-bb57-9a5f563304e7 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:19.804761 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 904/1813] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 11 05:30:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:30:19.807422 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a75863d-0c2d-4e82-9b06-ca9a7a88e07a None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:19.809752 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91696a69-7923-4468-bb57-9a5f563304e7 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:19.816693 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcf5b38-118d-4858-9c64-c0208083f8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:19.817605 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf5b38-118d-4858-9c64-c0208083f8ab admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:19.817930 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf5b38-118d-4858-9c64-c0208083f8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:19.818306 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf5b38-118d-4858-9c64-c0208083f8ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:19.819066 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcf5b38-118d-4858-9c64-c0208083f8ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:19.820968 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcf5b38-118d-4858-9c64-c0208083f8ab admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:19.832151 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a75863d-0c2d-4e82-9b06-ca9a7a88e07a None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:19.850983 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e2737c-bddb-467b-b135-7088c99e4744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:19.851792 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2737c-bddb-467b-b135-7088c99e4744 admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:19.852084 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2737c-bddb-467b-b135-7088c99e4744 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:19.852366 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2737c-bddb-467b-b135-7088c99e4744 admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:19.853029 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e2737c-bddb-467b-b135-7088c99e4744 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:19.854665 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e2737c-bddb-467b-b135-7088c99e4744 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:19.857232 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 910/1814] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:30:19 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:30:19.864026 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcf5b38-118d-4858-9c64-c0208083f8ab admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:19.878908 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 905/1815] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:30:19 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:30:19.886259 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e2737c-bddb-467b-b135-7088c99e4744 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:19.895046 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcf5b38-118d-4858-9c64-c0208083f8ab admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:19.901558 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73bfcf0-e9f2-4531-9008-13e0c9f2f034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:19.903408 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73bfcf0-e9f2-4531-9008-13e0c9f2f034 admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:19.904036 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73bfcf0-e9f2-4531-9008-13e0c9f2f034 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:19.904703 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73bfcf0-e9f2-4531-9008-13e0c9f2f034 admin admin] PATH_INFO: `/v3/projects/71138670240147a4ac0a353bbdf20992/users/ac4bc5ee5f83434abfcfc69671f36a54/roles/aa7ff8e0ec1e48e5811335b9eb38b448` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:19.905874 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-81e2737c-bddb-467b-b135-7088c99e4744 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:19.926565 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73bfcf0-e9f2-4531-9008-13e0c9f2f034 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71138670240147a4ac0a353bbdf20992, user_id=ac4bc5ee5f83434abfcfc69671f36a54, role_id=aa7ff8e0ec1e48e5811335b9eb38b448)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:19.929808 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73bfcf0-e9f2-4531-9008-13e0c9f2f034 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:19.938763 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e2737c-bddb-467b-b135-7088c99e4744 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:19.946581 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef7882b-c4a6-4c00-bc17-ee99205b86dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cd6136036bd467c946cae90d5c29263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:19.956243 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef7882b-c4a6-4c00-bc17-ee99205b86dc service nova] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:19.956851 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef7882b-c4a6-4c00-bc17-ee99205b86dc service nova] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:19.957215 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef7882b-c4a6-4c00-bc17-ee99205b86dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:19.963546 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 911/1816] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:30:19 2022] PUT /identity/v3/projects/71138670240147a4ac0a353bbdf20992/users/ac4bc5ee5f83434abfcfc69671f36a54/roles/aa7ff8e0ec1e48e5811335b9eb38b448 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:30:19.964260 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73bfcf0-e9f2-4531-9008-13e0c9f2f034 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:19.978093 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef7882b-c4a6-4c00-bc17-ee99205b86dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:19.980219 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef7882b-c4a6-4c00-bc17-ee99205b86dc service nova] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:19.995605 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 906/1817] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:30:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:30:20.015569 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda2962-d241-4e54-9584-8dada1a007bd None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:20.015569 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda2962-d241-4e54-9584-8dada1a007bd None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:20.015569 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda2962-d241-4e54-9584-8dada1a007bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:20.050127 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:20.055418 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73bfcf0-e9f2-4531-9008-13e0c9f2f034 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:20.066390 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6cd528-078b-47bd-acf3-e1951c49b65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:20.068374 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6cd528-078b-47bd-acf3-e1951c49b65f admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:20.068681 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6cd528-078b-47bd-acf3-e1951c49b65f admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:20.069031 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6cd528-078b-47bd-acf3-e1951c49b65f admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:20.070223 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6cd528-078b-47bd-acf3-e1951c49b65f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:20.073122 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6cd528-078b-47bd-acf3-e1951c49b65f admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:20.092462 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-acda2962-d241-4e54-9584-8dada1a007bd None None] MFA Rules not processed for user `ac4bc5ee5f83434abfcfc69671f36a54`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:30:20.094512 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-acda2962-d241-4e54-9584-8dada1a007bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:20.108466 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 912/1818] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:30:19 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:30:20.110258 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6cd528-078b-47bd-acf3-e1951c49b65f admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:20.125484 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6cd528-078b-47bd-acf3-e1951c49b65f admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:20.132078 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe4b127-d5ad-46fd-873a-ee7e4dc63419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:20.132922 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4b127-d5ad-46fd-873a-ee7e4dc63419 admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:20.133976 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4b127-d5ad-46fd-873a-ee7e4dc63419 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:20.134512 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4b127-d5ad-46fd-873a-ee7e4dc63419 admin admin] PATH_INFO: `/v3/projects/30274f77370d4b9bbe1883eeae0a00b2/users/99b370249494460a8a228c8a417c3c01/roles/aa7ff8e0ec1e48e5811335b9eb38b448` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:20.157990 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe4b127-d5ad-46fd-873a-ee7e4dc63419 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30274f77370d4b9bbe1883eeae0a00b2, user_id=99b370249494460a8a228c8a417c3c01, role_id=aa7ff8e0ec1e48e5811335b9eb38b448)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:20.168598 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe4b127-d5ad-46fd-873a-ee7e4dc63419 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:20.199874 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 913/1819] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:30:20 2022] PUT /identity/v3/projects/30274f77370d4b9bbe1883eeae0a00b2/users/99b370249494460a8a228c8a417c3c01/roles/aa7ff8e0ec1e48e5811335b9eb38b448 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 05:30:20.201578 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5854c324-d134-47f2-8d2c-7972ec0dcae8 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:20.201861 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5854c324-d134-47f2-8d2c-7972ec0dcae8 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:20.202279 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5854c324-d134-47f2-8d2c-7972ec0dcae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:20.218590 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:20.228075 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 907/1820] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:30:19 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:30:20.232201 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda2962-d241-4e54-9584-8dada1a007bd None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:20.241654 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-5854c324-d134-47f2-8d2c-7972ec0dcae8 None None] MFA Rules not processed for user `99b370249494460a8a228c8a417c3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:30:20.242980 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-5854c324-d134-47f2-8d2c-7972ec0dcae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:20.247909 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda2962-d241-4e54-9584-8dada1a007bd None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:20.330367 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3278db40-e564-492c-ac10-dc5b303660fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:20.331389 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3278db40-e564-492c-ac10-dc5b303660fe admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:20.331767 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3278db40-e564-492c-ac10-dc5b303660fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:20.332339 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3278db40-e564-492c-ac10-dc5b303660fe admin admin] PATH_INFO: `/v3/projects` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:20.333047 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3278db40-e564-492c-ac10-dc5b303660fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:20.335700 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3278db40-e564-492c-ac10-dc5b303660fe admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:20.367754 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 914/1821] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:30:20 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:30:20.368988 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5854c324-d134-47f2-8d2c-7972ec0dcae8 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:20.376629 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 908/1822] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:30:20 2022] POST /identity/v3/projects => generated 387 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:30:20.380581 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3278db40-e564-492c-ac10-dc5b303660fe admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:20.391519 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5854c324-d134-47f2-8d2c-7972ec0dcae8 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:20.477459 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bb77a2-4563-4449-9c30-d9171a919feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:20.478422 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb77a2-4563-4449-9c30-d9171a919feb admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:20.478422 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb77a2-4563-4449-9c30-d9171a919feb admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:20.478677 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb77a2-4563-4449-9c30-d9171a919feb admin admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:20.481299 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bb77a2-4563-4449-9c30-d9171a919feb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:20.483563 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bb77a2-4563-4449-9c30-d9171a919feb admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:20.519928 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 915/1823] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:30:20 2022] POST /identity/v3/projects => generated 399 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:30:20.521022 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bb77a2-4563-4449-9c30-d9171a919feb admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:20.524109 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-50bb77a2-4563-4449-9c30-d9171a919feb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:20.527775 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3278db40-e564-492c-ac10-dc5b303660fe admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:20.618809 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:20.637541 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db819e74-7c13-4279-93fe-595d0567e51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:20.638173 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db819e74-7c13-4279-93fe-595d0567e51b admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:20.638453 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db819e74-7c13-4279-93fe-595d0567e51b admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:20.638934 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db819e74-7c13-4279-93fe-595d0567e51b admin admin] PATH_INFO: `/v3/users` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:20.639673 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db819e74-7c13-4279-93fe-595d0567e51b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:20.643308 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db819e74-7c13-4279-93fe-595d0567e51b admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:20.645365 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bb77a2-4563-4449-9c30-d9171a919feb admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:20.650658 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947d2c19-0386-49f7-9156-6624e216490a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:20.651638 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d2c19-0386-49f7-9156-6624e216490a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:20.652020 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d2c19-0386-49f7-9156-6624e216490a admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:20.652921 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d2c19-0386-49f7-9156-6624e216490a admin admin] PATH_INFO: `/v3/users/eb6d71febb3b4f4fa7b3293f1570803b` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:20.659396 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947d2c19-0386-49f7-9156-6624e216490a admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb6d71febb3b4f4fa7b3293f1570803b)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:20.662204 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947d2c19-0386-49f7-9156-6624e216490a admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:20.681601 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 909/1824] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:30:20 2022] POST /identity/v3/users => generated 300 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:30:20.688741 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db819e74-7c13-4279-93fe-595d0567e51b admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:20.718344 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db819e74-7c13-4279-93fe-595d0567e51b admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:20.732216 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8dbb84-0bd6-461e-a61c-00639b38c9a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:20.733398 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8dbb84-0bd6-461e-a61c-00639b38c9a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:20.735067 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8dbb84-0bd6-461e-a61c-00639b38c9a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:20.735662 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8dbb84-0bd6-461e-a61c-00639b38c9a2 admin admin] PATH_INFO: `/v3/users` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:20.737986 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8dbb84-0bd6-461e-a61c-00639b38c9a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:20.745016 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8dbb84-0bd6-461e-a61c-00639b38c9a2 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:20.767991 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-947d2c19-0386-49f7-9156-6624e216490a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb6d71febb3b4f4fa7b3293f1570803b'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:20.794071 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 910/1825] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:30:20 2022] POST /identity/v3/users => generated 306 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:30:20.795567 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8dbb84-0bd6-461e-a61c-00639b38c9a2 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:20.801808 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-947d2c19-0386-49f7-9156-6624e216490a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb6d71febb3b4f4fa7b3293f1570803b'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:20.807464 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:20.814540 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-947d2c19-0386-49f7-9156-6624e216490a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb6d71febb3b4f4fa7b3293f1570803b'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:20.824728 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-947d2c19-0386-49f7-9156-6624e216490a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb6d71febb3b4f4fa7b3293f1570803b'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:20.825496 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-947d2c19-0386-49f7-9156-6624e216490a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb6d71febb3b4f4fa7b3293f1570803b'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:20.836456 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8dbb84-0bd6-461e-a61c-00639b38c9a2 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:20.858380 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 916/1826] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:30:20 2022] DELETE /identity/v3/users/eb6d71febb3b4f4fa7b3293f1570803b => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:30:20.858380 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947d2c19-0386-49f7-9156-6624e216490a admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:20.860633 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-947d2c19-0386-49f7-9156-6624e216490a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:20.925594 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7292d7d-70b4-43ac-9d8d-cd55fb98b7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:20.926439 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7292d7d-70b4-43ac-9d8d-cd55fb98b7a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:20.926972 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7292d7d-70b4-43ac-9d8d-cd55fb98b7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:20.927346 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7292d7d-70b4-43ac-9d8d-cd55fb98b7a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:20.928375 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7292d7d-70b4-43ac-9d8d-cd55fb98b7a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:20.931059 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7292d7d-70b4-43ac-9d8d-cd55fb98b7a8 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:20.974129 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947d2c19-0386-49f7-9156-6624e216490a admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:20.975841 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 911/1827] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:30:20 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:30:20.978593 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d60fca-d96f-43da-999e-75c5e0ce575c None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:20.980177 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f8932e-95a3-4982-b685-adbae03aca25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:20.981100 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d60fca-d96f-43da-999e-75c5e0ce575c None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:20.981431 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f8932e-95a3-4982-b685-adbae03aca25 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:20.981717 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f8932e-95a3-4982-b685-adbae03aca25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:20.981994 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f8932e-95a3-4982-b685-adbae03aca25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:20.982377 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d60fca-d96f-43da-999e-75c5e0ce575c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:20.982658 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f8932e-95a3-4982-b685-adbae03aca25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:20.984614 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f8932e-95a3-4982-b685-adbae03aca25 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:21.003836 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 917/1828] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:30:20 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:30:21.003836 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f8932e-95a3-4982-b685-adbae03aca25 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:21.004382 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-12f8932e-95a3-4982-b685-adbae03aca25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:21.016587 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-28d60fca-d96f-43da-999e-75c5e0ce575c None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:30:21.017929 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-28d60fca-d96f-43da-999e-75c5e0ce575c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:21.031817 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 912/1829] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:30:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:30:21.031817 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d60fca-d96f-43da-999e-75c5e0ce575c None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:21.050597 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f8932e-95a3-4982-b685-adbae03aca25 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:21.056517 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4c7ae2-9c16-4a62-a51c-a8b1ce09451b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:21.058497 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c7ae2-9c16-4a62-a51c-a8b1ce09451b admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:21.058834 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c7ae2-9c16-4a62-a51c-a8b1ce09451b admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:21.059182 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c7ae2-9c16-4a62-a51c-a8b1ce09451b admin admin] PATH_INFO: `/v3/projects/1747773b0c044a119113ce0df11b0549/users/8d80845ff61c4cb4976c4abcd52b8405/roles/5b702713e40145b49e0b42abd0a5fba9` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:21.059920 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d60fca-d96f-43da-999e-75c5e0ce575c None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:21.066668 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b84180-d8ff-4d04-adf2-98dc6c71a7f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:21.067925 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b84180-d8ff-4d04-adf2-98dc6c71a7f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:21.068215 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b84180-d8ff-4d04-adf2-98dc6c71a7f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:21.068498 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b84180-d8ff-4d04-adf2-98dc6c71a7f6 admin admin] PATH_INFO: `/v3/projects/d8c97bfd568047ffb0ce406ad9623226/users/98d6c7a299e84b57a8be0d316f567e4d/roles/5b702713e40145b49e0b42abd0a5fba9` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:21.083838 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4c7ae2-9c16-4a62-a51c-a8b1ce09451b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1747773b0c044a119113ce0df11b0549, user_id=8d80845ff61c4cb4976c4abcd52b8405, role_id=5b702713e40145b49e0b42abd0a5fba9)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:21.086360 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b84180-d8ff-4d04-adf2-98dc6c71a7f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8c97bfd568047ffb0ce406ad9623226, user_id=98d6c7a299e84b57a8be0d316f567e4d, role_id=5b702713e40145b49e0b42abd0a5fba9)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:21.087277 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4c7ae2-9c16-4a62-a51c-a8b1ce09451b admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:21.090475 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b84180-d8ff-4d04-adf2-98dc6c71a7f6 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:21.114204 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 913/1830] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:30:21 2022] PUT /identity/v3/projects/d8c97bfd568047ffb0ce406ad9623226/users/98d6c7a299e84b57a8be0d316f567e4d/roles/5b702713e40145b49e0b42abd0a5fba9 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:30:21.115601 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b84180-d8ff-4d04-adf2-98dc6c71a7f6 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:21.123176 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-f9b84180-d8ff-4d04-adf2-98dc6c71a7f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:21.128243 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 918/1831] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:30:21 2022] PUT /identity/v3/projects/1747773b0c044a119113ce0df11b0549/users/8d80845ff61c4cb4976c4abcd52b8405/roles/5b702713e40145b49e0b42abd0a5fba9 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:30:21.128243 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4c7ae2-9c16-4a62-a51c-a8b1ce09451b admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:21.171072 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:21.219997 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4c7ae2-9c16-4a62-a51c-a8b1ce09451b admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:21.222809 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b84180-d8ff-4d04-adf2-98dc6c71a7f6 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:21.226040 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b77118-86f1-450f-87c3-abc95c5c4ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:21.226980 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b77118-86f1-450f-87c3-abc95c5c4ca8 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:21.227502 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b77118-86f1-450f-87c3-abc95c5c4ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:21.227957 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b77118-86f1-450f-87c3-abc95c5c4ca8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:21.228907 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b77118-86f1-450f-87c3-abc95c5c4ca8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:21.240115 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b77118-86f1-450f-87c3-abc95c5c4ca8 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:21.258871 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 919/1832] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:30:21 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:30:21.260252 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b77118-86f1-450f-87c3-abc95c5c4ca8 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:21.272109 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b77118-86f1-450f-87c3-abc95c5c4ca8 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:21.277490 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74391eb-10a5-47d1-bd0b-165f82e23052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:21.278701 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74391eb-10a5-47d1-bd0b-165f82e23052 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:21.279344 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74391eb-10a5-47d1-bd0b-165f82e23052 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:21.279746 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74391eb-10a5-47d1-bd0b-165f82e23052 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:21.280507 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74391eb-10a5-47d1-bd0b-165f82e23052 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:21.282230 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74391eb-10a5-47d1-bd0b-165f82e23052 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:21.300930 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 920/1833] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:30:21 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:30:21.302227 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74391eb-10a5-47d1-bd0b-165f82e23052 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:21.314228 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6356f2d4-826c-420c-925b-d99c6584d969 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:21.314907 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6356f2d4-826c-420c-925b-d99c6584d969 service neutron] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:21.315182 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6356f2d4-826c-420c-925b-d99c6584d969 service neutron] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:21.315447 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6356f2d4-826c-420c-925b-d99c6584d969 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:21.327461 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74391eb-10a5-47d1-bd0b-165f82e23052 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:21.334135 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71fd7f0-73bb-4b6f-82ed-ead047550cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:21.335533 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71fd7f0-73bb-4b6f-82ed-ead047550cf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:21.336304 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6356f2d4-826c-420c-925b-d99c6584d969 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:21.336484 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71fd7f0-73bb-4b6f-82ed-ead047550cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:21.336914 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71fd7f0-73bb-4b6f-82ed-ead047550cf5 admin admin] PATH_INFO: `/v3/projects/d8c97bfd568047ffb0ce406ad9623226/users/98d6c7a299e84b57a8be0d316f567e4d/roles/5b702713e40145b49e0b42abd0a5fba9` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:21.340010 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71fd7f0-73bb-4b6f-82ed-ead047550cf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8c97bfd568047ffb0ce406ad9623226, user_id=98d6c7a299e84b57a8be0d316f567e4d, role_id=5b702713e40145b49e0b42abd0a5fba9)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:21.340758 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6356f2d4-826c-420c-925b-d99c6584d969 service neutron] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:21.342960 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71fd7f0-73bb-4b6f-82ed-ead047550cf5 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:21.355174 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 914/1834] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:30:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:30:21.358270 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6356f2d4-826c-420c-925b-d99c6584d969 service neutron] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:21.360547 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 921/1835] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:30:21 2022] PUT /identity/v3/projects/d8c97bfd568047ffb0ce406ad9623226/users/98d6c7a299e84b57a8be0d316f567e4d/roles/5b702713e40145b49e0b42abd0a5fba9 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:30:21.372216 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b08ec03-37be-4135-a89f-323eda927316 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:21.372399 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b08ec03-37be-4135-a89f-323eda927316 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:21.372624 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b08ec03-37be-4135-a89f-323eda927316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:21.374450 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6356f2d4-826c-420c-925b-d99c6584d969 service neutron] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:21.404706 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:21.417175 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-8b08ec03-37be-4135-a89f-323eda927316 None None] MFA Rules not processed for user `98d6c7a299e84b57a8be0d316f567e4d`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:30:21.419613 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-8b08ec03-37be-4135-a89f-323eda927316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:21.450451 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558aa844-8b7e-4bbd-b981-348c6240e7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:21.451425 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558aa844-8b7e-4bbd-b981-348c6240e7c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:21.451907 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558aa844-8b7e-4bbd-b981-348c6240e7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:21.452601 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558aa844-8b7e-4bbd-b981-348c6240e7c8 admin admin] PATH_INFO: `/v3/projects/1747773b0c044a119113ce0df11b0549/users/8d80845ff61c4cb4976c4abcd52b8405/roles/5b702713e40145b49e0b42abd0a5fba9` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:21.457844 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558aa844-8b7e-4bbd-b981-348c6240e7c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1747773b0c044a119113ce0df11b0549, user_id=8d80845ff61c4cb4976c4abcd52b8405, role_id=5b702713e40145b49e0b42abd0a5fba9)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:21.463005 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558aa844-8b7e-4bbd-b981-348c6240e7c8 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:21.479377 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 915/1836] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:30:21 2022] PUT /identity/v3/projects/1747773b0c044a119113ce0df11b0549/users/8d80845ff61c4cb4976c4abcd52b8405/roles/5b702713e40145b49e0b42abd0a5fba9 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:30:21.490318 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a122f-3474-4149-96af-441345fc50c4 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:21.490648 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a122f-3474-4149-96af-441345fc50c4 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:21.490886 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a122f-3474-4149-96af-441345fc50c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:21.546048 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 922/1837] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:30:21 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 05:30:21.555990 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b08ec03-37be-4135-a89f-323eda927316 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:21.558099 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-8b08ec03-37be-4135-a89f-323eda927316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:21.569141 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-ae1a122f-3474-4149-96af-441345fc50c4 None None] MFA Rules not processed for user `8d80845ff61c4cb4976c4abcd52b8405`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:30:21.572475 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-ae1a122f-3474-4149-96af-441345fc50c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:21.637877 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b08ec03-37be-4135-a89f-323eda927316 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:21.699669 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 916/1838] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:30:21 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 05:30:21.711822 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1a122f-3474-4149-96af-441345fc50c4 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:21.712877 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:21.714689 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-ae1a122f-3474-4149-96af-441345fc50c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:21.721404 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf19c278-bd84-45ad-a261-2d7adcaf810a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a147e14b61d481db1cac02c58ac3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:21.722048 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf19c278-bd84-45ad-a261-2d7adcaf810a service cinder] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:21.722449 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf19c278-bd84-45ad-a261-2d7adcaf810a service cinder] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:21.723087 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf19c278-bd84-45ad-a261-2d7adcaf810a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:21.752650 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1a122f-3474-4149-96af-441345fc50c4 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:21.773745 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b1d3b0-3a3a-42a4-852a-30fffb2fce18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a147e14b61d481db1cac02c58ac3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:21.774630 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1d3b0-3a3a-42a4-852a-30fffb2fce18 service cinder] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:21.775050 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1d3b0-3a3a-42a4-852a-30fffb2fce18 service cinder] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:21.783548 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1d3b0-3a3a-42a4-852a-30fffb2fce18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:21.814913 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b1d3b0-3a3a-42a4-852a-30fffb2fce18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:21.816733 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b1d3b0-3a3a-42a4-852a-30fffb2fce18 service cinder] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:21.838860 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 917/1839] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:30:21 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:30:21.875506 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf19c278-bd84-45ad-a261-2d7adcaf810a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:21.878438 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf19c278-bd84-45ad-a261-2d7adcaf810a service cinder] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:21.966744 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 923/1840] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:30:21 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 05:30:22.125684 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b1d3b0-3a3a-42a4-852a-30fffb2fce18 service cinder] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:22.149684 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b1d3b0-3a3a-42a4-852a-30fffb2fce18 service cinder] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:22.182883 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51a30fa-20eb-4f6a-99b7-370fd8674f57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a147e14b61d481db1cac02c58ac3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:22.183391 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51a30fa-20eb-4f6a-99b7-370fd8674f57 service cinder] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:22.183673 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51a30fa-20eb-4f6a-99b7-370fd8674f57 service cinder] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:22.183989 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51a30fa-20eb-4f6a-99b7-370fd8674f57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:22.186641 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-e51a30fa-20eb-4f6a-99b7-370fd8674f57 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:22.298195 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51a30fa-20eb-4f6a-99b7-370fd8674f57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:22.299709 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51a30fa-20eb-4f6a-99b7-370fd8674f57 service cinder] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:22.310436 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 918/1841] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:30:22 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:30:23.010596 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf19c278-bd84-45ad-a261-2d7adcaf810a service cinder] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:23.012268 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51a30fa-20eb-4f6a-99b7-370fd8674f57 service cinder] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:23.013916 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-e51a30fa-20eb-4f6a-99b7-370fd8674f57 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:23.056503 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:23.126158 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51a30fa-20eb-4f6a-99b7-370fd8674f57 service cinder] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:23.135028 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce021375-d350-4980-84bf-2602d14d12f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:23.136241 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce021375-d350-4980-84bf-2602d14d12f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:23.137081 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce021375-d350-4980-84bf-2602d14d12f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:23.137517 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce021375-d350-4980-84bf-2602d14d12f8 admin admin] PATH_INFO: `/v3/projects/6b38c25e8b8740e6a81a29c58c7e9cf4` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:23.138821 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce021375-d350-4980-84bf-2602d14d12f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b38c25e8b8740e6a81a29c58c7e9cf4)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:23.150184 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce021375-d350-4980-84bf-2602d14d12f8 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:23.160426 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf19c278-bd84-45ad-a261-2d7adcaf810a service cinder] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:23.172463 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc67fe3-08fc-4bdb-9e82-5e653f1d6ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:23.173231 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc67fe3-08fc-4bdb-9e82-5e653f1d6ad3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:23.173493 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc67fe3-08fc-4bdb-9e82-5e653f1d6ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:23.173766 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc67fe3-08fc-4bdb-9e82-5e653f1d6ad3 admin admin] PATH_INFO: `/v3/users/ac4bc5ee5f83434abfcfc69671f36a54` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:23.175901 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc67fe3-08fc-4bdb-9e82-5e653f1d6ad3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac4bc5ee5f83434abfcfc69671f36a54)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:23.178362 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc67fe3-08fc-4bdb-9e82-5e653f1d6ad3 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:23.290083 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-ce021375-d350-4980-84bf-2602d14d12f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b38c25e8b8740e6a81a29c58c7e9cf4', 'request_id': 'req-ce021375-d350-4980-84bf-2602d14d12f8'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:23.302008 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-ddc67fe3-08fc-4bdb-9e82-5e653f1d6ad3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac4bc5ee5f83434abfcfc69671f36a54'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:23.306462 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-ce021375-d350-4980-84bf-2602d14d12f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b38c25e8b8740e6a81a29c58c7e9cf4', 'request_id': 'req-ce021375-d350-4980-84bf-2602d14d12f8'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:23.323711 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-ce021375-d350-4980-84bf-2602d14d12f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b38c25e8b8740e6a81a29c58c7e9cf4', 'request_id': 'req-ce021375-d350-4980-84bf-2602d14d12f8'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:23.359011 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-ddc67fe3-08fc-4bdb-9e82-5e653f1d6ad3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac4bc5ee5f83434abfcfc69671f36a54'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:23.366813 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-ce021375-d350-4980-84bf-2602d14d12f8 admin admin] The token cache is being invalidate because project 6b38c25e8b8740e6a81a29c58c7e9cf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81383) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:30:23.367103 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-ce021375-d350-4980-84bf-2602d14d12f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:23.367898 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-ce021375-d350-4980-84bf-2602d14d12f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:23.372006 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-ddc67fe3-08fc-4bdb-9e82-5e653f1d6ad3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac4bc5ee5f83434abfcfc69671f36a54'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:23.373681 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 919/1842] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:30:23 2022] DELETE /identity/v3/projects/6b38c25e8b8740e6a81a29c58c7e9cf4 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 05:30:23.374873 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce021375-d350-4980-84bf-2602d14d12f8 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:23.376899 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-ce021375-d350-4980-84bf-2602d14d12f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:23.388411 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-ddc67fe3-08fc-4bdb-9e82-5e653f1d6ad3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac4bc5ee5f83434abfcfc69671f36a54'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:23.390410 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-ddc67fe3-08fc-4bdb-9e82-5e653f1d6ad3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac4bc5ee5f83434abfcfc69671f36a54'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:23.407959 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 924/1843] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:30:23 2022] DELETE /identity/v3/users/ac4bc5ee5f83434abfcfc69671f36a54 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:30:23.413960 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6960b-28c6-47be-a7bc-946ea9470061 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:23.414566 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6960b-28c6-47be-a7bc-946ea9470061 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:23.415047 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6960b-28c6-47be-a7bc-946ea9470061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:23.445247 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-63e6960b-28c6-47be-a7bc-946ea9470061 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:30:23.446833 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-63e6960b-28c6-47be-a7bc-946ea9470061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:23.458203 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:23.476407 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce021375-d350-4980-84bf-2602d14d12f8 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:23.545183 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61652e08-d070-4c81-986d-049f473bdc1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:23.545836 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61652e08-d070-4c81-986d-049f473bdc1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:23.546116 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61652e08-d070-4c81-986d-049f473bdc1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:23.546388 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61652e08-d070-4c81-986d-049f473bdc1b admin admin] PATH_INFO: `/v3/users/30d34022ec6b471094f34f9d0c919ccc` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:23.548433 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61652e08-d070-4c81-986d-049f473bdc1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=30d34022ec6b471094f34f9d0c919ccc)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:23.559034 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61652e08-d070-4c81-986d-049f473bdc1b admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:23.577399 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:23.606964 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 925/1844] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:30:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:30:23.700410 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e6960b-28c6-47be-a7bc-946ea9470061 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:23.701872 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-63e6960b-28c6-47be-a7bc-946ea9470061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:23.723198 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-61652e08-d070-4c81-986d-049f473bdc1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30d34022ec6b471094f34f9d0c919ccc'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:23.749523 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-61652e08-d070-4c81-986d-049f473bdc1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30d34022ec6b471094f34f9d0c919ccc'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:23.773078 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-61652e08-d070-4c81-986d-049f473bdc1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30d34022ec6b471094f34f9d0c919ccc'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:23.795150 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-61652e08-d070-4c81-986d-049f473bdc1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30d34022ec6b471094f34f9d0c919ccc'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:23.796114 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-61652e08-d070-4c81-986d-049f473bdc1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30d34022ec6b471094f34f9d0c919ccc'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:23.817644 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 920/1845] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:30:23 2022] DELETE /identity/v3/users/30d34022ec6b471094f34f9d0c919ccc => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:30:23.831851 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e6960b-28c6-47be-a7bc-946ea9470061 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:23.904280 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43cecd0-2c53-464a-805a-142262d2e6d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:23.904914 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43cecd0-2c53-464a-805a-142262d2e6d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:23.905192 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43cecd0-2c53-464a-805a-142262d2e6d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:23.905948 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43cecd0-2c53-464a-805a-142262d2e6d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:23.907438 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-c43cecd0-2c53-464a-805a-142262d2e6d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:24.007730 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43cecd0-2c53-464a-805a-142262d2e6d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:24.009286 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43cecd0-2c53-464a-805a-142262d2e6d0 service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:24.022699 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 926/1846] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:30:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 05:30:25.603490 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61652e08-d070-4c81-986d-049f473bdc1b admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:25.606748 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-61652e08-d070-4c81-986d-049f473bdc1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:25.633796 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61652e08-d070-4c81-986d-049f473bdc1b admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:25.650911 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d9230e-af5d-44a8-88e7-064cb2312603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:25.651891 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d9230e-af5d-44a8-88e7-064cb2312603 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:25.653494 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d9230e-af5d-44a8-88e7-064cb2312603 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:25.653849 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d9230e-af5d-44a8-88e7-064cb2312603 admin admin] PATH_INFO: `/v3/projects/83d282e9e8624d16bb34946f9e56b57e` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:25.656215 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d9230e-af5d-44a8-88e7-064cb2312603 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83d282e9e8624d16bb34946f9e56b57e)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:25.681215 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d9230e-af5d-44a8-88e7-064cb2312603 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:25.828149 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-c6d9230e-af5d-44a8-88e7-064cb2312603 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83d282e9e8624d16bb34946f9e56b57e', 'request_id': 'req-c6d9230e-af5d-44a8-88e7-064cb2312603'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:25.847134 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-c6d9230e-af5d-44a8-88e7-064cb2312603 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83d282e9e8624d16bb34946f9e56b57e', 'request_id': 'req-c6d9230e-af5d-44a8-88e7-064cb2312603'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:25.859477 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-c6d9230e-af5d-44a8-88e7-064cb2312603 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83d282e9e8624d16bb34946f9e56b57e', 'request_id': 'req-c6d9230e-af5d-44a8-88e7-064cb2312603'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:25.903519 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-c6d9230e-af5d-44a8-88e7-064cb2312603 admin admin] The token cache is being invalidate because project 83d282e9e8624d16bb34946f9e56b57e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81383) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:30:25.905018 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-c6d9230e-af5d-44a8-88e7-064cb2312603 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:25.907485 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-c6d9230e-af5d-44a8-88e7-064cb2312603 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:25.910971 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 921/1847] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:30:25 2022] DELETE /identity/v3/projects/83d282e9e8624d16bb34946f9e56b57e => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:30:25.915982 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b54be-2000-461c-8f51-8941ff6f7a2e None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:25.916894 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b54be-2000-461c-8f51-8941ff6f7a2e None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:25.917413 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b54be-2000-461c-8f51-8941ff6f7a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:25.967909 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d9230e-af5d-44a8-88e7-064cb2312603 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:25.970427 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-c6d9230e-af5d-44a8-88e7-064cb2312603 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:25.979087 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-4e5b54be-2000-461c-8f51-8941ff6f7a2e None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:30:25.981604 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-4e5b54be-2000-461c-8f51-8941ff6f7a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:26.020005 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:26.102912 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 927/1848] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:30:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:30:26.106204 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa04696-d70f-48c7-8305-a783c0e0e20a None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:26.106558 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa04696-d70f-48c7-8305-a783c0e0e20a None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:26.106848 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa04696-d70f-48c7-8305-a783c0e0e20a None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:26.108276 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 928/1849] 10.222.0.16 () {54 vars in 921 bytes} [Sun Sep 11 05:30:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:30:26.109360 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f9d58-adbf-4d4f-a054-5c4e5ca4c9ab None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:26.109640 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f9d58-adbf-4d4f-a054-5c4e5ca4c9ab None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:26.109911 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f9d58-adbf-4d4f-a054-5c4e5ca4c9ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:26.144070 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-189f9d58-adbf-4d4f-a054-5c4e5ca4c9ab None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:30:26.151061 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d9230e-af5d-44a8-88e7-064cb2312603 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:26.157117 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-189f9d58-adbf-4d4f-a054-5c4e5ca4c9ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:26.157511 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af3e179-394b-4f14-9750-f2ffa4e0235e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:26.158442 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3e179-394b-4f14-9750-f2ffa4e0235e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:26.158896 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3e179-394b-4f14-9750-f2ffa4e0235e admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:26.159325 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3e179-394b-4f14-9750-f2ffa4e0235e admin admin] PATH_INFO: `/v3/projects/71138670240147a4ac0a353bbdf20992` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:26.160686 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af3e179-394b-4f14-9750-f2ffa4e0235e admin admin] RBAC: Authorizing `identity:delete_project(project_id=71138670240147a4ac0a353bbdf20992)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:26.162813 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af3e179-394b-4f14-9750-f2ffa4e0235e admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:26.171310 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 929/1850] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:30:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:30:26.173096 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d56d5-a8c7-4e85-b41e-315399b6d538 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:26.173612 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d56d5-a8c7-4e85-b41e-315399b6d538 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:26.174402 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d56d5-a8c7-4e85-b41e-315399b6d538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:26.181708 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:26.199078 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-371d56d5-a8c7-4e85-b41e-315399b6d538 None None] MFA Rules not processed for user `6cd6136036bd467c946cae90d5c29263`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:30:26.200626 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-371d56d5-a8c7-4e85-b41e-315399b6d538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:26.234039 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-5af3e179-394b-4f14-9750-f2ffa4e0235e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71138670240147a4ac0a353bbdf20992', 'request_id': 'req-5af3e179-394b-4f14-9750-f2ffa4e0235e'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:26.244340 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-5af3e179-394b-4f14-9750-f2ffa4e0235e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71138670240147a4ac0a353bbdf20992', 'request_id': 'req-5af3e179-394b-4f14-9750-f2ffa4e0235e'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:26.251026 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-5af3e179-394b-4f14-9750-f2ffa4e0235e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71138670240147a4ac0a353bbdf20992', 'request_id': 'req-5af3e179-394b-4f14-9750-f2ffa4e0235e'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:26.263290 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-5af3e179-394b-4f14-9750-f2ffa4e0235e admin admin] The token cache is being invalidate because project 71138670240147a4ac0a353bbdf20992 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81383) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:30:26.263725 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-5af3e179-394b-4f14-9750-f2ffa4e0235e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:26.264685 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-5af3e179-394b-4f14-9750-f2ffa4e0235e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:26.267464 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 922/1851] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:30:25 2022] DELETE /identity/v3/projects/71138670240147a4ac0a353bbdf20992 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:30:26.268509 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af3e179-394b-4f14-9750-f2ffa4e0235e admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:26.270260 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-5af3e179-394b-4f14-9750-f2ffa4e0235e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:26.293974 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 930/1852] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 11 05:30:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:30:26.294834 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371d56d5-a8c7-4e85-b41e-315399b6d538 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:26.296200 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-371d56d5-a8c7-4e85-b41e-315399b6d538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:26.315749 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371d56d5-a8c7-4e85-b41e-315399b6d538 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:26.375661 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af3e179-394b-4f14-9750-f2ffa4e0235e admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:26.383069 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca00095-3e43-4f4b-9656-80dd45597da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:26.384237 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca00095-3e43-4f4b-9656-80dd45597da0 admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:26.384699 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca00095-3e43-4f4b-9656-80dd45597da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:26.385142 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca00095-3e43-4f4b-9656-80dd45597da0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:26.385817 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca00095-3e43-4f4b-9656-80dd45597da0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:30:26.386128 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca00095-3e43-4f4b-9656-80dd45597da0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:26.388762 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca00095-3e43-4f4b-9656-80dd45597da0 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:26.410704 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25d1df1-e98f-4a8e-b3d0-df062c1fcccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:26.410704 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d1df1-e98f-4a8e-b3d0-df062c1fcccd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:26.410704 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d1df1-e98f-4a8e-b3d0-df062c1fcccd admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:26.410704 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d1df1-e98f-4a8e-b3d0-df062c1fcccd admin admin] PATH_INFO: `/v3/users/8d80845ff61c4cb4976c4abcd52b8405` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:26.411448 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25d1df1-e98f-4a8e-b3d0-df062c1fcccd admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d80845ff61c4cb4976c4abcd52b8405)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:26.412124 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 923/1853] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 05:30:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:30:26.414174 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca00095-3e43-4f4b-9656-80dd45597da0 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:26.414548 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25d1df1-e98f-4a8e-b3d0-df062c1fcccd admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:26.419752 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-6ca00095-3e43-4f4b-9656-80dd45597da0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:26.482231 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-f25d1df1-e98f-4a8e-b3d0-df062c1fcccd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d80845ff61c4cb4976c4abcd52b8405'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:26.484149 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:26.496667 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-f25d1df1-e98f-4a8e-b3d0-df062c1fcccd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d80845ff61c4cb4976c4abcd52b8405'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:26.503860 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-f25d1df1-e98f-4a8e-b3d0-df062c1fcccd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d80845ff61c4cb4976c4abcd52b8405'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:26.508591 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca00095-3e43-4f4b-9656-80dd45597da0 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:26.511820 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-f25d1df1-e98f-4a8e-b3d0-df062c1fcccd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d80845ff61c4cb4976c4abcd52b8405'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:26.512555 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-f25d1df1-e98f-4a8e-b3d0-df062c1fcccd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d80845ff61c4cb4976c4abcd52b8405'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:26.515304 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797b19fa-8b9d-453f-84df-001ee113e26e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cd6136036bd467c946cae90d5c29263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:26.515951 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b19fa-8b9d-453f-84df-001ee113e26e service nova] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:26.516236 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b19fa-8b9d-453f-84df-001ee113e26e service nova] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:26.516559 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b19fa-8b9d-453f-84df-001ee113e26e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:26.518414 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-797b19fa-8b9d-453f-84df-001ee113e26e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:26.519688 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 931/1854] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:30:26 2022] DELETE /identity/v3/users/8d80845ff61c4cb4976c4abcd52b8405 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:30:26.520509 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25d1df1-e98f-4a8e-b3d0-df062c1fcccd admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:26.523626 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-f25d1df1-e98f-4a8e-b3d0-df062c1fcccd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:26.544904 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797b19fa-8b9d-453f-84df-001ee113e26e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:26.546199 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797b19fa-8b9d-453f-84df-001ee113e26e service nova] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:26.578391 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 924/1855] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:30:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:30:26.622233 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25d1df1-e98f-4a8e-b3d0-df062c1fcccd admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:26.627585 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f303d83f-3825-4f46-b498-fc8ff6805bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:26.628175 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f303d83f-3825-4f46-b498-fc8ff6805bbc admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:26.628451 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f303d83f-3825-4f46-b498-fc8ff6805bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:26.628717 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f303d83f-3825-4f46-b498-fc8ff6805bbc admin admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:26.629346 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f303d83f-3825-4f46-b498-fc8ff6805bbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:26.631236 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f303d83f-3825-4f46-b498-fc8ff6805bbc admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:26.660722 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 932/1856] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:30:26 2022] POST /identity/v3/projects => generated 387 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:30:26.664994 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797b19fa-8b9d-453f-84df-001ee113e26e service nova] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:26.676327 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797b19fa-8b9d-453f-84df-001ee113e26e service nova] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:26.704239 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:26.752768 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7345ea0-3acf-4c57-96de-ab502b863687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:26.753498 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7345ea0-3acf-4c57-96de-ab502b863687 admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:26.753877 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7345ea0-3acf-4c57-96de-ab502b863687 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:26.754254 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7345ea0-3acf-4c57-96de-ab502b863687 admin admin] PATH_INFO: `/v3/users` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:26.757200 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7345ea0-3acf-4c57-96de-ab502b863687 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:26.762228 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7345ea0-3acf-4c57-96de-ab502b863687 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:26.795385 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 925/1857] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:30:26 2022] POST /identity/v3/users => generated 294 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 05:30:26.801759 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f303d83f-3825-4f46-b498-fc8ff6805bbc admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:26.819824 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f303d83f-3825-4f46-b498-fc8ff6805bbc admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:26.826476 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d96c8a6-77dc-49af-9dce-3727de3e0831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:26.827225 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d96c8a6-77dc-49af-9dce-3727de3e0831 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:26.827572 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d96c8a6-77dc-49af-9dce-3727de3e0831 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:26.828104 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d96c8a6-77dc-49af-9dce-3727de3e0831 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:26.828836 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d96c8a6-77dc-49af-9dce-3727de3e0831 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:26.830682 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d96c8a6-77dc-49af-9dce-3727de3e0831 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:26.843218 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 933/1858] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:30:26 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:30:26.847446 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7345ea0-3acf-4c57-96de-ab502b863687 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:26.858187 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7345ea0-3acf-4c57-96de-ab502b863687 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:26.867331 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbfce9f-07a5-42d6-9a87-10c035a61c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:26.868259 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbfce9f-07a5-42d6-9a87-10c035a61c43 admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:26.868614 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbfce9f-07a5-42d6-9a87-10c035a61c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:26.869020 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbfce9f-07a5-42d6-9a87-10c035a61c43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:26.869777 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbfce9f-07a5-42d6-9a87-10c035a61c43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:26.872198 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbfce9f-07a5-42d6-9a87-10c035a61c43 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:26.878987 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d96c8a6-77dc-49af-9dce-3727de3e0831 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:26.882535 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-1d96c8a6-77dc-49af-9dce-3727de3e0831 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:26.887478 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 926/1859] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:30:26 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:30:26.893034 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbfce9f-07a5-42d6-9a87-10c035a61c43 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:26.906002 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d96c8a6-77dc-49af-9dce-3727de3e0831 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:26.919542 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0098236e-8a36-4d29-981b-a5ddf6a6bd1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:26.920263 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0098236e-8a36-4d29-981b-a5ddf6a6bd1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:26.920545 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0098236e-8a36-4d29-981b-a5ddf6a6bd1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:26.920815 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0098236e-8a36-4d29-981b-a5ddf6a6bd1f admin admin] PATH_INFO: `/v3/projects/1747773b0c044a119113ce0df11b0549` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:26.923299 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0098236e-8a36-4d29-981b-a5ddf6a6bd1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1747773b0c044a119113ce0df11b0549)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:26.925497 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0098236e-8a36-4d29-981b-a5ddf6a6bd1f admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:26.931018 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbfce9f-07a5-42d6-9a87-10c035a61c43 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:26.937232 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3097f68e-0679-472d-ab2d-2d775dca0534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:26.937906 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3097f68e-0679-472d-ab2d-2d775dca0534 admin admin] REQUEST_METHOD: `PUT` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:26.938190 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3097f68e-0679-472d-ab2d-2d775dca0534 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:26.938466 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3097f68e-0679-472d-ab2d-2d775dca0534 admin admin] PATH_INFO: `/v3/projects/bf701ae919784da3b591da86de9aa0db/users/fe81291de10945c78a7eb99f5022125f/roles/aa7ff8e0ec1e48e5811335b9eb38b448` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:26.957346 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3097f68e-0679-472d-ab2d-2d775dca0534 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf701ae919784da3b591da86de9aa0db, user_id=fe81291de10945c78a7eb99f5022125f, role_id=aa7ff8e0ec1e48e5811335b9eb38b448)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:26.960168 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3097f68e-0679-472d-ab2d-2d775dca0534 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:26.976616 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 927/1860] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:30:26 2022] PUT /identity/v3/projects/bf701ae919784da3b591da86de9aa0db/users/fe81291de10945c78a7eb99f5022125f/roles/aa7ff8e0ec1e48e5811335b9eb38b448 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:30:26.982995 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-0098236e-8a36-4d29-981b-a5ddf6a6bd1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1747773b0c044a119113ce0df11b0549', 'request_id': 'req-0098236e-8a36-4d29-981b-a5ddf6a6bd1f'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:26.993206 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6b9bd-4003-4cb2-83a1-cafd6f4464d0 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:26.993439 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6b9bd-4003-4cb2-83a1-cafd6f4464d0 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:26.993712 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6b9bd-4003-4cb2-83a1-cafd6f4464d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:26.994902 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-0098236e-8a36-4d29-981b-a5ddf6a6bd1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1747773b0c044a119113ce0df11b0549', 'request_id': 'req-0098236e-8a36-4d29-981b-a5ddf6a6bd1f'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:27.010012 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-0098236e-8a36-4d29-981b-a5ddf6a6bd1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1747773b0c044a119113ce0df11b0549', 'request_id': 'req-0098236e-8a36-4d29-981b-a5ddf6a6bd1f'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:27.029520 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-27a6b9bd-4003-4cb2-83a1-cafd6f4464d0 None None] MFA Rules not processed for user `fe81291de10945c78a7eb99f5022125f`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:30:27.031328 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-27a6b9bd-4003-4cb2-83a1-cafd6f4464d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:27.034160 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-0098236e-8a36-4d29-981b-a5ddf6a6bd1f admin admin] The token cache is being invalidate because project 1747773b0c044a119113ce0df11b0549 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:30:27.034643 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-0098236e-8a36-4d29-981b-a5ddf6a6bd1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:27.035562 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-0098236e-8a36-4d29-981b-a5ddf6a6bd1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:27.038178 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 934/1861] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:30:26 2022] DELETE /identity/v3/projects/1747773b0c044a119113ce0df11b0549 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 05:30:27.043101 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f1d94-4ae5-4e8e-840e-cf8d992cd74a None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:27.043412 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f1d94-4ae5-4e8e-840e-cf8d992cd74a None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:27.046720 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f1d94-4ae5-4e8e-840e-cf8d992cd74a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:27.075738 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-229f1d94-4ae5-4e8e-840e-cf8d992cd74a None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:30:27.077761 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-229f1d94-4ae5-4e8e-840e-cf8d992cd74a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:27.121409 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 928/1862] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:30:26 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:30:27.122617 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a6b9bd-4003-4cb2-83a1-cafd6f4464d0 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:27.124074 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-27a6b9bd-4003-4cb2-83a1-cafd6f4464d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:27.142833 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:27.272419 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 935/1863] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:30:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:30:27.279124 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a6b9bd-4003-4cb2-83a1-cafd6f4464d0 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:27.279751 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f7c93-a385-4c95-b616-dc1beadaf0ce None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:27.280043 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f7c93-a385-4c95-b616-dc1beadaf0ce None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:27.280321 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f7c93-a385-4c95-b616-dc1beadaf0ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:27.287114 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfcb336-b76b-4442-a07c-5a0e4eb13e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:27.288279 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfcb336-b76b-4442-a07c-5a0e4eb13e2d admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:27.289781 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfcb336-b76b-4442-a07c-5a0e4eb13e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:27.291788 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfcb336-b76b-4442-a07c-5a0e4eb13e2d admin admin] PATH_INFO: `/v3/projects` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:27.293783 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfcb336-b76b-4442-a07c-5a0e4eb13e2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:27.297450 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfcb336-b76b-4442-a07c-5a0e4eb13e2d admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:27.310414 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:27.314031 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-da7f7c93-a385-4c95-b616-dc1beadaf0ce None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:30:27.315431 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-da7f7c93-a385-4c95-b616-dc1beadaf0ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:27.326682 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 936/1864] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:30:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 05:30:27.332929 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f7c93-a385-4c95-b616-dc1beadaf0ce None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:27.343706 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 929/1865] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:30:27 2022] POST /identity/v3/projects => generated 385 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:30:27.344573 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfcb336-b76b-4442-a07c-5a0e4eb13e2d admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:27.346979 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f7c93-a385-4c95-b616-dc1beadaf0ce None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:27.423072 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac13a0e-baa3-4818-801a-95a9a3773c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:27.424318 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac13a0e-baa3-4818-801a-95a9a3773c76 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:27.424883 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac13a0e-baa3-4818-801a-95a9a3773c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:27.425318 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac13a0e-baa3-4818-801a-95a9a3773c76 admin admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:27.426193 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac13a0e-baa3-4818-801a-95a9a3773c76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:30:27.426665 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac13a0e-baa3-4818-801a-95a9a3773c76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:27.428649 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac13a0e-baa3-4818-801a-95a9a3773c76 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:27.456754 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 937/1866] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 05:30:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:30:27.457792 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac13a0e-baa3-4818-801a-95a9a3773c76 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:27.463004 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-eac13a0e-baa3-4818-801a-95a9a3773c76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:27.465238 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfcb336-b76b-4442-a07c-5a0e4eb13e2d admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:27.470579 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fc8a17-6a56-4f50-afce-7c36a91b18d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:27.471203 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fc8a17-6a56-4f50-afce-7c36a91b18d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:27.471509 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fc8a17-6a56-4f50-afce-7c36a91b18d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:27.472066 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fc8a17-6a56-4f50-afce-7c36a91b18d4 admin admin] PATH_INFO: `/v3/users` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:27.472840 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fc8a17-6a56-4f50-afce-7c36a91b18d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:27.474946 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fc8a17-6a56-4f50-afce-7c36a91b18d4 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:27.477545 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac13a0e-baa3-4818-801a-95a9a3773c76 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:27.483002 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b56515a-8399-476f-b36f-8fee7a30ca9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:27.483637 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b56515a-8399-476f-b36f-8fee7a30ca9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:27.483950 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b56515a-8399-476f-b36f-8fee7a30ca9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:27.484405 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b56515a-8399-476f-b36f-8fee7a30ca9f admin admin] PATH_INFO: `/v3/users/99b370249494460a8a228c8a417c3c01` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:27.485553 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b56515a-8399-476f-b36f-8fee7a30ca9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=99b370249494460a8a228c8a417c3c01)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:27.487533 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b56515a-8399-476f-b36f-8fee7a30ca9f admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:27.501898 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 930/1867] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:30:27 2022] POST /identity/v3/users => generated 293 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:30:27.501898 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fc8a17-6a56-4f50-afce-7c36a91b18d4 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:27.514142 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fc8a17-6a56-4f50-afce-7c36a91b18d4 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:27.519942 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b808fc-8b9a-4416-90b7-3e532a54a705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:27.520717 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b808fc-8b9a-4416-90b7-3e532a54a705 admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:27.521065 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b808fc-8b9a-4416-90b7-3e532a54a705 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:27.521978 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b808fc-8b9a-4416-90b7-3e532a54a705 admin admin] PATH_INFO: `/v3/projects` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:27.522097 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b808fc-8b9a-4416-90b7-3e532a54a705 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:27.524305 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b808fc-8b9a-4416-90b7-3e532a54a705 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:27.548115 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-1b56515a-8399-476f-b36f-8fee7a30ca9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99b370249494460a8a228c8a417c3c01'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:27.555713 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 931/1868] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:30:27 2022] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:30:27.556588 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b808fc-8b9a-4416-90b7-3e532a54a705 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:27.562773 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-1b56515a-8399-476f-b36f-8fee7a30ca9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99b370249494460a8a228c8a417c3c01'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:27.576484 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-1b56515a-8399-476f-b36f-8fee7a30ca9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99b370249494460a8a228c8a417c3c01'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:27.585734 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-1b56515a-8399-476f-b36f-8fee7a30ca9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99b370249494460a8a228c8a417c3c01'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:27.586363 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-1b56515a-8399-476f-b36f-8fee7a30ca9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99b370249494460a8a228c8a417c3c01'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:27.594590 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 938/1869] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:30:27 2022] DELETE /identity/v3/users/99b370249494460a8a228c8a417c3c01 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:30:27.595937 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b56515a-8399-476f-b36f-8fee7a30ca9f admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:27.598491 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-1b56515a-8399-476f-b36f-8fee7a30ca9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:27.633416 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:27.648208 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b808fc-8b9a-4416-90b7-3e532a54a705 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:27.685866 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b56515a-8399-476f-b36f-8fee7a30ca9f admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:27.690547 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd8dba2-d724-4524-8a9f-26989ecd6baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:27.691150 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd8dba2-d724-4524-8a9f-26989ecd6baa admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:27.691425 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd8dba2-d724-4524-8a9f-26989ecd6baa admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:27.691735 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd8dba2-d724-4524-8a9f-26989ecd6baa admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:27.692484 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd8dba2-d724-4524-8a9f-26989ecd6baa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:27.694439 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd8dba2-d724-4524-8a9f-26989ecd6baa admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:27.712313 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0e8621-e585-4058-81b5-f75342b95bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:27.712929 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e8621-e585-4058-81b5-f75342b95bbe admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:27.713212 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e8621-e585-4058-81b5-f75342b95bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:27.713484 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e8621-e585-4058-81b5-f75342b95bbe admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:27.714127 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0e8621-e585-4058-81b5-f75342b95bbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:27.715827 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0e8621-e585-4058-81b5-f75342b95bbe admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:27.717183 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 939/1870] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:30:27 2022] POST /identity/v3/users => generated 292 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:30:27.722341 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e50a008-1a9d-4d97-9052-10c8d0ac6d35 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:27.723561 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e50a008-1a9d-4d97-9052-10c8d0ac6d35 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:27.723875 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e50a008-1a9d-4d97-9052-10c8d0ac6d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:27.725132 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:27.731827 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 932/1871] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:30:27 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:30:27.733209 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0e8621-e585-4058-81b5-f75342b95bbe admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:27.746667 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0e8621-e585-4058-81b5-f75342b95bbe admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:27.751828 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd5ac0-bd40-47f8-81ac-efebc3728d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:27.752680 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd5ac0-bd40-47f8-81ac-efebc3728d26 admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:27.753144 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd5ac0-bd40-47f8-81ac-efebc3728d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:27.753583 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd5ac0-bd40-47f8-81ac-efebc3728d26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:27.754383 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bd5ac0-bd40-47f8-81ac-efebc3728d26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:27.756355 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bd5ac0-bd40-47f8-81ac-efebc3728d26 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:27.764306 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-3e50a008-1a9d-4d97-9052-10c8d0ac6d35 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:30:27.765692 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-3e50a008-1a9d-4d97-9052-10c8d0ac6d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:27.769268 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 933/1872] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:30:27 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:30:27.770533 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd5ac0-bd40-47f8-81ac-efebc3728d26 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:27.772635 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-c0bd5ac0-bd40-47f8-81ac-efebc3728d26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:27.780914 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 940/1873] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:30:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:30:27.780914 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e50a008-1a9d-4d97-9052-10c8d0ac6d35 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:27.787386 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd5ac0-bd40-47f8-81ac-efebc3728d26 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:27.790810 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e50a008-1a9d-4d97-9052-10c8d0ac6d35 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:27.792245 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621915ba-ea7e-4cdc-8d5d-104e068c0eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:27.793700 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621915ba-ea7e-4cdc-8d5d-104e068c0eb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:27.793984 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621915ba-ea7e-4cdc-8d5d-104e068c0eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:27.794257 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621915ba-ea7e-4cdc-8d5d-104e068c0eb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:27.794903 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621915ba-ea7e-4cdc-8d5d-104e068c0eb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:27.796683 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee6a44b-4d10-43f8-b1cc-3a102d2d3056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:27.796800 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621915ba-ea7e-4cdc-8d5d-104e068c0eb0 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:27.796897 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee6a44b-4d10-43f8-b1cc-3a102d2d3056 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:27.796992 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee6a44b-4d10-43f8-b1cc-3a102d2d3056 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:27.797232 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee6a44b-4d10-43f8-b1cc-3a102d2d3056 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:27.797862 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee6a44b-4d10-43f8-b1cc-3a102d2d3056 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:27.799444 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee6a44b-4d10-43f8-b1cc-3a102d2d3056 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:27.811494 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 934/1874] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:30:27 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:30:27.811494 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621915ba-ea7e-4cdc-8d5d-104e068c0eb0 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:27.811793 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 941/1875] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:30:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:30:27.812713 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee6a44b-4d10-43f8-b1cc-3a102d2d3056 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:27.813452 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-621915ba-ea7e-4cdc-8d5d-104e068c0eb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:27.822689 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee6a44b-4d10-43f8-b1cc-3a102d2d3056 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:27.827523 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bf2e89-97fb-4e34-a1cc-4dbceeadb6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:27.828233 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf2e89-97fb-4e34-a1cc-4dbceeadb6b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:27.828512 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf2e89-97fb-4e34-a1cc-4dbceeadb6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:27.828837 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf2e89-97fb-4e34-a1cc-4dbceeadb6b7 admin admin] PATH_INFO: `/v3/projects/a93333f1cf4d4febb5064aacfb7ea6b5/users/c0a01f9e7d954cee824ee7c5b0c36bf3/roles/aa7ff8e0ec1e48e5811335b9eb38b448` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:27.845687 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bf2e89-97fb-4e34-a1cc-4dbceeadb6b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a93333f1cf4d4febb5064aacfb7ea6b5, user_id=c0a01f9e7d954cee824ee7c5b0c36bf3, role_id=aa7ff8e0ec1e48e5811335b9eb38b448)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:27.849879 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bf2e89-97fb-4e34-a1cc-4dbceeadb6b7 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:27.873264 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 942/1876] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:30:27 2022] PUT /identity/v3/projects/a93333f1cf4d4febb5064aacfb7ea6b5/users/c0a01f9e7d954cee824ee7c5b0c36bf3/roles/aa7ff8e0ec1e48e5811335b9eb38b448 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:30:27.874427 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bf2e89-97fb-4e34-a1cc-4dbceeadb6b7 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:27.892712 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621915ba-ea7e-4cdc-8d5d-104e068c0eb0 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:27.987171 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323e64c4-6c89-4d77-b2b7-a5b9842ff929 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:27.987841 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323e64c4-6c89-4d77-b2b7-a5b9842ff929 service neutron] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:27.988126 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323e64c4-6c89-4d77-b2b7-a5b9842ff929 service neutron] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:27.988406 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323e64c4-6c89-4d77-b2b7-a5b9842ff929 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:28.005622 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bf2e89-97fb-4e34-a1cc-4dbceeadb6b7 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:28.010596 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b23589-c184-4fbe-a218-2e4d6f8940ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:28.011305 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b23589-c184-4fbe-a218-2e4d6f8940ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:28.011596 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b23589-c184-4fbe-a218-2e4d6f8940ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:28.011900 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b23589-c184-4fbe-a218-2e4d6f8940ed admin admin] PATH_INFO: `/v3/projects/68dc19de003b4bca880e862ad6ee6b63/users/ea549a3b64c143b6bd75a7039a9f0c93/roles/aa7ff8e0ec1e48e5811335b9eb38b448` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:28.029135 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b23589-c184-4fbe-a218-2e4d6f8940ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=68dc19de003b4bca880e862ad6ee6b63, user_id=ea549a3b64c143b6bd75a7039a9f0c93, role_id=aa7ff8e0ec1e48e5811335b9eb38b448)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:28.031956 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b23589-c184-4fbe-a218-2e4d6f8940ed admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:28.051945 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 943/1877] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:30:27 2022] PUT /identity/v3/projects/68dc19de003b4bca880e862ad6ee6b63/users/ea549a3b64c143b6bd75a7039a9f0c93/roles/aa7ff8e0ec1e48e5811335b9eb38b448 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:30:28.054250 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584bcd05-9d5f-4fc3-ac84-c441ced5e242 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:28.054700 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584bcd05-9d5f-4fc3-ac84-c441ced5e242 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:28.055130 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584bcd05-9d5f-4fc3-ac84-c441ced5e242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:28.072299 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323e64c4-6c89-4d77-b2b7-a5b9842ff929 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:28.073937 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323e64c4-6c89-4d77-b2b7-a5b9842ff929 service neutron] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:28.084856 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 935/1878] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:30:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:30:28.086330 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614fbe43-73c5-40ae-8889-b0b67d614b0f None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:28.086738 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614fbe43-73c5-40ae-8889-b0b67d614b0f None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:28.087117 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614fbe43-73c5-40ae-8889-b0b67d614b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:28.089858 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-584bcd05-9d5f-4fc3-ac84-c441ced5e242 None None] MFA Rules not processed for user `c0a01f9e7d954cee824ee7c5b0c36bf3`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:30:28.091082 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-584bcd05-9d5f-4fc3-ac84-c441ced5e242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:28.119071 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-614fbe43-73c5-40ae-8889-b0b67d614b0f None None] MFA Rules not processed for user `ea549a3b64c143b6bd75a7039a9f0c93`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:30:28.132107 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-614fbe43-73c5-40ae-8889-b0b67d614b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:28.185310 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:28.194560 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:28.224892 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 944/1879] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:30:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:30:28.229221 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584bcd05-9d5f-4fc3-ac84-c441ced5e242 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:28.265711 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 936/1880] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:30:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:30:28.275312 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614fbe43-73c5-40ae-8889-b0b67d614b0f None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:28.351954 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584bcd05-9d5f-4fc3-ac84-c441ced5e242 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:28.360185 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9c642a-dda4-4040-abf8-6e47162c5af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:28.360607 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c642a-dda4-4040-abf8-6e47162c5af2 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:28.361011 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c642a-dda4-4040-abf8-6e47162c5af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:28.361385 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c642a-dda4-4040-abf8-6e47162c5af2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:28.362653 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9c642a-dda4-4040-abf8-6e47162c5af2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:28.365077 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9c642a-dda4-4040-abf8-6e47162c5af2 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:28.379637 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614fbe43-73c5-40ae-8889-b0b67d614b0f None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:28.386425 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d5d4f6-1269-4954-bb13-3a5d0f3aadcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:28.387548 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d5d4f6-1269-4954-bb13-3a5d0f3aadcd admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:28.387548 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d5d4f6-1269-4954-bb13-3a5d0f3aadcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:28.387808 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d5d4f6-1269-4954-bb13-3a5d0f3aadcd admin admin] PATH_INFO: `/v3/projects` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:28.388487 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d5d4f6-1269-4954-bb13-3a5d0f3aadcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:28.391300 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d5d4f6-1269-4954-bb13-3a5d0f3aadcd admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:28.443359 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 945/1881] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:30:28 2022] POST /identity/v3/projects => generated 387 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 05:30:28.444907 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9c642a-dda4-4040-abf8-6e47162c5af2 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:28.463409 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 937/1882] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:30:28 2022] POST /identity/v3/projects => generated 379 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 05:30:28.468019 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d5d4f6-1269-4954-bb13-3a5d0f3aadcd admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:28.601163 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9c642a-dda4-4040-abf8-6e47162c5af2 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:28.650604 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d5d4f6-1269-4954-bb13-3a5d0f3aadcd admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:28.672619 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d279a3-9cc2-454b-9c01-30e1ce47f53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:28.673260 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d279a3-9cc2-454b-9c01-30e1ce47f53f admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:28.673533 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d279a3-9cc2-454b-9c01-30e1ce47f53f admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:28.674002 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d279a3-9cc2-454b-9c01-30e1ce47f53f admin admin] PATH_INFO: `/v3/users` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:28.674759 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d279a3-9cc2-454b-9c01-30e1ce47f53f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:28.676791 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d279a3-9cc2-454b-9c01-30e1ce47f53f admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:28.737849 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5729c38d-6c93-478d-843d-1663cd9569cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:28.738724 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5729c38d-6c93-478d-843d-1663cd9569cc admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:28.739013 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5729c38d-6c93-478d-843d-1663cd9569cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:28.739288 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5729c38d-6c93-478d-843d-1663cd9569cc admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:28.740264 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5729c38d-6c93-478d-843d-1663cd9569cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:28.743491 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 938/1883] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:30:28 2022] POST /identity/v3/users => generated 296 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:30:28.744020 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5729c38d-6c93-478d-843d-1663cd9569cc admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:28.778261 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d279a3-9cc2-454b-9c01-30e1ce47f53f admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:28.787217 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 946/1884] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:30:28 2022] POST /identity/v3/users => generated 300 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:30:28.798780 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5729c38d-6c93-478d-843d-1663cd9569cc admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:28.805751 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d279a3-9cc2-454b-9c01-30e1ce47f53f admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:28.831673 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fa5df3-c0a7-44b5-8db1-965dd32c1540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:28.835381 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fa5df3-c0a7-44b5-8db1-965dd32c1540 admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:28.835670 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fa5df3-c0a7-44b5-8db1-965dd32c1540 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:28.836003 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fa5df3-c0a7-44b5-8db1-965dd32c1540 admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:28.837806 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fa5df3-c0a7-44b5-8db1-965dd32c1540 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:28.839604 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5729c38d-6c93-478d-843d-1663cd9569cc admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:28.841786 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fa5df3-c0a7-44b5-8db1-965dd32c1540 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:28.869371 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d128a0ae-b051-4b46-8e62-192cc6df8ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:28.870020 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d128a0ae-b051-4b46-8e62-192cc6df8ee3 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:28.870301 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d128a0ae-b051-4b46-8e62-192cc6df8ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:28.870669 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d128a0ae-b051-4b46-8e62-192cc6df8ee3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:28.872427 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d128a0ae-b051-4b46-8e62-192cc6df8ee3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:28.873716 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d128a0ae-b051-4b46-8e62-192cc6df8ee3 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:28.875418 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:28.880144 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 939/1885] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:30:28 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:30:28.882114 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fa5df3-c0a7-44b5-8db1-965dd32c1540 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:28.884305 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-24fa5df3-c0a7-44b5-8db1-965dd32c1540 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:28.901768 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 947/1886] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:30:28 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:30:28.903858 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fa5df3-c0a7-44b5-8db1-965dd32c1540 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:28.904463 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d128a0ae-b051-4b46-8e62-192cc6df8ee3 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:28.930659 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dfd36f-6c1b-4ad9-b387-526aa7649ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:28.934117 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dfd36f-6c1b-4ad9-b387-526aa7649ff7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:28.936666 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dfd36f-6c1b-4ad9-b387-526aa7649ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:28.937248 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dfd36f-6c1b-4ad9-b387-526aa7649ff7 admin admin] PATH_INFO: `/v3/projects/30274f77370d4b9bbe1883eeae0a00b2` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:28.940347 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dfd36f-6c1b-4ad9-b387-526aa7649ff7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30274f77370d4b9bbe1883eeae0a00b2)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:28.942947 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dfd36f-6c1b-4ad9-b387-526aa7649ff7 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:28.943334 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d128a0ae-b051-4b46-8e62-192cc6df8ee3 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:28.960560 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913464a3-b500-4183-9e25-c38ef9a7b5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:28.961335 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913464a3-b500-4183-9e25-c38ef9a7b5a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:28.961996 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913464a3-b500-4183-9e25-c38ef9a7b5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:28.962255 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913464a3-b500-4183-9e25-c38ef9a7b5a2 admin admin] PATH_INFO: `/v3/projects/9c2983243b284d3bb420a7d5ce750798/users/872c0c098c274d6ca3a9fc0bd9f8d79e/roles/5b702713e40145b49e0b42abd0a5fba9` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:29.004385 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:29.014861 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913464a3-b500-4183-9e25-c38ef9a7b5a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c2983243b284d3bb420a7d5ce750798, user_id=872c0c098c274d6ca3a9fc0bd9f8d79e, role_id=5b702713e40145b49e0b42abd0a5fba9)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:29.017802 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913464a3-b500-4183-9e25-c38ef9a7b5a2 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:29.029784 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-d0dfd36f-6c1b-4ad9-b387-526aa7649ff7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30274f77370d4b9bbe1883eeae0a00b2', 'request_id': 'req-d0dfd36f-6c1b-4ad9-b387-526aa7649ff7'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:29.045474 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 948/1887] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:30:28 2022] PUT /identity/v3/projects/9c2983243b284d3bb420a7d5ce750798/users/872c0c098c274d6ca3a9fc0bd9f8d79e/roles/5b702713e40145b49e0b42abd0a5fba9 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:30:29.047192 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913464a3-b500-4183-9e25-c38ef9a7b5a2 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:29.048151 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-d0dfd36f-6c1b-4ad9-b387-526aa7649ff7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30274f77370d4b9bbe1883eeae0a00b2', 'request_id': 'req-d0dfd36f-6c1b-4ad9-b387-526aa7649ff7'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:29.065951 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-d0dfd36f-6c1b-4ad9-b387-526aa7649ff7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30274f77370d4b9bbe1883eeae0a00b2', 'request_id': 'req-d0dfd36f-6c1b-4ad9-b387-526aa7649ff7'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:29.096964 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-d0dfd36f-6c1b-4ad9-b387-526aa7649ff7 admin admin] The token cache is being invalidate because project 30274f77370d4b9bbe1883eeae0a00b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81383) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:30:29.097271 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-d0dfd36f-6c1b-4ad9-b387-526aa7649ff7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:29.098136 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-d0dfd36f-6c1b-4ad9-b387-526aa7649ff7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:29.103402 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 940/1888] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:30:28 2022] DELETE /identity/v3/projects/30274f77370d4b9bbe1883eeae0a00b2 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:30:29.104522 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dfd36f-6c1b-4ad9-b387-526aa7649ff7 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:29.108084 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-d0dfd36f-6c1b-4ad9-b387-526aa7649ff7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:29.260993 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913464a3-b500-4183-9e25-c38ef9a7b5a2 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:29.276413 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1445a957-8155-43f0-aa5a-72b2fedf045a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:29.277640 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1445a957-8155-43f0-aa5a-72b2fedf045a admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:29.278211 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1445a957-8155-43f0-aa5a-72b2fedf045a admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:29.278211 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1445a957-8155-43f0-aa5a-72b2fedf045a admin admin] PATH_INFO: `/v3/projects/d96866ee8b904db88779dde960988d17/users/9603fae6de43488981e82aec6f1a6daf/roles/5b702713e40145b49e0b42abd0a5fba9` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:29.282704 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dfd36f-6c1b-4ad9-b387-526aa7649ff7 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:29.316214 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dbc30e-3741-4995-bca9-9168350139f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:29.316989 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dbc30e-3741-4995-bca9-9168350139f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:29.318713 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dbc30e-3741-4995-bca9-9168350139f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:29.319220 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dbc30e-3741-4995-bca9-9168350139f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:29.319958 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dbc30e-3741-4995-bca9-9168350139f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:29.321983 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dbc30e-3741-4995-bca9-9168350139f0 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:29.332878 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1445a957-8155-43f0-aa5a-72b2fedf045a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d96866ee8b904db88779dde960988d17, user_id=9603fae6de43488981e82aec6f1a6daf, role_id=5b702713e40145b49e0b42abd0a5fba9)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:29.336721 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1445a957-8155-43f0-aa5a-72b2fedf045a admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:29.342267 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 941/1889] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:30:29 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:30:29.343410 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dbc30e-3741-4995-bca9-9168350139f0 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:29.347380 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-75dbc30e-3741-4995-bca9-9168350139f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:29.364386 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dbc30e-3741-4995-bca9-9168350139f0 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:29.373874 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 949/1890] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:30:29 2022] PUT /identity/v3/projects/d96866ee8b904db88779dde960988d17/users/9603fae6de43488981e82aec6f1a6daf/roles/5b702713e40145b49e0b42abd0a5fba9 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:30:29.374724 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1445a957-8155-43f0-aa5a-72b2fedf045a admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:29.491656 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f938259d-5ade-4377-aac4-b1e8ecb24972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:29.492925 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f938259d-5ade-4377-aac4-b1e8ecb24972 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:29.495002 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f938259d-5ade-4377-aac4-b1e8ecb24972 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:29.495605 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f938259d-5ade-4377-aac4-b1e8ecb24972 admin admin] PATH_INFO: `/v3/users/98d6c7a299e84b57a8be0d316f567e4d` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:29.498450 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f938259d-5ade-4377-aac4-b1e8ecb24972 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98d6c7a299e84b57a8be0d316f567e4d)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:29.501358 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f938259d-5ade-4377-aac4-b1e8ecb24972 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:29.504965 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1445a957-8155-43f0-aa5a-72b2fedf045a admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:29.517419 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef68a3bc-3ef9-44b8-8a25-946e622c04ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:29.519470 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef68a3bc-3ef9-44b8-8a25-946e622c04ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:29.519809 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef68a3bc-3ef9-44b8-8a25-946e622c04ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:29.520093 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef68a3bc-3ef9-44b8-8a25-946e622c04ad admin admin] PATH_INFO: `/v3/projects/9c2983243b284d3bb420a7d5ce750798/users/872c0c098c274d6ca3a9fc0bd9f8d79e/roles/5b702713e40145b49e0b42abd0a5fba9` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:29.522723 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef68a3bc-3ef9-44b8-8a25-946e622c04ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c2983243b284d3bb420a7d5ce750798, user_id=872c0c098c274d6ca3a9fc0bd9f8d79e, role_id=5b702713e40145b49e0b42abd0a5fba9)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:29.528337 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef68a3bc-3ef9-44b8-8a25-946e622c04ad admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:29.555902 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 950/1891] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:30:29 2022] PUT /identity/v3/projects/9c2983243b284d3bb420a7d5ce750798/users/872c0c098c274d6ca3a9fc0bd9f8d79e/roles/5b702713e40145b49e0b42abd0a5fba9 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:30:29.555902 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef68a3bc-3ef9-44b8-8a25-946e622c04ad admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:29.557511 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-ef68a3bc-3ef9-44b8-8a25-946e622c04ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:29.631885 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-f938259d-5ade-4377-aac4-b1e8ecb24972 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98d6c7a299e84b57a8be0d316f567e4d'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:29.654772 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:29.658158 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:29.670130 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-f938259d-5ade-4377-aac4-b1e8ecb24972 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98d6c7a299e84b57a8be0d316f567e4d'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:29.717793 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-f938259d-5ade-4377-aac4-b1e8ecb24972 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98d6c7a299e84b57a8be0d316f567e4d'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:29.731036 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef68a3bc-3ef9-44b8-8a25-946e622c04ad admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:29.738262 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-f938259d-5ade-4377-aac4-b1e8ecb24972 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98d6c7a299e84b57a8be0d316f567e4d'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:29.739937 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-f938259d-5ade-4377-aac4-b1e8ecb24972 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98d6c7a299e84b57a8be0d316f567e4d'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:29.748363 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b3dbfb-ed22-415c-bd42-4e8247ffe4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:29.748363 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b3dbfb-ed22-415c-bd42-4e8247ffe4c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:29.748363 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b3dbfb-ed22-415c-bd42-4e8247ffe4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:29.748363 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b3dbfb-ed22-415c-bd42-4e8247ffe4c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:29.748965 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b3dbfb-ed22-415c-bd42-4e8247ffe4c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:29.750265 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b3dbfb-ed22-415c-bd42-4e8247ffe4c3 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:29.752091 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 942/1892] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:30:29 2022] DELETE /identity/v3/users/98d6c7a299e84b57a8be0d316f567e4d => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:30:29.753389 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aef6fee-be6a-45f4-8712-9d9b2e6c752f None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:29.753677 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aef6fee-be6a-45f4-8712-9d9b2e6c752f None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:29.753965 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aef6fee-be6a-45f4-8712-9d9b2e6c752f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:29.774097 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 951/1893] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:30:29 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:30:29.779219 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b3dbfb-ed22-415c-bd42-4e8247ffe4c3 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:29.784195 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-33b3dbfb-ed22-415c-bd42-4e8247ffe4c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:29.802210 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b3dbfb-ed22-415c-bd42-4e8247ffe4c3 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:29.844452 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-1aef6fee-be6a-45f4-8712-9d9b2e6c752f None None] MFA Rules not processed for user `872c0c098c274d6ca3a9fc0bd9f8d79e`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:30:29.848193 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-1aef6fee-be6a-45f4-8712-9d9b2e6c752f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:29.965409 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c411e2-14dc-4a97-9868-c5058928e06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:29.968087 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c411e2-14dc-4a97-9868-c5058928e06f admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:29.968937 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c411e2-14dc-4a97-9868-c5058928e06f admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:29.969320 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c411e2-14dc-4a97-9868-c5058928e06f admin admin] PATH_INFO: `/v3/projects/d96866ee8b904db88779dde960988d17/users/9603fae6de43488981e82aec6f1a6daf/roles/5b702713e40145b49e0b42abd0a5fba9` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:29.973126 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c411e2-14dc-4a97-9868-c5058928e06f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d96866ee8b904db88779dde960988d17, user_id=9603fae6de43488981e82aec6f1a6daf, role_id=5b702713e40145b49e0b42abd0a5fba9)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:29.977102 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c411e2-14dc-4a97-9868-c5058928e06f admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:30.015807 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 952/1894] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:30:29 2022] PUT /identity/v3/projects/d96866ee8b904db88779dde960988d17/users/9603fae6de43488981e82aec6f1a6daf/roles/5b702713e40145b49e0b42abd0a5fba9 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:30:30.019526 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e37b6-053e-4e51-a800-bd3d271eb274 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:30.020905 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e37b6-053e-4e51-a800-bd3d271eb274 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:30.021286 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e37b6-053e-4e51-a800-bd3d271eb274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:30.067973 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 943/1895] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:30:29 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:30:30.076715 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aef6fee-be6a-45f4-8712-9d9b2e6c752f None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:30.079263 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-1aef6fee-be6a-45f4-8712-9d9b2e6c752f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:30.090923 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-8d2e37b6-053e-4e51-a800-bd3d271eb274 None None] MFA Rules not processed for user `9603fae6de43488981e82aec6f1a6daf`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:30:30.093375 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-8d2e37b6-053e-4e51-a800-bd3d271eb274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:30.260103 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 953/1896] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:30:30 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:30:30.266227 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aef6fee-be6a-45f4-8712-9d9b2e6c752f None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:30.273762 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2e37b6-053e-4e51-a800-bd3d271eb274 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:30.275287 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-8d2e37b6-053e-4e51-a800-bd3d271eb274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:30.376510 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2e37b6-053e-4e51-a800-bd3d271eb274 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:30.380112 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43be7f1d-e248-4c3b-b979-52ea0711a2a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a147e14b61d481db1cac02c58ac3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:30.380733 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43be7f1d-e248-4c3b-b979-52ea0711a2a2 service cinder] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:30.381035 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43be7f1d-e248-4c3b-b979-52ea0711a2a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:30.381265 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43be7f1d-e248-4c3b-b979-52ea0711a2a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:30.392495 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6597f3f9-1526-4062-bcee-6d56b39fd847 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a147e14b61d481db1cac02c58ac3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:30.393389 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6597f3f9-1526-4062-bcee-6d56b39fd847 service cinder] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:30.393746 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6597f3f9-1526-4062-bcee-6d56b39fd847 service cinder] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:30.394028 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6597f3f9-1526-4062-bcee-6d56b39fd847 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:30.394353 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43be7f1d-e248-4c3b-b979-52ea0711a2a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:30.395855 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43be7f1d-e248-4c3b-b979-52ea0711a2a2 service cinder] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:30.422568 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 954/1897] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:30:30 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 05:30:30.468041 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:30.555366 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6597f3f9-1526-4062-bcee-6d56b39fd847 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:30.559104 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6597f3f9-1526-4062-bcee-6d56b39fd847 service cinder] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:30.576912 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 944/1898] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:30:30 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 05:30:30.791059 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43be7f1d-e248-4c3b-b979-52ea0711a2a2 service cinder] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:30.800961 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43be7f1d-e248-4c3b-b979-52ea0711a2a2 service cinder] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:30.807839 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b948e4-e7ca-4f57-a6b1-1eb957ce6d73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a147e14b61d481db1cac02c58ac3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:30.809289 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b948e4-e7ca-4f57-a6b1-1eb957ce6d73 service cinder] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:30.809806 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b948e4-e7ca-4f57-a6b1-1eb957ce6d73 service cinder] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:30.810294 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b948e4-e7ca-4f57-a6b1-1eb957ce6d73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:30.813199 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-18b948e4-e7ca-4f57-a6b1-1eb957ce6d73 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:30.822554 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:30.937336 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b948e4-e7ca-4f57-a6b1-1eb957ce6d73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:30.939894 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b948e4-e7ca-4f57-a6b1-1eb957ce6d73 service cinder] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:30.954875 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 955/1899] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:30:30 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:30:31.282642 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6597f3f9-1526-4062-bcee-6d56b39fd847 service cinder] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:31.284579 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-6597f3f9-1526-4062-bcee-6d56b39fd847 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:31.496843 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b948e4-e7ca-4f57-a6b1-1eb957ce6d73 service cinder] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:31.529133 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b948e4-e7ca-4f57-a6b1-1eb957ce6d73 service cinder] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:31.539541 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c02b2a-c739-43d3-acf1-61021ce1a7b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a147e14b61d481db1cac02c58ac3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:31.540376 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c02b2a-c739-43d3-acf1-61021ce1a7b2 service cinder] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:31.540755 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c02b2a-c739-43d3-acf1-61021ce1a7b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:31.541219 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c02b2a-c739-43d3-acf1-61021ce1a7b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:31.543705 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6597f3f9-1526-4062-bcee-6d56b39fd847 service cinder] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:31.545387 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-57c02b2a-c739-43d3-acf1-61021ce1a7b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:31.567471 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f04cec-cac4-4487-93f9-cb8f47b3007f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:31.570659 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f04cec-cac4-4487-93f9-cb8f47b3007f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:31.570943 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f04cec-cac4-4487-93f9-cb8f47b3007f admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:31.571216 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f04cec-cac4-4487-93f9-cb8f47b3007f admin admin] PATH_INFO: `/v3/projects/d8c97bfd568047ffb0ce406ad9623226` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:31.575915 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f04cec-cac4-4487-93f9-cb8f47b3007f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8c97bfd568047ffb0ce406ad9623226)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:31.579561 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f04cec-cac4-4487-93f9-cb8f47b3007f admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:31.670986 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-c2f04cec-cac4-4487-93f9-cb8f47b3007f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8c97bfd568047ffb0ce406ad9623226', 'request_id': 'req-c2f04cec-cac4-4487-93f9-cb8f47b3007f'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:31.703789 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-c2f04cec-cac4-4487-93f9-cb8f47b3007f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8c97bfd568047ffb0ce406ad9623226', 'request_id': 'req-c2f04cec-cac4-4487-93f9-cb8f47b3007f'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:31.720852 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-c2f04cec-cac4-4487-93f9-cb8f47b3007f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8c97bfd568047ffb0ce406ad9623226', 'request_id': 'req-c2f04cec-cac4-4487-93f9-cb8f47b3007f'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:31.741023 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c02b2a-c739-43d3-acf1-61021ce1a7b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:31.742995 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c02b2a-c739-43d3-acf1-61021ce1a7b2 service cinder] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:31.757010 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-c2f04cec-cac4-4487-93f9-cb8f47b3007f admin admin] The token cache is being invalidate because project d8c97bfd568047ffb0ce406ad9623226 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81383) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:30:31.757308 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-c2f04cec-cac4-4487-93f9-cb8f47b3007f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:31.758046 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-c2f04cec-cac4-4487-93f9-cb8f47b3007f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:31.763484 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 945/1900] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:30:31 2022] DELETE /identity/v3/projects/d8c97bfd568047ffb0ce406ad9623226 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:30:31.763484 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f04cec-cac4-4487-93f9-cb8f47b3007f admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:31.772727 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-c2f04cec-cac4-4487-93f9-cb8f47b3007f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:31.776369 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 956/1901] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:30:31 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:30:31.778054 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45bb80c-4d13-4605-8ba5-e2c6e159c772 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:31.778525 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45bb80c-4d13-4605-8ba5-e2c6e159c772 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:31.778938 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45bb80c-4d13-4605-8ba5-e2c6e159c772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:31.857247 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-d45bb80c-4d13-4605-8ba5-e2c6e159c772 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:30:31.860586 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-d45bb80c-4d13-4605-8ba5-e2c6e159c772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:31.969757 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:31.992257 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f04cec-cac4-4487-93f9-cb8f47b3007f admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:32.014105 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13db537-5aff-40ce-8c4c-f633e52fc79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:32.018638 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13db537-5aff-40ce-8c4c-f633e52fc79e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:32.019166 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13db537-5aff-40ce-8c4c-f633e52fc79e admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:32.021560 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13db537-5aff-40ce-8c4c-f633e52fc79e admin admin] PATH_INFO: `/v3/users/ea549a3b64c143b6bd75a7039a9f0c93` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:32.023116 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13db537-5aff-40ce-8c4c-f633e52fc79e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea549a3b64c143b6bd75a7039a9f0c93)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:32.028315 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13db537-5aff-40ce-8c4c-f633e52fc79e admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:32.044462 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 957/1902] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:30:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:30:32.054715 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301a7d5-d9d3-466f-ba75-42bc00e96aa1 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:32.054926 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301a7d5-d9d3-466f-ba75-42bc00e96aa1 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:32.055302 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301a7d5-d9d3-466f-ba75-42bc00e96aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:32.141942 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-f13db537-5aff-40ce-8c4c-f633e52fc79e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea549a3b64c143b6bd75a7039a9f0c93'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:32.170953 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-a301a7d5-d9d3-466f-ba75-42bc00e96aa1 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:30:32.175574 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-a301a7d5-d9d3-466f-ba75-42bc00e96aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:32.199729 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 958/1903] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:30:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:30:32.206269 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a301a7d5-d9d3-466f-ba75-42bc00e96aa1 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:32.206426 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-f13db537-5aff-40ce-8c4c-f633e52fc79e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea549a3b64c143b6bd75a7039a9f0c93'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:32.223331 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-f13db537-5aff-40ce-8c4c-f633e52fc79e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea549a3b64c143b6bd75a7039a9f0c93'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:32.233304 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a301a7d5-d9d3-466f-ba75-42bc00e96aa1 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:32.248612 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-f13db537-5aff-40ce-8c4c-f633e52fc79e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea549a3b64c143b6bd75a7039a9f0c93'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:32.250450 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-f13db537-5aff-40ce-8c4c-f633e52fc79e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea549a3b64c143b6bd75a7039a9f0c93'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:32.265503 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac25eb-b380-41e7-a3bd-0b626b8870ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:32.267016 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac25eb-b380-41e7-a3bd-0b626b8870ee admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:32.270988 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac25eb-b380-41e7-a3bd-0b626b8870ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:32.271798 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac25eb-b380-41e7-a3bd-0b626b8870ee admin admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:32.273967 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdac25eb-b380-41e7-a3bd-0b626b8870ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:30:32.276221 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdac25eb-b380-41e7-a3bd-0b626b8870ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:32.280412 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdac25eb-b380-41e7-a3bd-0b626b8870ee admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:32.287216 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 946/1904] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:30:31 2022] DELETE /identity/v3/users/ea549a3b64c143b6bd75a7039a9f0c93 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:30:32.292947 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d3fca-1a2a-4cf3-a0ea-4587dae3ec29 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:32.295116 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d3fca-1a2a-4cf3-a0ea-4587dae3ec29 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:32.295556 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d3fca-1a2a-4cf3-a0ea-4587dae3ec29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:32.314092 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 959/1905] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 05:30:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:30:32.322275 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac25eb-b380-41e7-a3bd-0b626b8870ee admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:32.325743 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-bdac25eb-b380-41e7-a3bd-0b626b8870ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:32.362245 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac25eb-b380-41e7-a3bd-0b626b8870ee admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:32.400304 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-8c4d3fca-1a2a-4cf3-a0ea-4587dae3ec29 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:30:32.404010 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-8c4d3fca-1a2a-4cf3-a0ea-4587dae3ec29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:32.429321 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:32.554484 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88baaa4d-0492-416b-a0cc-1b78298ffefa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:32.556150 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88baaa4d-0492-416b-a0cc-1b78298ffefa admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:32.556876 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88baaa4d-0492-416b-a0cc-1b78298ffefa admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:32.557368 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88baaa4d-0492-416b-a0cc-1b78298ffefa admin admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:32.559093 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88baaa4d-0492-416b-a0cc-1b78298ffefa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:32.562184 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88baaa4d-0492-416b-a0cc-1b78298ffefa admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:32.634880 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 960/1906] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:30:32 2022] POST /identity/v3/projects => generated 387 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:30:32.636538 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88baaa4d-0492-416b-a0cc-1b78298ffefa admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:32.644289 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 947/1907] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:30:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:30:32.658897 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4d3fca-1a2a-4cf3-a0ea-4587dae3ec29 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:32.659431 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-8c4d3fca-1a2a-4cf3-a0ea-4587dae3ec29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:32.799399 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4d3fca-1a2a-4cf3-a0ea-4587dae3ec29 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:32.805678 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88baaa4d-0492-416b-a0cc-1b78298ffefa admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:32.820182 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f6c79e-0023-484f-bc03-a8616735bd5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:32.822545 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f6c79e-0023-484f-bc03-a8616735bd5c admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:32.823237 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f6c79e-0023-484f-bc03-a8616735bd5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:32.823935 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f6c79e-0023-484f-bc03-a8616735bd5c admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:32.825537 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f6c79e-0023-484f-bc03-a8616735bd5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:32.831263 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f6c79e-0023-484f-bc03-a8616735bd5c admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:32.876887 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 961/1908] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:30:32 2022] POST /identity/v3/users => generated 294 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:30:32.880292 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:32.882091 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f6c79e-0023-484f-bc03-a8616735bd5c admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:32.913817 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f6c79e-0023-484f-bc03-a8616735bd5c admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:32.926604 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26118853-642b-49af-8383-3525577c4326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:32.928917 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26118853-642b-49af-8383-3525577c4326 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:32.928917 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26118853-642b-49af-8383-3525577c4326 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:32.929838 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26118853-642b-49af-8383-3525577c4326 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:32.931493 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26118853-642b-49af-8383-3525577c4326 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:32.935247 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26118853-642b-49af-8383-3525577c4326 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:32.938267 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9fb46e-e468-471f-83a3-9e89280262e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:32.939042 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9fb46e-e468-471f-83a3-9e89280262e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:32.939419 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9fb46e-e468-471f-83a3-9e89280262e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:32.939816 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9fb46e-e468-471f-83a3-9e89280262e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:32.962481 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9fb46e-e468-471f-83a3-9e89280262e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:32.962723 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 962/1909] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:30:32 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:30:32.963751 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26118853-642b-49af-8383-3525577c4326 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:32.966132 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9fb46e-e468-471f-83a3-9e89280262e9 service neutron] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:32.996571 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26118853-642b-49af-8383-3525577c4326 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:33.004378 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 948/1910] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:30:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:30:33.008899 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e07c42-d379-437f-87b8-c5fdee65e665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:33.009877 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e07c42-d379-437f-87b8-c5fdee65e665 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:33.010440 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e07c42-d379-437f-87b8-c5fdee65e665 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:33.010864 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e07c42-d379-437f-87b8-c5fdee65e665 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:33.012364 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e07c42-d379-437f-87b8-c5fdee65e665 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:33.017421 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e07c42-d379-437f-87b8-c5fdee65e665 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:33.054995 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 963/1911] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:30:32 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:30:33.060252 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9fb46e-e468-471f-83a3-9e89280262e9 service neutron] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:33.087143 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9fb46e-e468-471f-83a3-9e89280262e9 service neutron] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:33.112151 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a04d71e-2718-4d57-bc03-7f2be59b8a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:33.113041 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a04d71e-2718-4d57-bc03-7f2be59b8a64 admin admin] REQUEST_METHOD: `PUT` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:33.113322 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a04d71e-2718-4d57-bc03-7f2be59b8a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:33.113591 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a04d71e-2718-4d57-bc03-7f2be59b8a64 admin admin] PATH_INFO: `/v3/projects/ba93cb0addf648d8852faa33369a9aac/users/2c323c1d905749b581d52e748c3a6560/roles/aa7ff8e0ec1e48e5811335b9eb38b448` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:33.151173 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a04d71e-2718-4d57-bc03-7f2be59b8a64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba93cb0addf648d8852faa33369a9aac, user_id=2c323c1d905749b581d52e748c3a6560, role_id=aa7ff8e0ec1e48e5811335b9eb38b448)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:33.160591 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a04d71e-2718-4d57-bc03-7f2be59b8a64 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:33.203060 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 949/1912] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:30:33 2022] PUT /identity/v3/projects/ba93cb0addf648d8852faa33369a9aac/users/2c323c1d905749b581d52e748c3a6560/roles/aa7ff8e0ec1e48e5811335b9eb38b448 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:30:33.204919 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef2f8c-2971-4dea-90a8-920803a703c1 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:33.205499 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef2f8c-2971-4dea-90a8-920803a703c1 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:33.205903 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef2f8c-2971-4dea-90a8-920803a703c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:33.284736 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-93ef2f8c-2971-4dea-90a8-920803a703c1 None None] MFA Rules not processed for user `2c323c1d905749b581d52e748c3a6560`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:30:33.286188 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-93ef2f8c-2971-4dea-90a8-920803a703c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:33.409811 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 964/1913] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:30:33 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:30:33.414616 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a04d71e-2718-4d57-bc03-7f2be59b8a64 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:33.633529 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a04d71e-2718-4d57-bc03-7f2be59b8a64 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:33.650855 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac2be6f-87fb-4ef7-92a6-67d9bc045952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:33.652036 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac2be6f-87fb-4ef7-92a6-67d9bc045952 admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:33.652604 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac2be6f-87fb-4ef7-92a6-67d9bc045952 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:33.652878 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac2be6f-87fb-4ef7-92a6-67d9bc045952 admin admin] PATH_INFO: `/v3/projects` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:33.653704 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac2be6f-87fb-4ef7-92a6-67d9bc045952 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:33.655875 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac2be6f-87fb-4ef7-92a6-67d9bc045952 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:33.717726 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 950/1914] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:30:33 2022] POST /identity/v3/projects => generated 389 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 05:30:33.722460 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef2f8c-2971-4dea-90a8-920803a703c1 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:33.737389 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef2f8c-2971-4dea-90a8-920803a703c1 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:33.745100 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:33.796857 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac2be6f-87fb-4ef7-92a6-67d9bc045952 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:33.802660 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-bac2be6f-87fb-4ef7-92a6-67d9bc045952 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:33.934731 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494672ad-2e54-4c24-93e4-870398298c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:33.936002 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494672ad-2e54-4c24-93e4-870398298c90 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:33.936636 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494672ad-2e54-4c24-93e4-870398298c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:33.937169 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494672ad-2e54-4c24-93e4-870398298c90 admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:33.937980 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494672ad-2e54-4c24-93e4-870398298c90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:33.940487 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494672ad-2e54-4c24-93e4-870398298c90 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:34.008741 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 965/1915] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:30:33 2022] POST /identity/v3/users => generated 301 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:30:34.012798 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494672ad-2e54-4c24-93e4-870398298c90 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:34.017850 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac2be6f-87fb-4ef7-92a6-67d9bc045952 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:34.029735 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494672ad-2e54-4c24-93e4-870398298c90 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:34.031492 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bd36fa-46d5-4245-9f24-cdff4b5df913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:34.033935 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd36fa-46d5-4245-9f24-cdff4b5df913 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:34.034090 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd36fa-46d5-4245-9f24-cdff4b5df913 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:34.034500 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd36fa-46d5-4245-9f24-cdff4b5df913 admin admin] PATH_INFO: `/v3/projects/68dc19de003b4bca880e862ad6ee6b63` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:34.037557 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bd36fa-46d5-4245-9f24-cdff4b5df913 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68dc19de003b4bca880e862ad6ee6b63)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:34.038595 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bd36fa-46d5-4245-9f24-cdff4b5df913 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:34.046378 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2fc0f1-cbb5-43fb-8464-8c0c821f44c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:34.047660 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2fc0f1-cbb5-43fb-8464-8c0c821f44c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:34.048538 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2fc0f1-cbb5-43fb-8464-8c0c821f44c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:34.049031 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2fc0f1-cbb5-43fb-8464-8c0c821f44c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:34.051058 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2fc0f1-cbb5-43fb-8464-8c0c821f44c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:34.056826 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2fc0f1-cbb5-43fb-8464-8c0c821f44c4 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:34.088367 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 966/1916] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:30:34 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:30:34.092894 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2fc0f1-cbb5-43fb-8464-8c0c821f44c4 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:34.117490 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2fc0f1-cbb5-43fb-8464-8c0c821f44c4 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:34.124889 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:34.145558 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-74bd36fa-46d5-4245-9f24-cdff4b5df913 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68dc19de003b4bca880e862ad6ee6b63', 'request_id': 'req-74bd36fa-46d5-4245-9f24-cdff4b5df913'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:34.160204 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-74bd36fa-46d5-4245-9f24-cdff4b5df913 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68dc19de003b4bca880e862ad6ee6b63', 'request_id': 'req-74bd36fa-46d5-4245-9f24-cdff4b5df913'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:34.171660 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-74bd36fa-46d5-4245-9f24-cdff4b5df913 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68dc19de003b4bca880e862ad6ee6b63', 'request_id': 'req-74bd36fa-46d5-4245-9f24-cdff4b5df913'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:34.193816 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-74bd36fa-46d5-4245-9f24-cdff4b5df913 admin admin] The token cache is being invalidate because project 68dc19de003b4bca880e862ad6ee6b63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81383) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:30:34.195587 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-74bd36fa-46d5-4245-9f24-cdff4b5df913 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:34.195587 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-74bd36fa-46d5-4245-9f24-cdff4b5df913 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:34.199100 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 951/1917] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:30:33 2022] DELETE /identity/v3/projects/68dc19de003b4bca880e862ad6ee6b63 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:30:34.203199 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bd36fa-46d5-4245-9f24-cdff4b5df913 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:34.204935 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-74bd36fa-46d5-4245-9f24-cdff4b5df913 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:34.221457 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e1735a-538e-4a48-b1c1-9d3791454e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:34.222571 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e1735a-538e-4a48-b1c1-9d3791454e03 admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:34.223579 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e1735a-538e-4a48-b1c1-9d3791454e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:34.224050 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e1735a-538e-4a48-b1c1-9d3791454e03 admin admin] PATH_INFO: `/v3/projects/41b4e486d3534360900926688ff671d3/users/812e083f8ab445898e019886723032fe/roles/5b702713e40145b49e0b42abd0a5fba9` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:34.289724 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e1735a-538e-4a48-b1c1-9d3791454e03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41b4e486d3534360900926688ff671d3, user_id=812e083f8ab445898e019886723032fe, role_id=5b702713e40145b49e0b42abd0a5fba9)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:34.291652 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e1735a-538e-4a48-b1c1-9d3791454e03 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:34.321314 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 967/1918] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:30:34 2022] PUT /identity/v3/projects/41b4e486d3534360900926688ff671d3/users/812e083f8ab445898e019886723032fe/roles/5b702713e40145b49e0b42abd0a5fba9 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:30:34.333093 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bd36fa-46d5-4245-9f24-cdff4b5df913 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:34.333566 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e1735a-538e-4a48-b1c1-9d3791454e03 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:34.338246 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-a2e1735a-538e-4a48-b1c1-9d3791454e03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:34.466701 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e1735a-538e-4a48-b1c1-9d3791454e03 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:34.471931 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da613157-6c1d-41b7-a6c8-f2985b98e71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:34.472795 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da613157-6c1d-41b7-a6c8-f2985b98e71f admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:34.473234 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da613157-6c1d-41b7-a6c8-f2985b98e71f admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:34.473656 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da613157-6c1d-41b7-a6c8-f2985b98e71f admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:34.474454 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da613157-6c1d-41b7-a6c8-f2985b98e71f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:34.476285 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da613157-6c1d-41b7-a6c8-f2985b98e71f admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:34.485716 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d344028-bffb-4f9d-81b9-27d9a98709e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:34.486461 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d344028-bffb-4f9d-81b9-27d9a98709e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:34.487438 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d344028-bffb-4f9d-81b9-27d9a98709e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:34.488673 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d344028-bffb-4f9d-81b9-27d9a98709e5 admin admin] PATH_INFO: `/v3/users/872c0c098c274d6ca3a9fc0bd9f8d79e` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:34.490256 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d344028-bffb-4f9d-81b9-27d9a98709e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=872c0c098c274d6ca3a9fc0bd9f8d79e)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:34.492483 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d344028-bffb-4f9d-81b9-27d9a98709e5 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:34.492816 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 968/1919] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:30:34 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:30:34.498122 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da613157-6c1d-41b7-a6c8-f2985b98e71f admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:34.505761 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:34.513617 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da613157-6c1d-41b7-a6c8-f2985b98e71f admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:34.536014 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1060f2a2-f40c-40f0-a1f8-628dfd4016a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:34.537190 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1060f2a2-f40c-40f0-a1f8-628dfd4016a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:34.537673 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1060f2a2-f40c-40f0-a1f8-628dfd4016a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:34.538158 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1060f2a2-f40c-40f0-a1f8-628dfd4016a2 admin admin] PATH_INFO: `/v3/projects/41b4e486d3534360900926688ff671d3/users/812e083f8ab445898e019886723032fe/roles/5b702713e40145b49e0b42abd0a5fba9` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:34.540655 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1060f2a2-f40c-40f0-a1f8-628dfd4016a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41b4e486d3534360900926688ff671d3, user_id=812e083f8ab445898e019886723032fe, role_id=5b702713e40145b49e0b42abd0a5fba9)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:34.545478 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1060f2a2-f40c-40f0-a1f8-628dfd4016a2 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:34.559912 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 969/1920] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:30:34 2022] PUT /identity/v3/projects/41b4e486d3534360900926688ff671d3/users/812e083f8ab445898e019886723032fe/roles/5b702713e40145b49e0b42abd0a5fba9 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 05:30:34.572067 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f07ac1-9d3c-4b1c-af0d-acccce27fb53 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:34.572483 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f07ac1-9d3c-4b1c-af0d-acccce27fb53 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:34.574036 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f07ac1-9d3c-4b1c-af0d-acccce27fb53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:34.606550 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-4d344028-bffb-4f9d-81b9-27d9a98709e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '872c0c098c274d6ca3a9fc0bd9f8d79e'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:34.613803 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-c4f07ac1-9d3c-4b1c-af0d-acccce27fb53 None None] MFA Rules not processed for user `812e083f8ab445898e019886723032fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:30:34.625289 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-c4f07ac1-9d3c-4b1c-af0d-acccce27fb53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:34.643814 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-4d344028-bffb-4f9d-81b9-27d9a98709e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '872c0c098c274d6ca3a9fc0bd9f8d79e'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:34.673595 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-4d344028-bffb-4f9d-81b9-27d9a98709e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '872c0c098c274d6ca3a9fc0bd9f8d79e'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:34.678575 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:34.706108 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-4d344028-bffb-4f9d-81b9-27d9a98709e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '872c0c098c274d6ca3a9fc0bd9f8d79e'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:34.706869 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-4d344028-bffb-4f9d-81b9-27d9a98709e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '872c0c098c274d6ca3a9fc0bd9f8d79e'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:34.717354 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 952/1921] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:30:34 2022] DELETE /identity/v3/users/872c0c098c274d6ca3a9fc0bd9f8d79e => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:30:34.819801 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 970/1922] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:30:34 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 05:30:34.836840 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d344028-bffb-4f9d-81b9-27d9a98709e5 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:34.838916 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-4d344028-bffb-4f9d-81b9-27d9a98709e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:35.009789 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d344028-bffb-4f9d-81b9-27d9a98709e5 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:35.015491 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5424266-2847-4bb3-87eb-418f9fcf845a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a147e14b61d481db1cac02c58ac3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:35.016150 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5424266-2847-4bb3-87eb-418f9fcf845a service cinder] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:35.016430 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5424266-2847-4bb3-87eb-418f9fcf845a service cinder] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:35.016701 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5424266-2847-4bb3-87eb-418f9fcf845a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:35.196006 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5424266-2847-4bb3-87eb-418f9fcf845a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:35.200097 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5424266-2847-4bb3-87eb-418f9fcf845a service cinder] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:35.269345 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 953/1923] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:30:34 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:30:35.456482 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f07ac1-9d3c-4b1c-af0d-acccce27fb53 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:35.462115 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-c4f07ac1-9d3c-4b1c-af0d-acccce27fb53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:35.656351 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5424266-2847-4bb3-87eb-418f9fcf845a service cinder] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:35.658217 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-e5424266-2847-4bb3-87eb-418f9fcf845a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:35.701987 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f07ac1-9d3c-4b1c-af0d-acccce27fb53 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:35.790149 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5424266-2847-4bb3-87eb-418f9fcf845a service cinder] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:35.797456 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ca7049-3d52-482d-befb-7a146e3d390f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:35.798557 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ca7049-3d52-482d-befb-7a146e3d390f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:35.799055 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ca7049-3d52-482d-befb-7a146e3d390f admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:35.799672 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ca7049-3d52-482d-befb-7a146e3d390f admin admin] PATH_INFO: `/v3/users/2c323c1d905749b581d52e748c3a6560` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:35.801381 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ca7049-3d52-482d-befb-7a146e3d390f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c323c1d905749b581d52e748c3a6560)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:35.804139 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ca7049-3d52-482d-befb-7a146e3d390f admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:35.820364 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0e876a-5883-44e3-b258-50b35195b15d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:35.821086 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0e876a-5883-44e3-b258-50b35195b15d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:35.821476 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0e876a-5883-44e3-b258-50b35195b15d admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:35.821762 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0e876a-5883-44e3-b258-50b35195b15d admin admin] PATH_INFO: `/v3/projects/9c2983243b284d3bb420a7d5ce750798` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:35.823005 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0e876a-5883-44e3-b258-50b35195b15d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c2983243b284d3bb420a7d5ce750798)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:35.825255 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0e876a-5883-44e3-b258-50b35195b15d admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:35.876152 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:35.879577 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:DELETE=8,keystone:SELECT=92 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:35.881704 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-66ca7049-3d52-482d-befb-7a146e3d390f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c323c1d905749b581d52e748c3a6560'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:35.904029 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-66ca7049-3d52-482d-befb-7a146e3d390f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c323c1d905749b581d52e748c3a6560'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:35.904412 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-9c0e876a-5883-44e3-b258-50b35195b15d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c2983243b284d3bb420a7d5ce750798', 'request_id': 'req-9c0e876a-5883-44e3-b258-50b35195b15d'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:35.913274 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-9c0e876a-5883-44e3-b258-50b35195b15d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c2983243b284d3bb420a7d5ce750798', 'request_id': 'req-9c0e876a-5883-44e3-b258-50b35195b15d'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:35.915940 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-66ca7049-3d52-482d-befb-7a146e3d390f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c323c1d905749b581d52e748c3a6560'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:35.922394 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-9c0e876a-5883-44e3-b258-50b35195b15d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c2983243b284d3bb420a7d5ce750798', 'request_id': 'req-9c0e876a-5883-44e3-b258-50b35195b15d'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:35.926717 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-66ca7049-3d52-482d-befb-7a146e3d390f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c323c1d905749b581d52e748c3a6560'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:35.928021 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-66ca7049-3d52-482d-befb-7a146e3d390f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c323c1d905749b581d52e748c3a6560'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:35.940663 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 954/1924] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:30:35 2022] DELETE /identity/v3/users/2c323c1d905749b581d52e748c3a6560 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:30:35.943811 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-9c0e876a-5883-44e3-b258-50b35195b15d admin admin] The token cache is being invalidate because project 9c2983243b284d3bb420a7d5ce750798 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:30:35.944128 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-9c0e876a-5883-44e3-b258-50b35195b15d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:35.944966 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-9c0e876a-5883-44e3-b258-50b35195b15d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:35.946012 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdef42f-a3ab-41b8-aebf-ca88bd41612f None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:35.946507 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdef42f-a3ab-41b8-aebf-ca88bd41612f None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:35.946629 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 971/1925] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:30:35 2022] DELETE /identity/v3/projects/9c2983243b284d3bb420a7d5ce750798 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:30:35.947080 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdef42f-a3ab-41b8-aebf-ca88bd41612f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:35.953952 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be7778-ff84-4a4a-9f0c-291f34916a50 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:35.954309 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be7778-ff84-4a4a-9f0c-291f34916a50 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:35.954511 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be7778-ff84-4a4a-9f0c-291f34916a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:35.976605 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-5fdef42f-a3ab-41b8-aebf-ca88bd41612f None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:30:35.981245 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-5fdef42f-a3ab-41b8-aebf-ca88bd41612f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:35.981874 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-35be7778-ff84-4a4a-9f0c-291f34916a50 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:30:35.983473 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-35be7778-ff84-4a4a-9f0c-291f34916a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:36.093494 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 972/1926] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:30:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:30:36.112688 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a0568-af9a-4807-834a-555a54fb7f23 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:36.114714 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a0568-af9a-4807-834a-555a54fb7f23 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:36.115105 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a0568-af9a-4807-834a-555a54fb7f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:36.159062 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 955/1927] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:30:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:30:36.160034 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-a25a0568-af9a-4807-834a-555a54fb7f23 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:30:36.162414 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-a25a0568-af9a-4807-834a-555a54fb7f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:36.172275 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 973/1928] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:30:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:30:36.176591 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdef42f-a3ab-41b8-aebf-ca88bd41612f None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:36.187765 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25a0568-af9a-4807-834a-555a54fb7f23 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:36.188818 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdef42f-a3ab-41b8-aebf-ca88bd41612f None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:36.191153 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-a25a0568-af9a-4807-834a-555a54fb7f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:36.194561 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6cef79-b7ea-4646-9c48-983542782219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:36.195611 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6cef79-b7ea-4646-9c48-983542782219 admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:36.196118 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6cef79-b7ea-4646-9c48-983542782219 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:36.196546 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6cef79-b7ea-4646-9c48-983542782219 admin admin] PATH_INFO: `/v3/domains` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:36.197571 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6cef79-b7ea-4646-9c48-983542782219 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:30:36.198110 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6cef79-b7ea-4646-9c48-983542782219 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:36.200629 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6cef79-b7ea-4646-9c48-983542782219 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:36.216571 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 956/1929] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 05:30:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:30:36.223827 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6cef79-b7ea-4646-9c48-983542782219 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:36.251585 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6cef79-b7ea-4646-9c48-983542782219 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:36.262722 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6567a97f-cc30-4a49-9112-9852cbb0c20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:36.264224 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6567a97f-cc30-4a49-9112-9852cbb0c20f admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:36.264710 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6567a97f-cc30-4a49-9112-9852cbb0c20f admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:36.265089 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6567a97f-cc30-4a49-9112-9852cbb0c20f admin admin] PATH_INFO: `/v3/projects` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:36.267194 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6567a97f-cc30-4a49-9112-9852cbb0c20f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:36.270045 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6567a97f-cc30-4a49-9112-9852cbb0c20f admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:36.320227 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25a0568-af9a-4807-834a-555a54fb7f23 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:36.338537 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3822c27-142c-4da1-95de-9cd2d40dbfd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:36.339443 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3822c27-142c-4da1-95de-9cd2d40dbfd3 service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:36.339895 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3822c27-142c-4da1-95de-9cd2d40dbfd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:36.340257 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3822c27-142c-4da1-95de-9cd2d40dbfd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:36.355937 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 957/1930] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:30:36 2022] POST /identity/v3/projects => generated 385 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 05:30:36.358528 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3822c27-142c-4da1-95de-9cd2d40dbfd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:36.361051 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6567a97f-cc30-4a49-9112-9852cbb0c20f admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:36.361215 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3822c27-142c-4da1-95de-9cd2d40dbfd3 service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:36.400277 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 974/1931] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:30:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:30:36.492780 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6567a97f-cc30-4a49-9112-9852cbb0c20f admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:36.504920 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc1cee3-867e-4f62-9ba9-bcacbd39138b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:36.505728 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc1cee3-867e-4f62-9ba9-bcacbd39138b admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:36.506110 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc1cee3-867e-4f62-9ba9-bcacbd39138b admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:36.506529 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc1cee3-867e-4f62-9ba9-bcacbd39138b admin admin] PATH_INFO: `/v3/users` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:36.507276 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc1cee3-867e-4f62-9ba9-bcacbd39138b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:36.511525 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc1cee3-867e-4f62-9ba9-bcacbd39138b admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:36.579721 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 958/1932] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:30:36 2022] POST /identity/v3/users => generated 293 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:30:36.581418 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3822c27-142c-4da1-95de-9cd2d40dbfd3 service neutron] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:36.599019 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3822c27-142c-4da1-95de-9cd2d40dbfd3 service neutron] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:36.611406 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44d239c-fb10-4369-a987-1f272332c0c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:36.612407 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d239c-fb10-4369-a987-1f272332c0c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:36.612744 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d239c-fb10-4369-a987-1f272332c0c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:36.612987 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d239c-fb10-4369-a987-1f272332c0c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:36.613887 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44d239c-fb10-4369-a987-1f272332c0c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:36.616769 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44d239c-fb10-4369-a987-1f272332c0c7 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:36.641353 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 975/1933] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:30:36.644814 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc1cee3-867e-4f62-9ba9-bcacbd39138b admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:36.660425 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc1cee3-867e-4f62-9ba9-bcacbd39138b admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:36.673048 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878154a7-2c5c-4251-a1cd-d11e99b3aa32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:36.673788 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878154a7-2c5c-4251-a1cd-d11e99b3aa32 admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:36.674141 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878154a7-2c5c-4251-a1cd-d11e99b3aa32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:36.674491 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878154a7-2c5c-4251-a1cd-d11e99b3aa32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:36.675221 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878154a7-2c5c-4251-a1cd-d11e99b3aa32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:36.679057 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878154a7-2c5c-4251-a1cd-d11e99b3aa32 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:36.705901 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 959/1934] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:30:36.711659 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44d239c-fb10-4369-a987-1f272332c0c7 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:36.728372 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44d239c-fb10-4369-a987-1f272332c0c7 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:36.728372 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcdec49-fdfe-4b69-b43e-fe84516bf52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:36.728372 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcdec49-fdfe-4b69-b43e-fe84516bf52b admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:36.729289 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcdec49-fdfe-4b69-b43e-fe84516bf52b admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:36.729697 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcdec49-fdfe-4b69-b43e-fe84516bf52b admin admin] PATH_INFO: `/v3/projects/b5df7c3b0e034c21b24e8dc62a4a4aa5/users/e6908b95490b41f8947237a2cf047635/roles/aa7ff8e0ec1e48e5811335b9eb38b448` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:36.771033 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcdec49-fdfe-4b69-b43e-fe84516bf52b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5df7c3b0e034c21b24e8dc62a4a4aa5, user_id=e6908b95490b41f8947237a2cf047635, role_id=aa7ff8e0ec1e48e5811335b9eb38b448)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:36.774453 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcdec49-fdfe-4b69-b43e-fe84516bf52b admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:36.825746 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 976/1935] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:30:36 2022] PUT /identity/v3/projects/b5df7c3b0e034c21b24e8dc62a4a4aa5/users/e6908b95490b41f8947237a2cf047635/roles/aa7ff8e0ec1e48e5811335b9eb38b448 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:30:36.826559 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a39ad-9481-492a-82bc-baa577b85732 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:36.827179 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a39ad-9481-492a-82bc-baa577b85732 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:36.827477 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a39ad-9481-492a-82bc-baa577b85732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:36.851973 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:36.880002 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-4b4a39ad-9481-492a-82bc-baa577b85732 None None] MFA Rules not processed for user `e6908b95490b41f8947237a2cf047635`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:30:36.880002 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-4b4a39ad-9481-492a-82bc-baa577b85732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:37.155800 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 960/1936] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:30:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 05:30:37.173463 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcdec49-fdfe-4b69-b43e-fe84516bf52b admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:37.173463 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-6fcdec49-fdfe-4b69-b43e-fe84516bf52b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:37.206777 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4a39ad-9481-492a-82bc-baa577b85732 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:37.208239 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-4b4a39ad-9481-492a-82bc-baa577b85732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:37.219001 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:37.299820 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcdec49-fdfe-4b69-b43e-fe84516bf52b admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:37.304272 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11127855-f01b-4e18-9ba7-61bc80241b9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a147e14b61d481db1cac02c58ac3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:37.305021 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11127855-f01b-4e18-9ba7-61bc80241b9b service cinder] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:37.305380 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11127855-f01b-4e18-9ba7-61bc80241b9b service cinder] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:37.305798 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11127855-f01b-4e18-9ba7-61bc80241b9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:37.348318 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11127855-f01b-4e18-9ba7-61bc80241b9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:37.351516 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4a39ad-9481-492a-82bc-baa577b85732 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:37.352017 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11127855-f01b-4e18-9ba7-61bc80241b9b service cinder] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:37.357550 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dd6293-acb7-4fb9-985d-8c7e60af2474 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a147e14b61d481db1cac02c58ac3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:37.358468 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd6293-acb7-4fb9-985d-8c7e60af2474 service cinder] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:37.358907 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd6293-acb7-4fb9-985d-8c7e60af2474 service cinder] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:37.359349 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd6293-acb7-4fb9-985d-8c7e60af2474 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:37.361418 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-82dd6293-acb7-4fb9-985d-8c7e60af2474 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:37.366725 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 977/1937] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:30:37 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:30:37.368159 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11127855-f01b-4e18-9ba7-61bc80241b9b service cinder] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:37.390206 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-11127855-f01b-4e18-9ba7-61bc80241b9b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:37.464863 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dd6293-acb7-4fb9-985d-8c7e60af2474 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:37.466814 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dd6293-acb7-4fb9-985d-8c7e60af2474 service cinder] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:37.493535 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 961/1938] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:30:37 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:30:37.495624 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dd6293-acb7-4fb9-985d-8c7e60af2474 service cinder] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:37.530566 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11127855-f01b-4e18-9ba7-61bc80241b9b service cinder] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:37.545429 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb12ced-db26-420b-be57-e55de78dc2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:37.546290 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb12ced-db26-420b-be57-e55de78dc2b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:37.546671 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb12ced-db26-420b-be57-e55de78dc2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:37.547051 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb12ced-db26-420b-be57-e55de78dc2b5 admin admin] PATH_INFO: `/v3/projects/ba93cb0addf648d8852faa33369a9aac` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:37.550474 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb12ced-db26-420b-be57-e55de78dc2b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba93cb0addf648d8852faa33369a9aac)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:37.552633 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb12ced-db26-420b-be57-e55de78dc2b5 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:37.577456 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:37.613053 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dd6293-acb7-4fb9-985d-8c7e60af2474 service cinder] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:37.626099 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbe1c34-4a6e-4070-b138-c75af777b517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:37.627921 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe1c34-4a6e-4070-b138-c75af777b517 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:37.627921 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe1c34-4a6e-4070-b138-c75af777b517 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:37.627921 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe1c34-4a6e-4070-b138-c75af777b517 admin admin] PATH_INFO: `/v3/users/e6908b95490b41f8947237a2cf047635` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:37.628414 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbe1c34-4a6e-4070-b138-c75af777b517 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6908b95490b41f8947237a2cf047635)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:37.634741 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbe1c34-4a6e-4070-b138-c75af777b517 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:37.696006 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-edb12ced-db26-420b-be57-e55de78dc2b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba93cb0addf648d8852faa33369a9aac', 'request_id': 'req-edb12ced-db26-420b-be57-e55de78dc2b5'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:37.731599 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-edb12ced-db26-420b-be57-e55de78dc2b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba93cb0addf648d8852faa33369a9aac', 'request_id': 'req-edb12ced-db26-420b-be57-e55de78dc2b5'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:37.783520 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-edb12ced-db26-420b-be57-e55de78dc2b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba93cb0addf648d8852faa33369a9aac', 'request_id': 'req-edb12ced-db26-420b-be57-e55de78dc2b5'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:37.830805 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-edb12ced-db26-420b-be57-e55de78dc2b5 admin admin] The token cache is being invalidate because project ba93cb0addf648d8852faa33369a9aac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:30:37.831511 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-edb12ced-db26-420b-be57-e55de78dc2b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:37.835305 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-edb12ced-db26-420b-be57-e55de78dc2b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:37.842022 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 978/1939] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:30:37 2022] DELETE /identity/v3/projects/ba93cb0addf648d8852faa33369a9aac => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:30:37.846481 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb12ced-db26-420b-be57-e55de78dc2b5 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:37.847944 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-cbbe1c34-4a6e-4070-b138-c75af777b517 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6908b95490b41f8947237a2cf047635'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:37.849971 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-edb12ced-db26-420b-be57-e55de78dc2b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:37.899557 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-cbbe1c34-4a6e-4070-b138-c75af777b517 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6908b95490b41f8947237a2cf047635'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:37.925425 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-cbbe1c34-4a6e-4070-b138-c75af777b517 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6908b95490b41f8947237a2cf047635'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:37.943734 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-cbbe1c34-4a6e-4070-b138-c75af777b517 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6908b95490b41f8947237a2cf047635'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:37.944126 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-cbbe1c34-4a6e-4070-b138-c75af777b517 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6908b95490b41f8947237a2cf047635'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:37.962081 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 962/1940] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:30:37 2022] DELETE /identity/v3/users/e6908b95490b41f8947237a2cf047635 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:30:37.966981 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b51440d-dc9a-4092-811d-f24cc9fd1636 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:37.967347 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b51440d-dc9a-4092-811d-f24cc9fd1636 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:37.967582 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b51440d-dc9a-4092-811d-f24cc9fd1636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:37.987387 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:38.020779 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-9b51440d-dc9a-4092-811d-f24cc9fd1636 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:30:38.023381 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-9b51440d-dc9a-4092-811d-f24cc9fd1636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:38.038576 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb12ced-db26-420b-be57-e55de78dc2b5 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:38.198393 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf46cb14-f534-444b-9e6e-f03b7d34115a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:38.199058 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46cb14-f534-444b-9e6e-f03b7d34115a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:38.199393 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46cb14-f534-444b-9e6e-f03b7d34115a admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:38.199889 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46cb14-f534-444b-9e6e-f03b7d34115a admin admin] PATH_INFO: `/v3/users/812e083f8ab445898e019886723032fe` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:38.203237 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf46cb14-f534-444b-9e6e-f03b7d34115a admin admin] RBAC: Authorizing `identity:delete_user(user_id=812e083f8ab445898e019886723032fe)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:38.210982 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf46cb14-f534-444b-9e6e-f03b7d34115a admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:38.251175 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 963/1941] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:30:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:30:38.265618 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b51440d-dc9a-4092-811d-f24cc9fd1636 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:38.267612 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-9b51440d-dc9a-4092-811d-f24cc9fd1636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:38.320670 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-bf46cb14-f534-444b-9e6e-f03b7d34115a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '812e083f8ab445898e019886723032fe'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:38.389752 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-bf46cb14-f534-444b-9e6e-f03b7d34115a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '812e083f8ab445898e019886723032fe'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:38.403547 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b51440d-dc9a-4092-811d-f24cc9fd1636 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:38.411172 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-bf46cb14-f534-444b-9e6e-f03b7d34115a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '812e083f8ab445898e019886723032fe'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:38.430612 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-bf46cb14-f534-444b-9e6e-f03b7d34115a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '812e083f8ab445898e019886723032fe'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:38.445585 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-bf46cb14-f534-444b-9e6e-f03b7d34115a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '812e083f8ab445898e019886723032fe'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:38.445943 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac48ce4-25cc-42bb-a8fd-74ac1c710726 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:38.445943 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac48ce4-25cc-42bb-a8fd-74ac1c710726 service neutron] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:38.445943 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac48ce4-25cc-42bb-a8fd-74ac1c710726 service neutron] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:38.445943 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac48ce4-25cc-42bb-a8fd-74ac1c710726 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:38.446586 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 979/1942] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:30:37 2022] DELETE /identity/v3/users/812e083f8ab445898e019886723032fe => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:30:38.454498 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-9ac48ce4-25cc-42bb-a8fd-74ac1c710726 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:38.517070 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac48ce4-25cc-42bb-a8fd-74ac1c710726 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:38.519480 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac48ce4-25cc-42bb-a8fd-74ac1c710726 service neutron] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:38.543624 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 964/1943] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:30:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 05:30:39.445505 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac48ce4-25cc-42bb-a8fd-74ac1c710726 service neutron] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:39.451957 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf46cb14-f534-444b-9e6e-f03b7d34115a admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:39.452674 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-bf46cb14-f534-444b-9e6e-f03b7d34115a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:39.452850 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-9ac48ce4-25cc-42bb-a8fd-74ac1c710726 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:39.498276 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac48ce4-25cc-42bb-a8fd-74ac1c710726 service neutron] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:39.530500 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:39.724006 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf46cb14-f534-444b-9e6e-f03b7d34115a admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:39.735718 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdd8dd4-fcbc-4d8a-8a25-9cb672cbaaa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:39.736349 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdd8dd4-fcbc-4d8a-8a25-9cb672cbaaa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:39.736739 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdd8dd4-fcbc-4d8a-8a25-9cb672cbaaa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:39.737273 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdd8dd4-fcbc-4d8a-8a25-9cb672cbaaa6 admin admin] PATH_INFO: `/v3/projects/41b4e486d3534360900926688ff671d3` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:39.741373 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdd8dd4-fcbc-4d8a-8a25-9cb672cbaaa6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41b4e486d3534360900926688ff671d3)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:39.746057 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdd8dd4-fcbc-4d8a-8a25-9cb672cbaaa6 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:39.781690 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:39.809414 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fc1361-5675-4901-98c6-e17cf9032fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:39.811641 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fc1361-5675-4901-98c6-e17cf9032fa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:39.812750 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fc1361-5675-4901-98c6-e17cf9032fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:39.813708 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fc1361-5675-4901-98c6-e17cf9032fa5 admin admin] PATH_INFO: `/v3/projects/b5df7c3b0e034c21b24e8dc62a4a4aa5` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:39.821946 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fc1361-5675-4901-98c6-e17cf9032fa5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5df7c3b0e034c21b24e8dc62a4a4aa5)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:39.830436 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fc1361-5675-4901-98c6-e17cf9032fa5 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:39.834646 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-fbdd8dd4-fcbc-4d8a-8a25-9cb672cbaaa6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41b4e486d3534360900926688ff671d3', 'request_id': 'req-fbdd8dd4-fcbc-4d8a-8a25-9cb672cbaaa6'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:39.845202 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-fbdd8dd4-fcbc-4d8a-8a25-9cb672cbaaa6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41b4e486d3534360900926688ff671d3', 'request_id': 'req-fbdd8dd4-fcbc-4d8a-8a25-9cb672cbaaa6'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:39.873558 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-fbdd8dd4-fcbc-4d8a-8a25-9cb672cbaaa6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41b4e486d3534360900926688ff671d3', 'request_id': 'req-fbdd8dd4-fcbc-4d8a-8a25-9cb672cbaaa6'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:39.911304 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-fbdd8dd4-fcbc-4d8a-8a25-9cb672cbaaa6 admin admin] The token cache is being invalidate because project 41b4e486d3534360900926688ff671d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:30:39.913415 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-fbdd8dd4-fcbc-4d8a-8a25-9cb672cbaaa6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:39.914388 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-fbdd8dd4-fcbc-4d8a-8a25-9cb672cbaaa6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:39.925911 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 980/1944] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:30:39 2022] DELETE /identity/v3/projects/41b4e486d3534360900926688ff671d3 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:30:39.930916 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca04f4e-b4a1-4587-bdba-0071377fcdbe None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:39.931318 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca04f4e-b4a1-4587-bdba-0071377fcdbe None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:39.931712 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca04f4e-b4a1-4587-bdba-0071377fcdbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:40.000359 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-0ca04f4e-b4a1-4587-bdba-0071377fcdbe None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:30:40.001696 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-0ca04f4e-b4a1-4587-bdba-0071377fcdbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:40.097530 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-97fc1361-5675-4901-98c6-e17cf9032fa5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5df7c3b0e034c21b24e8dc62a4a4aa5', 'request_id': 'req-97fc1361-5675-4901-98c6-e17cf9032fa5'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:40.120677 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-97fc1361-5675-4901-98c6-e17cf9032fa5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5df7c3b0e034c21b24e8dc62a4a4aa5', 'request_id': 'req-97fc1361-5675-4901-98c6-e17cf9032fa5'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:40.166554 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-97fc1361-5675-4901-98c6-e17cf9032fa5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5df7c3b0e034c21b24e8dc62a4a4aa5', 'request_id': 'req-97fc1361-5675-4901-98c6-e17cf9032fa5'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:40.192114 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-97fc1361-5675-4901-98c6-e17cf9032fa5 admin admin] The token cache is being invalidate because project b5df7c3b0e034c21b24e8dc62a4a4aa5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81383) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:30:40.192441 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-97fc1361-5675-4901-98c6-e17cf9032fa5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:40.193111 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-97fc1361-5675-4901-98c6-e17cf9032fa5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:40.198163 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 965/1945] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:30:39 2022] DELETE /identity/v3/projects/b5df7c3b0e034c21b24e8dc62a4a4aa5 => generated 0 bytes in 750 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:30:40.206184 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06493393-4bcc-4874-8789-21161b71a384 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:40.206466 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06493393-4bcc-4874-8789-21161b71a384 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:40.206736 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06493393-4bcc-4874-8789-21161b71a384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:40.254983 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 981/1946] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:30:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:30:40.262708 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f7cb4-9aaf-4350-bb64-c4ed35396402 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:40.263127 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f7cb4-9aaf-4350-bb64-c4ed35396402 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:40.263509 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f7cb4-9aaf-4350-bb64-c4ed35396402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:40.319269 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-6f3f7cb4-9aaf-4350-bb64-c4ed35396402 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:30:40.324412 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-06493393-4bcc-4874-8789-21161b71a384 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:30:40.325664 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-06493393-4bcc-4874-8789-21161b71a384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:40.326804 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-6f3f7cb4-9aaf-4350-bb64-c4ed35396402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:40.469543 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 982/1947] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:30:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:30:40.475618 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3f7cb4-9aaf-4350-bb64-c4ed35396402 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:40.492645 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 966/1948] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:30:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:30:40.503235 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8469a9-c2d9-4dbd-a8c6-c4cee8646e13 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:40.503934 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8469a9-c2d9-4dbd-a8c6-c4cee8646e13 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:40.504474 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8469a9-c2d9-4dbd-a8c6-c4cee8646e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:40.513692 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3f7cb4-9aaf-4350-bb64-c4ed35396402 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:40.524139 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb793faa-2491-4042-ae37-731e2697d32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:40.526492 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb793faa-2491-4042-ae37-731e2697d32b admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:40.527065 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb793faa-2491-4042-ae37-731e2697d32b admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:40.527629 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb793faa-2491-4042-ae37-731e2697d32b admin admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:40.533002 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb793faa-2491-4042-ae37-731e2697d32b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:30:40.534844 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb793faa-2491-4042-ae37-731e2697d32b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:40.537328 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-cc8469a9-c2d9-4dbd-a8c6-c4cee8646e13 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:30:40.538741 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb793faa-2491-4042-ae37-731e2697d32b admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:40.539418 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-cc8469a9-c2d9-4dbd-a8c6-c4cee8646e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:40.553012 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 967/1949] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:30:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:30:40.558494 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8469a9-c2d9-4dbd-a8c6-c4cee8646e13 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:40.578106 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8469a9-c2d9-4dbd-a8c6-c4cee8646e13 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:40.584190 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 983/1950] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 05:30:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:30:40.597591 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb793faa-2491-4042-ae37-731e2697d32b admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:40.605839 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db1b01-19c1-457f-84fa-f2cc9d8873dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:40.609167 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db1b01-19c1-457f-84fa-f2cc9d8873dd admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:40.610007 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db1b01-19c1-457f-84fa-f2cc9d8873dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:40.610459 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db1b01-19c1-457f-84fa-f2cc9d8873dd admin admin] PATH_INFO: `/v3/domains` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:40.611146 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04db1b01-19c1-457f-84fa-f2cc9d8873dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:30:40.611452 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04db1b01-19c1-457f-84fa-f2cc9d8873dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:40.613167 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04db1b01-19c1-457f-84fa-f2cc9d8873dd admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:40.622360 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb793faa-2491-4042-ae37-731e2697d32b admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:40.637446 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df077b61-92d4-4874-b47c-05670074d887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:40.638442 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df077b61-92d4-4874-b47c-05670074d887 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:40.638724 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df077b61-92d4-4874-b47c-05670074d887 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:40.639008 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df077b61-92d4-4874-b47c-05670074d887 admin admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:40.639651 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df077b61-92d4-4874-b47c-05670074d887 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:40.642258 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df077b61-92d4-4874-b47c-05670074d887 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:40.650092 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 968/1951] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 05:30:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:30:40.652914 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db1b01-19c1-457f-84fa-f2cc9d8873dd admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:40.668995 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db1b01-19c1-457f-84fa-f2cc9d8873dd admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:40.679537 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af413d11-1e8d-4018-bc72-64adae9eaf55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:40.681482 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af413d11-1e8d-4018-bc72-64adae9eaf55 admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:40.681692 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af413d11-1e8d-4018-bc72-64adae9eaf55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:40.681971 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af413d11-1e8d-4018-bc72-64adae9eaf55 admin admin] PATH_INFO: `/v3/projects` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:40.684637 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af413d11-1e8d-4018-bc72-64adae9eaf55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:40.689865 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af413d11-1e8d-4018-bc72-64adae9eaf55 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:40.700329 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 984/1952] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:30:40 2022] POST /identity/v3/projects => generated 379 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:30:40.704439 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df077b61-92d4-4874-b47c-05670074d887 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:40.728729 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:40.754630 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 969/1953] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:30:40 2022] POST /identity/v3/projects => generated 375 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 05:30:40.759223 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af413d11-1e8d-4018-bc72-64adae9eaf55 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:40.773743 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:40.856702 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df077b61-92d4-4874-b47c-05670074d887 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:40.898647 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af413d11-1e8d-4018-bc72-64adae9eaf55 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:40.909211 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e1d6d4-28ec-40d9-ba3f-0055a224e39d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:40.910093 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e1d6d4-28ec-40d9-ba3f-0055a224e39d admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:40.910531 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e1d6d4-28ec-40d9-ba3f-0055a224e39d admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:40.910966 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e1d6d4-28ec-40d9-ba3f-0055a224e39d admin admin] PATH_INFO: `/v3/users` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:40.911869 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e1d6d4-28ec-40d9-ba3f-0055a224e39d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:40.914199 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e1d6d4-28ec-40d9-ba3f-0055a224e39d admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:40.935322 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2b534c-163f-4727-b83d-9c39ce1ebbb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:40.936547 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b534c-163f-4727-b83d-9c39ce1ebbb1 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:40.937054 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b534c-163f-4727-b83d-9c39ce1ebbb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:40.937612 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b534c-163f-4727-b83d-9c39ce1ebbb1 admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:40.939125 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2b534c-163f-4727-b83d-9c39ce1ebbb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:40.942522 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2b534c-163f-4727-b83d-9c39ce1ebbb1 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:40.959738 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 970/1954] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:30:40 2022] POST /identity/v3/users => generated 288 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:30:40.962297 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e1d6d4-28ec-40d9-ba3f-0055a224e39d admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:40.975965 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e1d6d4-28ec-40d9-ba3f-0055a224e39d admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:40.985985 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816d50f1-25f9-4ac2-8ac2-f31692469a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:40.988917 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d50f1-25f9-4ac2-8ac2-f31692469a32 admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:40.990209 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d50f1-25f9-4ac2-8ac2-f31692469a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:40.991092 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d50f1-25f9-4ac2-8ac2-f31692469a32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:40.992984 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816d50f1-25f9-4ac2-8ac2-f31692469a32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:40.995116 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816d50f1-25f9-4ac2-8ac2-f31692469a32 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:40.996497 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 985/1955] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:30:40 2022] POST /identity/v3/users => generated 290 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 05:30:40.997542 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2b534c-163f-4727-b83d-9c39ce1ebbb1 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:41.010018 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2b534c-163f-4727-b83d-9c39ce1ebbb1 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:41.010621 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 971/1956] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:30:40 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:30:41.011861 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816d50f1-25f9-4ac2-8ac2-f31692469a32 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:41.015048 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99cce44-8bcb-4562-bae9-a233d592922b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:41.016014 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99cce44-8bcb-4562-bae9-a233d592922b admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:41.016398 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99cce44-8bcb-4562-bae9-a233d592922b admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:41.017378 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99cce44-8bcb-4562-bae9-a233d592922b admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:41.018145 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99cce44-8bcb-4562-bae9-a233d592922b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:41.021015 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99cce44-8bcb-4562-bae9-a233d592922b admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:41.043416 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816d50f1-25f9-4ac2-8ac2-f31692469a32 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:41.049124 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c9e0ad-2e05-4e65-ad3e-6a8258f5cc4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:41.053361 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9e0ad-2e05-4e65-ad3e-6a8258f5cc4c admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:41.053649 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9e0ad-2e05-4e65-ad3e-6a8258f5cc4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:41.057343 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9e0ad-2e05-4e65-ad3e-6a8258f5cc4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:41.065194 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 986/1957] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:30:40 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:30:41.067896 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99cce44-8bcb-4562-bae9-a233d592922b admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:41.070101 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c9e0ad-2e05-4e65-ad3e-6a8258f5cc4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:41.108001 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c9e0ad-2e05-4e65-ad3e-6a8258f5cc4c admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:41.115355 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99cce44-8bcb-4562-bae9-a233d592922b admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:41.135716 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67f88ce-b93f-45ef-8117-27aaa5d5293e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:41.137845 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67f88ce-b93f-45ef-8117-27aaa5d5293e admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:41.138623 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 972/1958] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:30:41 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:30:41.142970 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67f88ce-b93f-45ef-8117-27aaa5d5293e admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:41.143353 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67f88ce-b93f-45ef-8117-27aaa5d5293e admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:41.144758 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c9e0ad-2e05-4e65-ad3e-6a8258f5cc4c admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:41.146198 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67f88ce-b93f-45ef-8117-27aaa5d5293e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:41.152395 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67f88ce-b93f-45ef-8117-27aaa5d5293e admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:41.190493 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 987/1959] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:30:41 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:30:41.194041 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67f88ce-b93f-45ef-8117-27aaa5d5293e admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:41.229425 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67f88ce-b93f-45ef-8117-27aaa5d5293e admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:41.238325 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c9e0ad-2e05-4e65-ad3e-6a8258f5cc4c admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:41.250418 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fd2604-a3e0-45c4-9092-96165a8b3150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:41.251500 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fd2604-a3e0-45c4-9092-96165a8b3150 admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:41.253297 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fd2604-a3e0-45c4-9092-96165a8b3150 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:41.254153 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e41ba8-ac09-4633-ab8f-3d00dd984dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:41.254697 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fd2604-a3e0-45c4-9092-96165a8b3150 admin admin] PATH_INFO: `/v3/projects/a17a2345d12942c4919d1997e41b13bf/users/c401d17b53b1426fa4d35ebd62e0ee52/roles/aa7ff8e0ec1e48e5811335b9eb38b448` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:41.256428 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e41ba8-ac09-4633-ab8f-3d00dd984dce admin admin] REQUEST_METHOD: `PUT` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:41.257141 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e41ba8-ac09-4633-ab8f-3d00dd984dce admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:41.259099 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e41ba8-ac09-4633-ab8f-3d00dd984dce admin admin] PATH_INFO: `/v3/projects/1c31e718720a4daa90399cac2a126d5a/users/cb80332552644ad1a57eca9cf136b0f1/roles/aa7ff8e0ec1e48e5811335b9eb38b448` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:41.287749 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fd2604-a3e0-45c4-9092-96165a8b3150 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a17a2345d12942c4919d1997e41b13bf, user_id=c401d17b53b1426fa4d35ebd62e0ee52, role_id=aa7ff8e0ec1e48e5811335b9eb38b448)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:41.288697 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e41ba8-ac09-4633-ab8f-3d00dd984dce admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c31e718720a4daa90399cac2a126d5a, user_id=cb80332552644ad1a57eca9cf136b0f1, role_id=aa7ff8e0ec1e48e5811335b9eb38b448)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:41.290435 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fd2604-a3e0-45c4-9092-96165a8b3150 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:41.291605 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e41ba8-ac09-4633-ab8f-3d00dd984dce admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:41.318059 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 988/1960] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:30:41 2022] PUT /identity/v3/projects/a17a2345d12942c4919d1997e41b13bf/users/c401d17b53b1426fa4d35ebd62e0ee52/roles/aa7ff8e0ec1e48e5811335b9eb38b448 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:30:41.318920 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fd2604-a3e0-45c4-9092-96165a8b3150 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:41.322712 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 973/1961] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:30:41 2022] PUT /identity/v3/projects/1c31e718720a4daa90399cac2a126d5a/users/cb80332552644ad1a57eca9cf136b0f1/roles/aa7ff8e0ec1e48e5811335b9eb38b448 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 05:30:41.324788 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7654a8f9-fcb4-4a1e-84b5-a66257f79c8d None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:41.325344 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7654a8f9-fcb4-4a1e-84b5-a66257f79c8d None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:41.325777 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7654a8f9-fcb4-4a1e-84b5-a66257f79c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:41.331298 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-13fd2604-a3e0-45c4-9092-96165a8b3150 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:41.367260 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-7654a8f9-fcb4-4a1e-84b5-a66257f79c8d None None] MFA Rules not processed for user `c401d17b53b1426fa4d35ebd62e0ee52`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:30:41.368558 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-7654a8f9-fcb4-4a1e-84b5-a66257f79c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:41.466521 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 974/1962] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:30:41 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:30:41.468305 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e07331-9e34-48b6-ae90-c9475373ebf6 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:41.468806 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e07331-9e34-48b6-ae90-c9475373ebf6 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:41.469397 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e07331-9e34-48b6-ae90-c9475373ebf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:41.473376 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fd2604-a3e0-45c4-9092-96165a8b3150 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:41.478214 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:41.517728 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-57e07331-9e34-48b6-ae90-c9475373ebf6 None None] MFA Rules not processed for user `cb80332552644ad1a57eca9cf136b0f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:30:41.519421 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-57e07331-9e34-48b6-ae90-c9475373ebf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:41.553278 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:41.578301 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d328d73-183b-460f-94e6-a127a09699c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:41.579129 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d328d73-183b-460f-94e6-a127a09699c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:41.579450 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d328d73-183b-460f-94e6-a127a09699c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:41.579841 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d328d73-183b-460f-94e6-a127a09699c5 admin admin] PATH_INFO: `/v3/users/fe81291de10945c78a7eb99f5022125f` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:41.582517 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d328d73-183b-460f-94e6-a127a09699c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe81291de10945c78a7eb99f5022125f)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:41.585831 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d328d73-183b-460f-94e6-a127a09699c5 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:41.645179 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 975/1963] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:30:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:30:41.646549 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e07331-9e34-48b6-ae90-c9475373ebf6 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:41.665869 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-2d328d73-183b-460f-94e6-a127a09699c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe81291de10945c78a7eb99f5022125f'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:41.672101 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e07331-9e34-48b6-ae90-c9475373ebf6 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:41.679148 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251b8ef6-b99e-4171-ae27-43cb4fc73358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:41.681234 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251b8ef6-b99e-4171-ae27-43cb4fc73358 admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:41.681756 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251b8ef6-b99e-4171-ae27-43cb4fc73358 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:41.682375 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251b8ef6-b99e-4171-ae27-43cb4fc73358 admin admin] PATH_INFO: `/v3/projects` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:41.683659 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251b8ef6-b99e-4171-ae27-43cb4fc73358 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:41.685212 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-2d328d73-183b-460f-94e6-a127a09699c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe81291de10945c78a7eb99f5022125f'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:41.696644 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251b8ef6-b99e-4171-ae27-43cb4fc73358 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:41.704597 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-2d328d73-183b-460f-94e6-a127a09699c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe81291de10945c78a7eb99f5022125f'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:41.736773 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-2d328d73-183b-460f-94e6-a127a09699c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe81291de10945c78a7eb99f5022125f'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:41.737877 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-2d328d73-183b-460f-94e6-a127a09699c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe81291de10945c78a7eb99f5022125f'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:41.762118 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 989/1964] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:30:41 2022] DELETE /identity/v3/users/fe81291de10945c78a7eb99f5022125f => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:30:41.763724 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d328d73-183b-460f-94e6-a127a09699c5 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:41.768227 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-2d328d73-183b-460f-94e6-a127a09699c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:41.777781 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 976/1965] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:30:41 2022] POST /identity/v3/projects => generated 379 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:30:41.779323 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da78b8b9-9892-4dec-8ba0-b4fc0a89ab0f None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:41.779863 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da78b8b9-9892-4dec-8ba0-b4fc0a89ab0f None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:41.780546 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da78b8b9-9892-4dec-8ba0-b4fc0a89ab0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:41.826840 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-da78b8b9-9892-4dec-8ba0-b4fc0a89ab0f None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:30:41.829010 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-da78b8b9-9892-4dec-8ba0-b4fc0a89ab0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:41.902518 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d328d73-183b-460f-94e6-a127a09699c5 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:41.938621 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 977/1966] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:30:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:30:41.942860 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:41.945773 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da78b8b9-9892-4dec-8ba0-b4fc0a89ab0f None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:41.948755 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-da78b8b9-9892-4dec-8ba0-b4fc0a89ab0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:41.968435 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da78b8b9-9892-4dec-8ba0-b4fc0a89ab0f None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:41.974036 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c4cc3f-5c1c-4fa2-befe-26af9a2f70de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:41.975202 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4cc3f-5c1c-4fa2-befe-26af9a2f70de admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:41.975632 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4cc3f-5c1c-4fa2-befe-26af9a2f70de admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:41.976120 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4cc3f-5c1c-4fa2-befe-26af9a2f70de admin admin] PATH_INFO: `/v3/users` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:41.977040 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c4cc3f-5c1c-4fa2-befe-26af9a2f70de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:41.980042 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c4cc3f-5c1c-4fa2-befe-26af9a2f70de admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:41.983188 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7707e302-2778-463c-83fe-cfba07d75bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:41.984427 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7707e302-2778-463c-83fe-cfba07d75bda admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:41.985064 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7707e302-2778-463c-83fe-cfba07d75bda admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:41.985442 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7707e302-2778-463c-83fe-cfba07d75bda admin admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:41.986176 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7707e302-2778-463c-83fe-cfba07d75bda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:41.988395 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7707e302-2778-463c-83fe-cfba07d75bda admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:42.014276 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 978/1967] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:30:41 2022] POST /identity/v3/users => generated 290 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:30:42.014276 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c4cc3f-5c1c-4fa2-befe-26af9a2f70de admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:42.014276 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-31c4cc3f-5c1c-4fa2-befe-26af9a2f70de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:42.025267 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 990/1968] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:30:41 2022] POST /identity/v3/projects => generated 377 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:30:42.025868 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7707e302-2778-463c-83fe-cfba07d75bda admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:42.085618 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c4cc3f-5c1c-4fa2-befe-26af9a2f70de admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:42.100226 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7707e302-2778-463c-83fe-cfba07d75bda admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:42.110467 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8a1050-a7a8-455e-858f-3a3fd1745a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:42.111098 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8a1050-a7a8-455e-858f-3a3fd1745a6a admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:42.111386 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8a1050-a7a8-455e-858f-3a3fd1745a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:42.111646 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8a1050-a7a8-455e-858f-3a3fd1745a6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:42.112355 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8a1050-a7a8-455e-858f-3a3fd1745a6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:42.114146 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8a1050-a7a8-455e-858f-3a3fd1745a6a admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:42.125515 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 991/1969] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:30:42.126221 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8a1050-a7a8-455e-858f-3a3fd1745a6a admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:42.138266 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8a1050-a7a8-455e-858f-3a3fd1745a6a admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:42.145991 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cb0761-b841-4ca3-8566-deed98bee0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:42.145991 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cb0761-b841-4ca3-8566-deed98bee0af admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:42.145991 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cb0761-b841-4ca3-8566-deed98bee0af admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:42.145991 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cb0761-b841-4ca3-8566-deed98bee0af admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:42.147198 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cb0761-b841-4ca3-8566-deed98bee0af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:42.150275 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:42.150402 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cb0761-b841-4ca3-8566-deed98bee0af admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:42.166429 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66178f6a-8c75-4adf-aa41-a010695a18ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:42.168135 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66178f6a-8c75-4adf-aa41-a010695a18ca service neutron] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:42.168582 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66178f6a-8c75-4adf-aa41-a010695a18ca service neutron] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:42.168857 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66178f6a-8c75-4adf-aa41-a010695a18ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:42.183602 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66178f6a-8c75-4adf-aa41-a010695a18ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:42.185255 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66178f6a-8c75-4adf-aa41-a010695a18ca service neutron] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:42.186785 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 992/1970] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:30:42 2022] POST /identity/v3/users => generated 289 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:30:42.187983 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cb0761-b841-4ca3-8566-deed98bee0af admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:42.215363 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 979/1971] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:30:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:30:42.216273 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66178f6a-8c75-4adf-aa41-a010695a18ca service neutron] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:42.222832 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cb0761-b841-4ca3-8566-deed98bee0af admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:42.230870 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fb6238-4fe5-4e29-9772-1755af77d594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:42.232590 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fb6238-4fe5-4e29-9772-1755af77d594 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:42.232829 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66178f6a-8c75-4adf-aa41-a010695a18ca service neutron] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:42.233019 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fb6238-4fe5-4e29-9772-1755af77d594 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:42.233313 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fb6238-4fe5-4e29-9772-1755af77d594 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:42.234537 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fb6238-4fe5-4e29-9772-1755af77d594 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:42.241170 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3df82ba-eab3-4f2e-9bd3-14a4b4539780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:42.242243 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df82ba-eab3-4f2e-9bd3-14a4b4539780 admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:42.242475 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fb6238-4fe5-4e29-9772-1755af77d594 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:42.244189 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df82ba-eab3-4f2e-9bd3-14a4b4539780 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:42.244694 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df82ba-eab3-4f2e-9bd3-14a4b4539780 admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:42.246035 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3df82ba-eab3-4f2e-9bd3-14a4b4539780 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:42.248449 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3df82ba-eab3-4f2e-9bd3-14a4b4539780 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:42.259940 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 993/1972] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:30:42.264405 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fb6238-4fe5-4e29-9772-1755af77d594 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:42.265252 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 980/1973] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:30:42.270823 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3df82ba-eab3-4f2e-9bd3-14a4b4539780 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:42.277683 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fb6238-4fe5-4e29-9772-1755af77d594 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:42.283384 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3df82ba-eab3-4f2e-9bd3-14a4b4539780 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:42.285252 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3068757-3872-4b27-a1e6-d28c87a634a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:42.286111 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3068757-3872-4b27-a1e6-d28c87a634a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:42.286557 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3068757-3872-4b27-a1e6-d28c87a634a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:42.286983 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3068757-3872-4b27-a1e6-d28c87a634a9 admin admin] PATH_INFO: `/v3/projects/fcf59bb557cf45faade23710510704b9/users/bc937ada96194345bfa46387e34a3489/roles/aa7ff8e0ec1e48e5811335b9eb38b448` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:42.294889 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c360d9-581d-4a78-883a-e9207cb6300b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:42.295802 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c360d9-581d-4a78-883a-e9207cb6300b admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:42.297790 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c360d9-581d-4a78-883a-e9207cb6300b admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:42.298924 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c360d9-581d-4a78-883a-e9207cb6300b admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:42.299604 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c360d9-581d-4a78-883a-e9207cb6300b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:42.307043 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c360d9-581d-4a78-883a-e9207cb6300b admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:42.321687 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 981/1974] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:30:42.326467 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3068757-3872-4b27-a1e6-d28c87a634a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcf59bb557cf45faade23710510704b9, user_id=bc937ada96194345bfa46387e34a3489, role_id=aa7ff8e0ec1e48e5811335b9eb38b448)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:42.326598 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c360d9-581d-4a78-883a-e9207cb6300b admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:42.330403 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3068757-3872-4b27-a1e6-d28c87a634a9 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:42.337786 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c360d9-581d-4a78-883a-e9207cb6300b admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:42.343803 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479c9210-96e3-4f22-b31f-4bee3d3dc13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:42.344522 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c9210-96e3-4f22-b31f-4bee3d3dc13c admin admin] REQUEST_METHOD: `PUT` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:42.345462 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c9210-96e3-4f22-b31f-4bee3d3dc13c admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:42.345751 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c9210-96e3-4f22-b31f-4bee3d3dc13c admin admin] PATH_INFO: `/v3/projects/3cd9238559514b7fa1c56b0fc0546c30/users/c795e7a48bbc4d4fa6367e6435e0891d/roles/aa7ff8e0ec1e48e5811335b9eb38b448` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:42.351726 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 994/1975] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:30:42 2022] PUT /identity/v3/projects/fcf59bb557cf45faade23710510704b9/users/bc937ada96194345bfa46387e34a3489/roles/aa7ff8e0ec1e48e5811335b9eb38b448 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:30:42.361398 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dddc48-26fa-47de-87e8-f81952c28cf0 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:42.361684 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dddc48-26fa-47de-87e8-f81952c28cf0 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:42.361960 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dddc48-26fa-47de-87e8-f81952c28cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:42.378444 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479c9210-96e3-4f22-b31f-4bee3d3dc13c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cd9238559514b7fa1c56b0fc0546c30, user_id=c795e7a48bbc4d4fa6367e6435e0891d, role_id=aa7ff8e0ec1e48e5811335b9eb38b448)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:42.381200 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479c9210-96e3-4f22-b31f-4bee3d3dc13c admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:42.417632 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 982/1976] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:30:42 2022] PUT /identity/v3/projects/3cd9238559514b7fa1c56b0fc0546c30/users/c795e7a48bbc4d4fa6367e6435e0891d/roles/aa7ff8e0ec1e48e5811335b9eb38b448 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 05:30:42.420847 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-e0dddc48-26fa-47de-87e8-f81952c28cf0 None None] MFA Rules not processed for user `bc937ada96194345bfa46387e34a3489`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:30:42.422375 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-e0dddc48-26fa-47de-87e8-f81952c28cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:42.430065 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c38787-b279-4b1b-86f1-72973f7da6cd None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:42.430357 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c38787-b279-4b1b-86f1-72973f7da6cd None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:42.430634 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c38787-b279-4b1b-86f1-72973f7da6cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:42.483944 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-a8c38787-b279-4b1b-86f1-72973f7da6cd None None] MFA Rules not processed for user `c795e7a48bbc4d4fa6367e6435e0891d`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:30:42.486236 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-a8c38787-b279-4b1b-86f1-72973f7da6cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:42.505811 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:42.525573 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 995/1977] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:30:42 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:30:42.530630 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dddc48-26fa-47de-87e8-f81952c28cf0 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:42.684630 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 983/1978] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:30:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:30:42.689846 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c38787-b279-4b1b-86f1-72973f7da6cd None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:42.696846 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dddc48-26fa-47de-87e8-f81952c28cf0 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:42.705210 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65756fca-eefa-4a68-9b87-589294a75bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:42.705839 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65756fca-eefa-4a68-9b87-589294a75bc8 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:42.706117 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65756fca-eefa-4a68-9b87-589294a75bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:42.706386 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65756fca-eefa-4a68-9b87-589294a75bc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:42.706509 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c38787-b279-4b1b-86f1-72973f7da6cd None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:42.707020 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65756fca-eefa-4a68-9b87-589294a75bc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:42.708961 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65756fca-eefa-4a68-9b87-589294a75bc8 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:42.711744 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d05b2dc-f686-4189-94e3-efb17213f9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:42.712630 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d05b2dc-f686-4189-94e3-efb17213f9e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:42.713069 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d05b2dc-f686-4189-94e3-efb17213f9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:42.713580 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d05b2dc-f686-4189-94e3-efb17213f9e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:42.714549 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d05b2dc-f686-4189-94e3-efb17213f9e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:42.717034 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d05b2dc-f686-4189-94e3-efb17213f9e6 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:42.761434 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 996/1979] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:30:42 2022] POST /identity/v3/projects => generated 379 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:30:42.766220 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 984/1980] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:30:42 2022] POST /identity/v3/projects => generated 375 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:30:42.767235 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d05b2dc-f686-4189-94e3-efb17213f9e6 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:42.769168 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-2d05b2dc-f686-4189-94e3-efb17213f9e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:42.778944 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65756fca-eefa-4a68-9b87-589294a75bc8 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:42.930748 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d05b2dc-f686-4189-94e3-efb17213f9e6 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:42.932880 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65756fca-eefa-4a68-9b87-589294a75bc8 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:42.945979 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5e060c-1434-40b6-90fd-e05cab8903a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:42.946618 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e060c-1434-40b6-90fd-e05cab8903a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:42.946898 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e060c-1434-40b6-90fd-e05cab8903a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:42.947171 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e060c-1434-40b6-90fd-e05cab8903a0 admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:42.947892 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5e060c-1434-40b6-90fd-e05cab8903a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:42.951589 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5e060c-1434-40b6-90fd-e05cab8903a0 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:42.957123 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dfb506-8b97-44e2-a108-c32efca169a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:42.957912 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dfb506-8b97-44e2-a108-c32efca169a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:42.958193 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dfb506-8b97-44e2-a108-c32efca169a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:42.958470 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dfb506-8b97-44e2-a108-c32efca169a7 admin admin] PATH_INFO: `/v3/projects/bf701ae919784da3b591da86de9aa0db` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:42.960649 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dfb506-8b97-44e2-a108-c32efca169a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf701ae919784da3b591da86de9aa0db)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:42.970895 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dfb506-8b97-44e2-a108-c32efca169a7 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:43.001157 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 997/1981] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:30:42 2022] POST /identity/v3/users => generated 296 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:30:43.002811 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:43.009272 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5e060c-1434-40b6-90fd-e05cab8903a0 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:43.030451 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5e060c-1434-40b6-90fd-e05cab8903a0 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:43.047419 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e3057d-8944-47e7-9d47-458e03058ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:43.050498 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e3057d-8944-47e7-9d47-458e03058ec3 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:43.050498 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e3057d-8944-47e7-9d47-458e03058ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:43.050498 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e3057d-8944-47e7-9d47-458e03058ec3 admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:43.051242 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e3057d-8944-47e7-9d47-458e03058ec3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:43.059149 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e3057d-8944-47e7-9d47-458e03058ec3 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:43.092720 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-72dfb506-8b97-44e2-a108-c32efca169a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf701ae919784da3b591da86de9aa0db', 'request_id': 'req-72dfb506-8b97-44e2-a108-c32efca169a7'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:43.116956 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-72dfb506-8b97-44e2-a108-c32efca169a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf701ae919784da3b591da86de9aa0db', 'request_id': 'req-72dfb506-8b97-44e2-a108-c32efca169a7'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:43.117072 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 998/1982] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:30:43 2022] POST /identity/v3/users => generated 294 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:30:43.117072 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e3057d-8944-47e7-9d47-458e03058ec3 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:43.122879 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-72dfb506-8b97-44e2-a108-c32efca169a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf701ae919784da3b591da86de9aa0db', 'request_id': 'req-72dfb506-8b97-44e2-a108-c32efca169a7'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:43.142024 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e3057d-8944-47e7-9d47-458e03058ec3 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:43.151193 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-72dfb506-8b97-44e2-a108-c32efca169a7 admin admin] The token cache is being invalidate because project bf701ae919784da3b591da86de9aa0db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81383) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:30:43.153229 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-72dfb506-8b97-44e2-a108-c32efca169a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:43.154106 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-72dfb506-8b97-44e2-a108-c32efca169a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:43.161664 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 985/1983] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:30:42 2022] DELETE /identity/v3/projects/bf701ae919784da3b591da86de9aa0db => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:30:43.161664 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dfb506-8b97-44e2-a108-c32efca169a7 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:43.163162 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-72dfb506-8b97-44e2-a108-c32efca169a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:43.250300 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:43.270581 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d79441c-aefc-4682-b102-bb4f6fcd95bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:43.273686 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79441c-aefc-4682-b102-bb4f6fcd95bd admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:43.273976 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79441c-aefc-4682-b102-bb4f6fcd95bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:43.274249 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79441c-aefc-4682-b102-bb4f6fcd95bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:43.277318 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d79441c-aefc-4682-b102-bb4f6fcd95bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:43.280709 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d79441c-aefc-4682-b102-bb4f6fcd95bd admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:43.299929 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 999/1984] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:30:43 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:30:43.304046 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d79441c-aefc-4682-b102-bb4f6fcd95bd admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:43.306606 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-8d79441c-aefc-4682-b102-bb4f6fcd95bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:43.313838 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dfb506-8b97-44e2-a108-c32efca169a7 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:43.324171 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d79441c-aefc-4682-b102-bb4f6fcd95bd admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:43.328721 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91150cc-644a-4c98-a965-ad6688497ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:43.330310 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91150cc-644a-4c98-a965-ad6688497ff7 admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:43.330644 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91150cc-644a-4c98-a965-ad6688497ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:43.330986 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91150cc-644a-4c98-a965-ad6688497ff7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:43.331741 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91150cc-644a-4c98-a965-ad6688497ff7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:43.335463 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91150cc-644a-4c98-a965-ad6688497ff7 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:43.345426 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a61eca9-6063-407c-b37f-d9661e0dcbed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:43.346421 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a61eca9-6063-407c-b37f-d9661e0dcbed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:43.346878 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a61eca9-6063-407c-b37f-d9661e0dcbed admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:43.347288 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a61eca9-6063-407c-b37f-d9661e0dcbed admin admin] PATH_INFO: `/v3/users/c0a01f9e7d954cee824ee7c5b0c36bf3` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:43.349471 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a61eca9-6063-407c-b37f-d9661e0dcbed admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0a01f9e7d954cee824ee7c5b0c36bf3)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:43.352029 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 986/1985] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:30:43 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:30:43.352505 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a61eca9-6063-407c-b37f-d9661e0dcbed admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:43.352718 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91150cc-644a-4c98-a965-ad6688497ff7 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:43.361257 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-c91150cc-644a-4c98-a965-ad6688497ff7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:43.388164 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91150cc-644a-4c98-a965-ad6688497ff7 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:43.393839 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6908e8-ec22-4ef3-a542-58b723e771af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:43.394510 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6908e8-ec22-4ef3-a542-58b723e771af admin admin] REQUEST_METHOD: `PUT` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:43.394788 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6908e8-ec22-4ef3-a542-58b723e771af admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:43.395163 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6908e8-ec22-4ef3-a542-58b723e771af admin admin] PATH_INFO: `/v3/projects/3b5abb2bbb4e476294370724eaf51332/users/e00e80bf55ab45168ef37b3ae81ef77d/roles/5b702713e40145b49e0b42abd0a5fba9` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:43.414888 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6908e8-ec22-4ef3-a542-58b723e771af admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b5abb2bbb4e476294370724eaf51332, user_id=e00e80bf55ab45168ef37b3ae81ef77d, role_id=5b702713e40145b49e0b42abd0a5fba9)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:43.418342 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6908e8-ec22-4ef3-a542-58b723e771af admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:43.435182 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 987/1986] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:30:43 2022] PUT /identity/v3/projects/3b5abb2bbb4e476294370724eaf51332/users/e00e80bf55ab45168ef37b3ae81ef77d/roles/5b702713e40145b49e0b42abd0a5fba9 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:30:43.436472 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6908e8-ec22-4ef3-a542-58b723e771af admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:43.445468 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-9a61eca9-6063-407c-b37f-d9661e0dcbed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0a01f9e7d954cee824ee7c5b0c36bf3'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:43.478650 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-9a61eca9-6063-407c-b37f-d9661e0dcbed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0a01f9e7d954cee824ee7c5b0c36bf3'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:43.505182 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-9a61eca9-6063-407c-b37f-d9661e0dcbed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0a01f9e7d954cee824ee7c5b0c36bf3'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:43.514418 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-9a61eca9-6063-407c-b37f-d9661e0dcbed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0a01f9e7d954cee824ee7c5b0c36bf3'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:43.515178 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-9a61eca9-6063-407c-b37f-d9661e0dcbed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0a01f9e7d954cee824ee7c5b0c36bf3'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:43.523636 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1000/1987] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:30:43 2022] DELETE /identity/v3/users/c0a01f9e7d954cee824ee7c5b0c36bf3 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:30:43.524585 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a61eca9-6063-407c-b37f-d9661e0dcbed admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:43.526010 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-9a61eca9-6063-407c-b37f-d9661e0dcbed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:43.530393 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6908e8-ec22-4ef3-a542-58b723e771af admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:43.560117 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:43.626570 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a61eca9-6063-407c-b37f-d9661e0dcbed admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:43.638992 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f933d5-96c5-42e7-9459-38434a6d6def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:43.640469 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f933d5-96c5-42e7-9459-38434a6d6def admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:43.656565 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f933d5-96c5-42e7-9459-38434a6d6def admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:43.656890 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f933d5-96c5-42e7-9459-38434a6d6def admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:43.657600 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f933d5-96c5-42e7-9459-38434a6d6def admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:43.659340 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f933d5-96c5-42e7-9459-38434a6d6def admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:43.673373 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1001/1988] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:30:43 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:30:43.677464 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f933d5-96c5-42e7-9459-38434a6d6def admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:43.677626 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fe8604-589e-4f0f-82b5-2bf807dfb75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:43.678319 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe8604-589e-4f0f-82b5-2bf807dfb75a admin admin] REQUEST_METHOD: `PUT` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:43.678709 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe8604-589e-4f0f-82b5-2bf807dfb75a admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:43.679475 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe8604-589e-4f0f-82b5-2bf807dfb75a admin admin] PATH_INFO: `/v3/projects/e3915a25b4794225859d74add5a7d1cd/users/fe25ac9b819b4ad8b7e32133ea8aeaa1/roles/5b702713e40145b49e0b42abd0a5fba9` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:43.699267 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f933d5-96c5-42e7-9459-38434a6d6def admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:43.704104 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66720bf-b0ab-4a3e-88a6-0e766ac63660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:43.704790 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66720bf-b0ab-4a3e-88a6-0e766ac63660 admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:43.705065 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66720bf-b0ab-4a3e-88a6-0e766ac63660 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:43.705388 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66720bf-b0ab-4a3e-88a6-0e766ac63660 admin admin] PATH_INFO: `/v3/projects/3b5abb2bbb4e476294370724eaf51332/users/e00e80bf55ab45168ef37b3ae81ef77d/roles/5b702713e40145b49e0b42abd0a5fba9` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:43.707305 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66720bf-b0ab-4a3e-88a6-0e766ac63660 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b5abb2bbb4e476294370724eaf51332, user_id=e00e80bf55ab45168ef37b3ae81ef77d, role_id=5b702713e40145b49e0b42abd0a5fba9)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:43.710088 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66720bf-b0ab-4a3e-88a6-0e766ac63660 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:43.715178 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fe8604-589e-4f0f-82b5-2bf807dfb75a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3915a25b4794225859d74add5a7d1cd, user_id=fe25ac9b819b4ad8b7e32133ea8aeaa1, role_id=5b702713e40145b49e0b42abd0a5fba9)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:43.718206 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fe8604-589e-4f0f-82b5-2bf807dfb75a admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:43.730089 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1002/1989] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:30:43 2022] PUT /identity/v3/projects/3b5abb2bbb4e476294370724eaf51332/users/e00e80bf55ab45168ef37b3ae81ef77d/roles/5b702713e40145b49e0b42abd0a5fba9 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 05:30:43.740530 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e49763-eefd-4025-96ce-e5801d7fe494 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:43.740813 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e49763-eefd-4025-96ce-e5801d7fe494 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:43.741077 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e49763-eefd-4025-96ce-e5801d7fe494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:43.742836 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 988/1990] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:30:43 2022] PUT /identity/v3/projects/e3915a25b4794225859d74add5a7d1cd/users/fe25ac9b819b4ad8b7e32133ea8aeaa1/roles/5b702713e40145b49e0b42abd0a5fba9 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:30:43.747228 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fe8604-589e-4f0f-82b5-2bf807dfb75a admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:43.749179 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-11fe8604-589e-4f0f-82b5-2bf807dfb75a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:43.777428 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-d5e49763-eefd-4025-96ce-e5801d7fe494 None None] MFA Rules not processed for user `e00e80bf55ab45168ef37b3ae81ef77d`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:30:43.779159 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-d5e49763-eefd-4025-96ce-e5801d7fe494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:43.816083 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:43.840325 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fe8604-589e-4f0f-82b5-2bf807dfb75a admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:43.846152 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a080d0b-32f9-4342-92fe-c0bf0960c632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:43.846797 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a080d0b-32f9-4342-92fe-c0bf0960c632 admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:43.847083 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a080d0b-32f9-4342-92fe-c0bf0960c632 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:43.847361 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a080d0b-32f9-4342-92fe-c0bf0960c632 admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:43.848061 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a080d0b-32f9-4342-92fe-c0bf0960c632 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:43.849680 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a080d0b-32f9-4342-92fe-c0bf0960c632 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:43.861466 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 989/1991] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:30:43 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:30:43.865305 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a080d0b-32f9-4342-92fe-c0bf0960c632 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:43.869220 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1003/1992] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:30:43 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:30:43.879550 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a080d0b-32f9-4342-92fe-c0bf0960c632 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:43.881754 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e49763-eefd-4025-96ce-e5801d7fe494 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:43.883567 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-d5e49763-eefd-4025-96ce-e5801d7fe494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:43.885612 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5310cb16-2df8-4277-98a2-e8c9cadbd52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:43.886386 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5310cb16-2df8-4277-98a2-e8c9cadbd52f admin admin] REQUEST_METHOD: `PUT` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:43.886764 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5310cb16-2df8-4277-98a2-e8c9cadbd52f admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:43.887150 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5310cb16-2df8-4277-98a2-e8c9cadbd52f admin admin] PATH_INFO: `/v3/projects/e3915a25b4794225859d74add5a7d1cd/users/fe25ac9b819b4ad8b7e32133ea8aeaa1/roles/5b702713e40145b49e0b42abd0a5fba9` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:43.889247 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5310cb16-2df8-4277-98a2-e8c9cadbd52f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3915a25b4794225859d74add5a7d1cd, user_id=fe25ac9b819b4ad8b7e32133ea8aeaa1, role_id=5b702713e40145b49e0b42abd0a5fba9)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:43.892177 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5310cb16-2df8-4277-98a2-e8c9cadbd52f admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:43.904448 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 990/1993] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:30:43 2022] PUT /identity/v3/projects/e3915a25b4794225859d74add5a7d1cd/users/fe25ac9b819b4ad8b7e32133ea8aeaa1/roles/5b702713e40145b49e0b42abd0a5fba9 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:30:43.914649 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7cc660-0517-46a0-8489-37376744c210 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:43.914938 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7cc660-0517-46a0-8489-37376744c210 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:43.915217 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7cc660-0517-46a0-8489-37376744c210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:43.949437 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-3a7cc660-0517-46a0-8489-37376744c210 None None] MFA Rules not processed for user `fe25ac9b819b4ad8b7e32133ea8aeaa1`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:30:43.950824 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-3a7cc660-0517-46a0-8489-37376744c210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:43.955826 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e49763-eefd-4025-96ce-e5801d7fe494 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:44.025009 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81054424-55ae-4fa8-b59d-27d13dc1c07c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a147e14b61d481db1cac02c58ac3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:44.025637 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81054424-55ae-4fa8-b59d-27d13dc1c07c service cinder] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:44.027021 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81054424-55ae-4fa8-b59d-27d13dc1c07c service cinder] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:44.027316 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81054424-55ae-4fa8-b59d-27d13dc1c07c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:44.035721 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 991/1994] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:30:43 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:30:44.035721 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7cc660-0517-46a0-8489-37376744c210 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:44.036249 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-3a7cc660-0517-46a0-8489-37376744c210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:44.049118 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:44.100106 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81054424-55ae-4fa8-b59d-27d13dc1c07c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:44.101691 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81054424-55ae-4fa8-b59d-27d13dc1c07c service cinder] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:44.113895 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7cc660-0517-46a0-8489-37376744c210 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:44.115240 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1004/1995] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:30:43 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 05:30:44.116369 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81054424-55ae-4fa8-b59d-27d13dc1c07c service cinder] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:44.117684 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-81054424-55ae-4fa8-b59d-27d13dc1c07c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:44.120725 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5158db1-0440-48b4-a315-5123f37e9f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:44.121604 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5158db1-0440-48b4-a315-5123f37e9f4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:44.122007 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5158db1-0440-48b4-a315-5123f37e9f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:44.122355 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5158db1-0440-48b4-a315-5123f37e9f4f admin admin] PATH_INFO: `/v3/projects/a93333f1cf4d4febb5064aacfb7ea6b5` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:44.124069 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5158db1-0440-48b4-a315-5123f37e9f4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a93333f1cf4d4febb5064aacfb7ea6b5)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:44.126484 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5158db1-0440-48b4-a315-5123f37e9f4f admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:44.134316 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81054424-55ae-4fa8-b59d-27d13dc1c07c service cinder] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:44.139266 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d4c3ab-4f41-4add-af58-8cc765fa19f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a147e14b61d481db1cac02c58ac3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:44.140159 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d4c3ab-4f41-4add-af58-8cc765fa19f2 service cinder] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:44.140673 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d4c3ab-4f41-4add-af58-8cc765fa19f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:44.141231 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d4c3ab-4f41-4add-af58-8cc765fa19f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:44.143381 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-c9d4c3ab-4f41-4add-af58-8cc765fa19f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:44.192091 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:44.196833 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-e5158db1-0440-48b4-a315-5123f37e9f4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a93333f1cf4d4febb5064aacfb7ea6b5', 'request_id': 'req-e5158db1-0440-48b4-a315-5123f37e9f4f'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:44.206974 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-e5158db1-0440-48b4-a315-5123f37e9f4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a93333f1cf4d4febb5064aacfb7ea6b5', 'request_id': 'req-e5158db1-0440-48b4-a315-5123f37e9f4f'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:44.215710 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-e5158db1-0440-48b4-a315-5123f37e9f4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a93333f1cf4d4febb5064aacfb7ea6b5', 'request_id': 'req-e5158db1-0440-48b4-a315-5123f37e9f4f'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:44.229040 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d4c3ab-4f41-4add-af58-8cc765fa19f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:44.230184 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-e5158db1-0440-48b4-a315-5123f37e9f4f admin admin] The token cache is being invalidate because project a93333f1cf4d4febb5064aacfb7ea6b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81383) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:30:44.230570 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-e5158db1-0440-48b4-a315-5123f37e9f4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:44.230689 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d4c3ab-4f41-4add-af58-8cc765fa19f2 service cinder] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:44.231398 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-e5158db1-0440-48b4-a315-5123f37e9f4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:44.236749 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 992/1996] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:30:44 2022] DELETE /identity/v3/projects/a93333f1cf4d4febb5064aacfb7ea6b5 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:30:44.236749 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5158db1-0440-48b4-a315-5123f37e9f4f admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:44.236988 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-e5158db1-0440-48b4-a315-5123f37e9f4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:44.241180 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1005/1997] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:30:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:30:44.242075 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d4c3ab-4f41-4add-af58-8cc765fa19f2 service cinder] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:44.256133 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d4c3ab-4f41-4add-af58-8cc765fa19f2 service cinder] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:44.310056 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5158db1-0440-48b4-a315-5123f37e9f4f admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:44.315096 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d5b263-e00d-4e39-9e51-6144e8488094 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a147e14b61d481db1cac02c58ac3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:44.315746 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d5b263-e00d-4e39-9e51-6144e8488094 service cinder] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:44.316045 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d5b263-e00d-4e39-9e51-6144e8488094 service cinder] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:44.316290 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d5b263-e00d-4e39-9e51-6144e8488094 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:44.318065 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-88d5b263-e00d-4e39-9e51-6144e8488094 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:44.320089 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad251d0-6b25-4ec5-96c8-7ab5aa1e80a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:44.320807 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad251d0-6b25-4ec5-96c8-7ab5aa1e80a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:44.321158 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad251d0-6b25-4ec5-96c8-7ab5aa1e80a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:44.321511 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad251d0-6b25-4ec5-96c8-7ab5aa1e80a5 admin admin] PATH_INFO: `/v3/users/9603fae6de43488981e82aec6f1a6daf` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:44.322768 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad251d0-6b25-4ec5-96c8-7ab5aa1e80a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9603fae6de43488981e82aec6f1a6daf)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:44.325407 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad251d0-6b25-4ec5-96c8-7ab5aa1e80a5 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:44.381851 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-7ad251d0-6b25-4ec5-96c8-7ab5aa1e80a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9603fae6de43488981e82aec6f1a6daf'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:44.384984 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:44.398204 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d5b263-e00d-4e39-9e51-6144e8488094 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:44.398397 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-7ad251d0-6b25-4ec5-96c8-7ab5aa1e80a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9603fae6de43488981e82aec6f1a6daf'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:44.400154 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d5b263-e00d-4e39-9e51-6144e8488094 service cinder] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:44.405498 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-7ad251d0-6b25-4ec5-96c8-7ab5aa1e80a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9603fae6de43488981e82aec6f1a6daf'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:44.413498 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-7ad251d0-6b25-4ec5-96c8-7ab5aa1e80a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9603fae6de43488981e82aec6f1a6daf'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:44.413840 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 993/1998] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:30:44 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:30:44.416332 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-7ad251d0-6b25-4ec5-96c8-7ab5aa1e80a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9603fae6de43488981e82aec6f1a6daf'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:44.426588 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1006/1999] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:30:44 2022] DELETE /identity/v3/users/9603fae6de43488981e82aec6f1a6daf => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:30:44.844308 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d5b263-e00d-4e39-9e51-6144e8488094 service cinder] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:44.845915 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-88d5b263-e00d-4e39-9e51-6144e8488094 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:44.865523 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d5b263-e00d-4e39-9e51-6144e8488094 service cinder] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:44.998593 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0707e0b2-f2f5-4d47-9e3f-9a40e21e02f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:44.999243 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0707e0b2-f2f5-4d47-9e3f-9a40e21e02f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:44.999521 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0707e0b2-f2f5-4d47-9e3f-9a40e21e02f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:44.999887 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0707e0b2-f2f5-4d47-9e3f-9a40e21e02f5 admin admin] PATH_INFO: `/v3/projects/d96866ee8b904db88779dde960988d17` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:45.001170 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0707e0b2-f2f5-4d47-9e3f-9a40e21e02f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d96866ee8b904db88779dde960988d17)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:45.003164 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0707e0b2-f2f5-4d47-9e3f-9a40e21e02f5 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:45.058595 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-0707e0b2-f2f5-4d47-9e3f-9a40e21e02f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd96866ee8b904db88779dde960988d17', 'request_id': 'req-0707e0b2-f2f5-4d47-9e3f-9a40e21e02f5'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:45.068343 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-0707e0b2-f2f5-4d47-9e3f-9a40e21e02f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd96866ee8b904db88779dde960988d17', 'request_id': 'req-0707e0b2-f2f5-4d47-9e3f-9a40e21e02f5'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:45.074962 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-0707e0b2-f2f5-4d47-9e3f-9a40e21e02f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd96866ee8b904db88779dde960988d17', 'request_id': 'req-0707e0b2-f2f5-4d47-9e3f-9a40e21e02f5'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:45.087325 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-0707e0b2-f2f5-4d47-9e3f-9a40e21e02f5 admin admin] The token cache is being invalidate because project d96866ee8b904db88779dde960988d17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81383) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:30:45.087614 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-0707e0b2-f2f5-4d47-9e3f-9a40e21e02f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:45.088392 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-0707e0b2-f2f5-4d47-9e3f-9a40e21e02f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:45.091866 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 994/2000] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:30:44 2022] DELETE /identity/v3/projects/d96866ee8b904db88779dde960988d17 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:30:45.097194 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f4005-4381-4f9e-bcb7-0494e4cbddc4 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:45.097703 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f4005-4381-4f9e-bcb7-0494e4cbddc4 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:45.097703 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f4005-4381-4f9e-bcb7-0494e4cbddc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:45.119833 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-9f5f4005-4381-4f9e-bcb7-0494e4cbddc4 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:30:45.121073 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-9f5f4005-4381-4f9e-bcb7-0494e4cbddc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:45.181857 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:45.197428 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1007/2001] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:30:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:30:45.206338 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd39cc2-3cd5-4e11-96ae-8ca0c9297b14 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:45.206624 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd39cc2-3cd5-4e11-96ae-8ca0c9297b14 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:45.206899 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd39cc2-3cd5-4e11-96ae-8ca0c9297b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:45.228244 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-9dd39cc2-3cd5-4e11-96ae-8ca0c9297b14 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:30:45.229490 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-9dd39cc2-3cd5-4e11-96ae-8ca0c9297b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:45.239080 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 995/2002] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:30:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 05:30:45.243966 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5f4005-4381-4f9e-bcb7-0494e4cbddc4 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:45.253652 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5f4005-4381-4f9e-bcb7-0494e4cbddc4 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:45.258425 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce4268-5186-4dd8-be14-c8e8a8f1329b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:45.259031 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce4268-5186-4dd8-be14-c8e8a8f1329b admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:45.259302 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce4268-5186-4dd8-be14-c8e8a8f1329b admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:45.259573 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce4268-5186-4dd8-be14-c8e8a8f1329b admin admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:45.260247 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dce4268-5186-4dd8-be14-c8e8a8f1329b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:30:45.261067 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dce4268-5186-4dd8-be14-c8e8a8f1329b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:45.262680 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dce4268-5186-4dd8-be14-c8e8a8f1329b admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:45.274261 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1008/2003] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 05:30:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:30:45.279458 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd39cc2-3cd5-4e11-96ae-8ca0c9297b14 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:45.289931 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd39cc2-3cd5-4e11-96ae-8ca0c9297b14 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:45.294754 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572302c5-f23a-4bbf-94d0-9fd4447f7ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:45.295360 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572302c5-f23a-4bbf-94d0-9fd4447f7ceb admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:45.295632 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572302c5-f23a-4bbf-94d0-9fd4447f7ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:45.295956 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572302c5-f23a-4bbf-94d0-9fd4447f7ceb admin admin] PATH_INFO: `/v3/projects` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:45.296595 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572302c5-f23a-4bbf-94d0-9fd4447f7ceb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:45.298539 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572302c5-f23a-4bbf-94d0-9fd4447f7ceb admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:45.326263 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 996/2004] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:30:45 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 05:30:45.330534 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce4268-5186-4dd8-be14-c8e8a8f1329b admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:45.341165 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce4268-5186-4dd8-be14-c8e8a8f1329b admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:45.404996 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9b8dcc-f0af-4114-8861-76526746f80d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:45.405618 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9b8dcc-f0af-4114-8861-76526746f80d admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:45.405919 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9b8dcc-f0af-4114-8861-76526746f80d admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:45.406165 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9b8dcc-f0af-4114-8861-76526746f80d admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:45.406800 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9b8dcc-f0af-4114-8861-76526746f80d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:45.408825 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9b8dcc-f0af-4114-8861-76526746f80d admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:45.431764 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1009/2005] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:30:45 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 05:30:45.435433 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572302c5-f23a-4bbf-94d0-9fd4447f7ceb admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:45.445515 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572302c5-f23a-4bbf-94d0-9fd4447f7ceb admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:45.450847 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44234b1-ae07-4dc1-b997-5365930e6930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:45.451487 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44234b1-ae07-4dc1-b997-5365930e6930 admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:45.451790 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44234b1-ae07-4dc1-b997-5365930e6930 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:45.452062 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44234b1-ae07-4dc1-b997-5365930e6930 admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:45.452743 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44234b1-ae07-4dc1-b997-5365930e6930 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:45.454477 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44234b1-ae07-4dc1-b997-5365930e6930 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:45.465683 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 997/2006] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:30:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:30:45.469957 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9b8dcc-f0af-4114-8861-76526746f80d admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:45.481209 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9b8dcc-f0af-4114-8861-76526746f80d admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:45.486640 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caa2be7-2e4a-4d20-8759-86ad49bbca84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:45.487271 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa2be7-2e4a-4d20-8759-86ad49bbca84 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:45.487548 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa2be7-2e4a-4d20-8759-86ad49bbca84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:45.487844 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa2be7-2e4a-4d20-8759-86ad49bbca84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:45.488494 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caa2be7-2e4a-4d20-8759-86ad49bbca84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:45.490397 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caa2be7-2e4a-4d20-8759-86ad49bbca84 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:45.502463 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1010/2007] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:30:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:30:45.509433 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44234b1-ae07-4dc1-b997-5365930e6930 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:45.521687 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44234b1-ae07-4dc1-b997-5365930e6930 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:45.527739 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c31844e-6d9c-43e0-9db2-c2a04190bec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:45.528416 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31844e-6d9c-43e0-9db2-c2a04190bec7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:45.528700 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31844e-6d9c-43e0-9db2-c2a04190bec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:45.528979 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31844e-6d9c-43e0-9db2-c2a04190bec7 admin admin] PATH_INFO: `/v3/projects/1db9595200344ed39a8b7a112150b7e7/users/351c2bec2de54748abf5c0f1098f48d2/roles/aa7ff8e0ec1e48e5811335b9eb38b448` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:45.550471 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c31844e-6d9c-43e0-9db2-c2a04190bec7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1db9595200344ed39a8b7a112150b7e7, user_id=351c2bec2de54748abf5c0f1098f48d2, role_id=aa7ff8e0ec1e48e5811335b9eb38b448)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:45.553427 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c31844e-6d9c-43e0-9db2-c2a04190bec7 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:45.568090 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 998/2008] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:30:45 2022] PUT /identity/v3/projects/1db9595200344ed39a8b7a112150b7e7/users/351c2bec2de54748abf5c0f1098f48d2/roles/aa7ff8e0ec1e48e5811335b9eb38b448 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:30:45.580290 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d503fe-842d-4c3c-b6a5-4c454f8577e4 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:45.580542 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d503fe-842d-4c3c-b6a5-4c454f8577e4 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:45.580808 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d503fe-842d-4c3c-b6a5-4c454f8577e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:45.609189 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-84d503fe-842d-4c3c-b6a5-4c454f8577e4 None None] MFA Rules not processed for user `351c2bec2de54748abf5c0f1098f48d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:30:45.610419 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-84d503fe-842d-4c3c-b6a5-4c454f8577e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:45.693372 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1011/2009] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:30:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:30:45.697976 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c31844e-6d9c-43e0-9db2-c2a04190bec7 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:45.719728 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:45.794959 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c31844e-6d9c-43e0-9db2-c2a04190bec7 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:45.801369 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276e8085-c07b-4abe-9250-eb4cb6aec22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:45.802231 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e8085-c07b-4abe-9250-eb4cb6aec22f admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:45.802452 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e8085-c07b-4abe-9250-eb4cb6aec22f admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:45.802697 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e8085-c07b-4abe-9250-eb4cb6aec22f admin admin] PATH_INFO: `/v3/projects` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:45.803897 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276e8085-c07b-4abe-9250-eb4cb6aec22f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:45.806488 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276e8085-c07b-4abe-9250-eb4cb6aec22f admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:45.846128 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 999/2010] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:30:45 2022] POST /identity/v3/projects => generated 383 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:30:45.849030 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d503fe-842d-4c3c-b6a5-4c454f8577e4 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:45.856547 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276e8085-c07b-4abe-9250-eb4cb6aec22f admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:45.859502 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-276e8085-c07b-4abe-9250-eb4cb6aec22f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:45.861800 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d503fe-842d-4c3c-b6a5-4c454f8577e4 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:45.913443 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:45.927026 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276e8085-c07b-4abe-9250-eb4cb6aec22f admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:45.930727 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7f1da7-beed-431f-b515-204ab7c8e88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:45.931474 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f1da7-beed-431f-b515-204ab7c8e88a admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:45.931711 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e945fdb-a0cd-46ed-a3ec-b888b64aae7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a147e14b61d481db1cac02c58ac3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:45.931841 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f1da7-beed-431f-b515-204ab7c8e88a admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:45.932164 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f1da7-beed-431f-b515-204ab7c8e88a admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:45.933200 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e945fdb-a0cd-46ed-a3ec-b888b64aae7d service cinder] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:45.933484 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e945fdb-a0cd-46ed-a3ec-b888b64aae7d service cinder] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:45.933600 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7f1da7-beed-431f-b515-204ab7c8e88a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:45.933769 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e945fdb-a0cd-46ed-a3ec-b888b64aae7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:45.935604 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-9e945fdb-a0cd-46ed-a3ec-b888b64aae7d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:45.936680 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7f1da7-beed-431f-b515-204ab7c8e88a admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:45.991456 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1012/2011] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:30:45 2022] POST /identity/v3/users => generated 298 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:30:45.991456 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7f1da7-beed-431f-b515-204ab7c8e88a admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:46.008596 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7f1da7-beed-431f-b515-204ab7c8e88a admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:46.016502 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c787c4-de05-4b00-b0ce-c171a2a9ec25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:46.018566 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c787c4-de05-4b00-b0ce-c171a2a9ec25 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:46.019118 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c787c4-de05-4b00-b0ce-c171a2a9ec25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:46.019411 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c787c4-de05-4b00-b0ce-c171a2a9ec25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:46.021288 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c787c4-de05-4b00-b0ce-c171a2a9ec25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:46.023522 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c787c4-de05-4b00-b0ce-c171a2a9ec25 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:46.050237 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1013/2012] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:30:45 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:30:46.051320 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c787c4-de05-4b00-b0ce-c171a2a9ec25 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:46.055581 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e945fdb-a0cd-46ed-a3ec-b888b64aae7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:46.057842 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e945fdb-a0cd-46ed-a3ec-b888b64aae7d service cinder] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:46.070527 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c787c4-de05-4b00-b0ce-c171a2a9ec25 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:46.089991 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1000/2013] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:30:45 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 05:30:46.106004 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb8cc72-66a5-41b7-a68a-f02b90d7cec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:46.107283 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb8cc72-66a5-41b7-a68a-f02b90d7cec8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:46.107576 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb8cc72-66a5-41b7-a68a-f02b90d7cec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:46.107881 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb8cc72-66a5-41b7-a68a-f02b90d7cec8 admin admin] PATH_INFO: `/v3/projects/09685839adeb4eaba72b1f90fe1e8ddf/users/61d9c02fab5d466ba026a4c6dfd3631d/roles/5b702713e40145b49e0b42abd0a5fba9` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:46.162589 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb8cc72-66a5-41b7-a68a-f02b90d7cec8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09685839adeb4eaba72b1f90fe1e8ddf, user_id=61d9c02fab5d466ba026a4c6dfd3631d, role_id=5b702713e40145b49e0b42abd0a5fba9)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:46.165425 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb8cc72-66a5-41b7-a68a-f02b90d7cec8 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:46.199571 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1014/2014] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:30:46 2022] PUT /identity/v3/projects/09685839adeb4eaba72b1f90fe1e8ddf/users/61d9c02fab5d466ba026a4c6dfd3631d/roles/5b702713e40145b49e0b42abd0a5fba9 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:30:46.204739 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e945fdb-a0cd-46ed-a3ec-b888b64aae7d service cinder] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:46.224765 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e945fdb-a0cd-46ed-a3ec-b888b64aae7d service cinder] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:46.348720 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:46.381568 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a28f44c-7e08-4f1b-aa2e-ba75781ae9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:46.386566 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a28f44c-7e08-4f1b-aa2e-ba75781ae9e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:46.387088 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a28f44c-7e08-4f1b-aa2e-ba75781ae9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:46.387377 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a28f44c-7e08-4f1b-aa2e-ba75781ae9e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:46.388122 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a28f44c-7e08-4f1b-aa2e-ba75781ae9e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:46.393235 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a28f44c-7e08-4f1b-aa2e-ba75781ae9e7 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:46.441115 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1001/2015] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:30:46 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:30:46.444819 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb8cc72-66a5-41b7-a68a-f02b90d7cec8 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:46.459022 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb8cc72-66a5-41b7-a68a-f02b90d7cec8 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:46.465998 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97405141-36ad-4389-8bb4-6d1585f4dd7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:46.466744 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97405141-36ad-4389-8bb4-6d1585f4dd7b admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:46.467023 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97405141-36ad-4389-8bb4-6d1585f4dd7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:46.467296 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97405141-36ad-4389-8bb4-6d1585f4dd7b admin admin] PATH_INFO: `/v3/projects/09685839adeb4eaba72b1f90fe1e8ddf/users/61d9c02fab5d466ba026a4c6dfd3631d/roles/5b702713e40145b49e0b42abd0a5fba9` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:46.469578 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97405141-36ad-4389-8bb4-6d1585f4dd7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=09685839adeb4eaba72b1f90fe1e8ddf, user_id=61d9c02fab5d466ba026a4c6dfd3631d, role_id=5b702713e40145b49e0b42abd0a5fba9)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:46.472471 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97405141-36ad-4389-8bb4-6d1585f4dd7b admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:46.499583 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1015/2016] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:30:46 2022] PUT /identity/v3/projects/09685839adeb4eaba72b1f90fe1e8ddf/users/61d9c02fab5d466ba026a4c6dfd3631d/roles/5b702713e40145b49e0b42abd0a5fba9 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:30:46.500845 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c72ad40-0736-4134-ae41-4f65c868b526 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:46.501211 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c72ad40-0736-4134-ae41-4f65c868b526 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:46.501523 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c72ad40-0736-4134-ae41-4f65c868b526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:46.548337 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-1c72ad40-0736-4134-ae41-4f65c868b526 None None] MFA Rules not processed for user `61d9c02fab5d466ba026a4c6dfd3631d`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:30:46.552618 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-1c72ad40-0736-4134-ae41-4f65c868b526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:46.694426 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1002/2017] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:30:46 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 05:30:46.821218 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97405141-36ad-4389-8bb4-6d1585f4dd7b admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:46.888597 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97405141-36ad-4389-8bb4-6d1585f4dd7b admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:46.894749 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d827815-a862-4822-babf-bb4c9d1c560d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a147e14b61d481db1cac02c58ac3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:46.895324 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d827815-a862-4822-babf-bb4c9d1c560d service cinder] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:46.895635 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d827815-a862-4822-babf-bb4c9d1c560d service cinder] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:46.895905 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d827815-a862-4822-babf-bb4c9d1c560d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:46.978566 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d827815-a862-4822-babf-bb4c9d1c560d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:46.980355 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d827815-a862-4822-babf-bb4c9d1c560d service cinder] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:46.990409 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1016/2018] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:30:46 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:30:47.033771 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c72ad40-0736-4134-ae41-4f65c868b526 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:47.035250 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-1c72ad40-0736-4134-ae41-4f65c868b526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:47.047054 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c72ad40-0736-4134-ae41-4f65c868b526 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:47.050670 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441592e1-8a35-4749-945b-c0b6e3ec3ea7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a147e14b61d481db1cac02c58ac3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:47.051277 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441592e1-8a35-4749-945b-c0b6e3ec3ea7 service cinder] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:47.051556 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441592e1-8a35-4749-945b-c0b6e3ec3ea7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:47.051948 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441592e1-8a35-4749-945b-c0b6e3ec3ea7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:47.053738 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-441592e1-8a35-4749-945b-c0b6e3ec3ea7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:47.119292 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441592e1-8a35-4749-945b-c0b6e3ec3ea7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:47.121288 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441592e1-8a35-4749-945b-c0b6e3ec3ea7 service cinder] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:47.131095 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1003/2019] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:30:47 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:30:47.811092 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d827815-a862-4822-babf-bb4c9d1c560d service cinder] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:47.812652 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-7d827815-a862-4822-babf-bb4c9d1c560d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:47.862469 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:47.884931 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d827815-a862-4822-babf-bb4c9d1c560d service cinder] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:47.890684 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3925ee05-5048-4025-bd66-7f09663aa842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:47.891438 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3925ee05-5048-4025-bd66-7f09663aa842 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:47.891821 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3925ee05-5048-4025-bd66-7f09663aa842 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:47.892013 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3925ee05-5048-4025-bd66-7f09663aa842 admin admin] PATH_INFO: `/v3/users/c401d17b53b1426fa4d35ebd62e0ee52` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:47.893135 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3925ee05-5048-4025-bd66-7f09663aa842 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c401d17b53b1426fa4d35ebd62e0ee52)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:47.895089 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3925ee05-5048-4025-bd66-7f09663aa842 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:47.958811 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-3925ee05-5048-4025-bd66-7f09663aa842 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c401d17b53b1426fa4d35ebd62e0ee52'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:47.982741 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-3925ee05-5048-4025-bd66-7f09663aa842 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c401d17b53b1426fa4d35ebd62e0ee52'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:47.996084 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-3925ee05-5048-4025-bd66-7f09663aa842 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c401d17b53b1426fa4d35ebd62e0ee52'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:48.007183 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-3925ee05-5048-4025-bd66-7f09663aa842 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c401d17b53b1426fa4d35ebd62e0ee52'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:48.007442 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-3925ee05-5048-4025-bd66-7f09663aa842 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c401d17b53b1426fa4d35ebd62e0ee52'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:48.017247 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1017/2020] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:30:47 2022] DELETE /identity/v3/users/c401d17b53b1426fa4d35ebd62e0ee52 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 05:30:48.023372 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad423a-8d13-43be-96e4-10d7039f5b43 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:48.024527 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad423a-8d13-43be-96e4-10d7039f5b43 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:48.025231 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad423a-8d13-43be-96e4-10d7039f5b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:48.054870 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-1aad423a-8d13-43be-96e4-10d7039f5b43 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:30:48.056310 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-1aad423a-8d13-43be-96e4-10d7039f5b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:48.121944 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1004/2021] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:30:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:30:48.131646 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3925ee05-5048-4025-bd66-7f09663aa842 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:48.133210 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-3925ee05-5048-4025-bd66-7f09663aa842 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:48.193486 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3925ee05-5048-4025-bd66-7f09663aa842 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:48.197149 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb62d067-2d14-4a0c-8d23-6789fe86e4b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:48.197865 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb62d067-2d14-4a0c-8d23-6789fe86e4b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:48.198141 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb62d067-2d14-4a0c-8d23-6789fe86e4b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:48.198411 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb62d067-2d14-4a0c-8d23-6789fe86e4b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:48.208196 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb62d067-2d14-4a0c-8d23-6789fe86e4b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:48.209807 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb62d067-2d14-4a0c-8d23-6789fe86e4b5 service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:48.220007 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1018/2022] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:30:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:30:48.655753 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aad423a-8d13-43be-96e4-10d7039f5b43 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:48.657904 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-1aad423a-8d13-43be-96e4-10d7039f5b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:48.683957 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aad423a-8d13-43be-96e4-10d7039f5b43 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:48.691307 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac21a8-d3cb-4014-80d3-07e321b028ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:48.692250 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac21a8-d3cb-4014-80d3-07e321b028ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:48.692250 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac21a8-d3cb-4014-80d3-07e321b028ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:48.692525 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac21a8-d3cb-4014-80d3-07e321b028ab admin admin] PATH_INFO: `/v3/projects/a17a2345d12942c4919d1997e41b13bf` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:48.693686 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaac21a8-d3cb-4014-80d3-07e321b028ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=a17a2345d12942c4919d1997e41b13bf)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:48.695815 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaac21a8-d3cb-4014-80d3-07e321b028ab admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:48.705677 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:48.773020 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-eaac21a8-d3cb-4014-80d3-07e321b028ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a17a2345d12942c4919d1997e41b13bf', 'request_id': 'req-eaac21a8-d3cb-4014-80d3-07e321b028ab'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:48.788087 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-eaac21a8-d3cb-4014-80d3-07e321b028ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a17a2345d12942c4919d1997e41b13bf', 'request_id': 'req-eaac21a8-d3cb-4014-80d3-07e321b028ab'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:48.796145 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-eaac21a8-d3cb-4014-80d3-07e321b028ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a17a2345d12942c4919d1997e41b13bf', 'request_id': 'req-eaac21a8-d3cb-4014-80d3-07e321b028ab'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:48.810367 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-eaac21a8-d3cb-4014-80d3-07e321b028ab admin admin] The token cache is being invalidate because project a17a2345d12942c4919d1997e41b13bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81383) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:30:48.810884 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-eaac21a8-d3cb-4014-80d3-07e321b028ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:48.812130 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-eaac21a8-d3cb-4014-80d3-07e321b028ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:48.814152 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1005/2023] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:30:48 2022] DELETE /identity/v3/projects/a17a2345d12942c4919d1997e41b13bf => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:30:48.818803 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb62d067-2d14-4a0c-8d23-6789fe86e4b5 service neutron] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:48.835328 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb62d067-2d14-4a0c-8d23-6789fe86e4b5 service neutron] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:48.937707 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524b048e-37b5-491e-afeb-101dcf448164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:48.938357 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b048e-37b5-491e-afeb-101dcf448164 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:48.938932 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b048e-37b5-491e-afeb-101dcf448164 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:48.939217 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b048e-37b5-491e-afeb-101dcf448164 admin admin] PATH_INFO: `/v3/users/bc937ada96194345bfa46387e34a3489` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:48.942093 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524b048e-37b5-491e-afeb-101dcf448164 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc937ada96194345bfa46387e34a3489)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:48.943506 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524b048e-37b5-491e-afeb-101dcf448164 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:48.950977 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:49.008695 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-524b048e-37b5-491e-afeb-101dcf448164 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc937ada96194345bfa46387e34a3489'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:49.022290 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-524b048e-37b5-491e-afeb-101dcf448164 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc937ada96194345bfa46387e34a3489'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:49.035054 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-524b048e-37b5-491e-afeb-101dcf448164 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc937ada96194345bfa46387e34a3489'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:49.046177 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-524b048e-37b5-491e-afeb-101dcf448164 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc937ada96194345bfa46387e34a3489'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:49.046814 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-524b048e-37b5-491e-afeb-101dcf448164 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc937ada96194345bfa46387e34a3489'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:49.052960 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1019/2024] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:30:48 2022] DELETE /identity/v3/users/bc937ada96194345bfa46387e34a3489 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:30:49.128542 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac21a8-d3cb-4014-80d3-07e321b028ab admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:49.130277 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-eaac21a8-d3cb-4014-80d3-07e321b028ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:49.146524 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac21a8-d3cb-4014-80d3-07e321b028ab admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:49.212027 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2d01ff-1297-4ca2-9ab2-da0a60a5fe9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:49.212727 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d01ff-1297-4ca2-9ab2-da0a60a5fe9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:49.212908 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d01ff-1297-4ca2-9ab2-da0a60a5fe9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:49.213204 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d01ff-1297-4ca2-9ab2-da0a60a5fe9b admin admin] PATH_INFO: `/v3/users/c405e9ed18014ef1b125f679614f4022` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:49.214877 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2d01ff-1297-4ca2-9ab2-da0a60a5fe9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c405e9ed18014ef1b125f679614f4022)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:49.216896 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2d01ff-1297-4ca2-9ab2-da0a60a5fe9b admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:49.269474 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-5a2d01ff-1297-4ca2-9ab2-da0a60a5fe9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c405e9ed18014ef1b125f679614f4022'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:49.285007 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-5a2d01ff-1297-4ca2-9ab2-da0a60a5fe9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c405e9ed18014ef1b125f679614f4022'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:49.295278 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-5a2d01ff-1297-4ca2-9ab2-da0a60a5fe9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c405e9ed18014ef1b125f679614f4022'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:49.303473 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-5a2d01ff-1297-4ca2-9ab2-da0a60a5fe9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c405e9ed18014ef1b125f679614f4022'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:49.304211 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-5a2d01ff-1297-4ca2-9ab2-da0a60a5fe9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c405e9ed18014ef1b125f679614f4022'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:49.311277 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1006/2025] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:30:49 2022] DELETE /identity/v3/users/c405e9ed18014ef1b125f679614f4022 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:30:49.316795 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c659a5-2030-4bcf-b6d4-9a8d4cfebec9 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:49.317109 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c659a5-2030-4bcf-b6d4-9a8d4cfebec9 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:49.317718 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c659a5-2030-4bcf-b6d4-9a8d4cfebec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:49.341014 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-c6c659a5-2030-4bcf-b6d4-9a8d4cfebec9 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:30:49.342491 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-c6c659a5-2030-4bcf-b6d4-9a8d4cfebec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:49.352630 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2d01ff-1297-4ca2-9ab2-da0a60a5fe9b admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:49.355130 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-5a2d01ff-1297-4ca2-9ab2-da0a60a5fe9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:49.391095 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:49.414833 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1020/2026] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:30:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 05:30:49.424460 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c659a5-2030-4bcf-b6d4-9a8d4cfebec9 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:49.426102 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-c6c659a5-2030-4bcf-b6d4-9a8d4cfebec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:49.440229 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2d01ff-1297-4ca2-9ab2-da0a60a5fe9b admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:49.445064 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7e8e90-9e76-42cd-9373-801b800f517c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:49.445707 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7e8e90-9e76-42cd-9373-801b800f517c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:49.445994 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7e8e90-9e76-42cd-9373-801b800f517c admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:49.446277 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7e8e90-9e76-42cd-9373-801b800f517c admin admin] PATH_INFO: `/v3/projects/fcf59bb557cf45faade23710510704b9` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:49.447420 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7e8e90-9e76-42cd-9373-801b800f517c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcf59bb557cf45faade23710510704b9)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:49.449929 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7e8e90-9e76-42cd-9373-801b800f517c admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:49.484593 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c659a5-2030-4bcf-b6d4-9a8d4cfebec9 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:49.497751 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-4f7e8e90-9e76-42cd-9373-801b800f517c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcf59bb557cf45faade23710510704b9', 'request_id': 'req-4f7e8e90-9e76-42cd-9373-801b800f517c'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:49.505920 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-4f7e8e90-9e76-42cd-9373-801b800f517c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcf59bb557cf45faade23710510704b9', 'request_id': 'req-4f7e8e90-9e76-42cd-9373-801b800f517c'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:49.512099 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-4f7e8e90-9e76-42cd-9373-801b800f517c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcf59bb557cf45faade23710510704b9', 'request_id': 'req-4f7e8e90-9e76-42cd-9373-801b800f517c'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:49.523766 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-4f7e8e90-9e76-42cd-9373-801b800f517c admin admin] The token cache is being invalidate because project fcf59bb557cf45faade23710510704b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81383) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:30:49.523995 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-4f7e8e90-9e76-42cd-9373-801b800f517c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:49.524661 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-4f7e8e90-9e76-42cd-9373-801b800f517c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:49.525400 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:49.526729 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1007/2027] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:30:49 2022] DELETE /identity/v3/projects/fcf59bb557cf45faade23710510704b9 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 05:30:49.530905 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7e8e90-9e76-42cd-9373-801b800f517c admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:49.532548 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-4f7e8e90-9e76-42cd-9373-801b800f517c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:49.539383 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95cd3ff-e877-4dfe-9361-5c303fa6dfa2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:49.540033 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95cd3ff-e877-4dfe-9361-5c303fa6dfa2 service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:49.540317 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95cd3ff-e877-4dfe-9361-5c303fa6dfa2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:49.540590 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95cd3ff-e877-4dfe-9361-5c303fa6dfa2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:49.542940 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-e95cd3ff-e877-4dfe-9361-5c303fa6dfa2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:49.599052 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7e8e90-9e76-42cd-9373-801b800f517c admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:49.604250 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272e7d68-89b8-462b-81af-6e669246614f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:49.605496 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e7d68-89b8-462b-81af-6e669246614f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:49.605779 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e7d68-89b8-462b-81af-6e669246614f admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:49.606277 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e7d68-89b8-462b-81af-6e669246614f admin admin] PATH_INFO: `/v3/users/e00e80bf55ab45168ef37b3ae81ef77d` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:49.606997 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95cd3ff-e877-4dfe-9361-5c303fa6dfa2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:49.607551 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272e7d68-89b8-462b-81af-6e669246614f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e00e80bf55ab45168ef37b3ae81ef77d)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:49.608490 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95cd3ff-e877-4dfe-9361-5c303fa6dfa2 service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:49.609552 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272e7d68-89b8-462b-81af-6e669246614f admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:49.619918 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1021/2028] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:30:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 05:30:49.675289 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-272e7d68-89b8-462b-81af-6e669246614f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e00e80bf55ab45168ef37b3ae81ef77d'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:49.676776 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:49.693736 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-272e7d68-89b8-462b-81af-6e669246614f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e00e80bf55ab45168ef37b3ae81ef77d'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:49.706354 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-272e7d68-89b8-462b-81af-6e669246614f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e00e80bf55ab45168ef37b3ae81ef77d'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:49.719375 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-272e7d68-89b8-462b-81af-6e669246614f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e00e80bf55ab45168ef37b3ae81ef77d'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:49.721087 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-272e7d68-89b8-462b-81af-6e669246614f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e00e80bf55ab45168ef37b3ae81ef77d'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:49.728867 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1008/2029] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:30:49 2022] DELETE /identity/v3/users/e00e80bf55ab45168ef37b3ae81ef77d => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 05:30:50.032454 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95cd3ff-e877-4dfe-9361-5c303fa6dfa2 service neutron] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:50.034143 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-e95cd3ff-e877-4dfe-9361-5c303fa6dfa2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:50.051030 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95cd3ff-e877-4dfe-9361-5c303fa6dfa2 service neutron] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:50.170341 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a13be91-12de-4a28-8625-6e9e0f12d072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:50.171027 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a13be91-12de-4a28-8625-6e9e0f12d072 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:50.171867 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a13be91-12de-4a28-8625-6e9e0f12d072 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:50.172450 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a13be91-12de-4a28-8625-6e9e0f12d072 admin admin] PATH_INFO: `/v3/projects/bbd0e9ddffc14e338730620073cdaab9` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:50.173914 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a13be91-12de-4a28-8625-6e9e0f12d072 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbd0e9ddffc14e338730620073cdaab9)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:50.176396 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a13be91-12de-4a28-8625-6e9e0f12d072 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:50.194150 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272e7d68-89b8-462b-81af-6e669246614f admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:50.195972 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-272e7d68-89b8-462b-81af-6e669246614f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:50.226082 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272e7d68-89b8-462b-81af-6e669246614f admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:50.239502 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ddae40-9ba0-43ea-9c3d-ee3f81dca1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:50.241261 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ddae40-9ba0-43ea-9c3d-ee3f81dca1d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:50.241724 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ddae40-9ba0-43ea-9c3d-ee3f81dca1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:50.242211 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ddae40-9ba0-43ea-9c3d-ee3f81dca1d0 admin admin] PATH_INFO: `/v3/projects/3b5abb2bbb4e476294370724eaf51332` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:50.244021 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ddae40-9ba0-43ea-9c3d-ee3f81dca1d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b5abb2bbb4e476294370724eaf51332)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:50.247353 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ddae40-9ba0-43ea-9c3d-ee3f81dca1d0 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:50.280250 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-4a13be91-12de-4a28-8625-6e9e0f12d072 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbd0e9ddffc14e338730620073cdaab9', 'request_id': 'req-4a13be91-12de-4a28-8625-6e9e0f12d072'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:50.289602 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-4a13be91-12de-4a28-8625-6e9e0f12d072 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbd0e9ddffc14e338730620073cdaab9', 'request_id': 'req-4a13be91-12de-4a28-8625-6e9e0f12d072'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:50.299984 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-4a13be91-12de-4a28-8625-6e9e0f12d072 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbd0e9ddffc14e338730620073cdaab9', 'request_id': 'req-4a13be91-12de-4a28-8625-6e9e0f12d072'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:50.318223 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-4a13be91-12de-4a28-8625-6e9e0f12d072 admin admin] The token cache is being invalidate because project bbd0e9ddffc14e338730620073cdaab9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:30:50.318514 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-4a13be91-12de-4a28-8625-6e9e0f12d072 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:50.319392 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-4a13be91-12de-4a28-8625-6e9e0f12d072 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:50.321668 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1022/2030] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:30:50 2022] DELETE /identity/v3/projects/bbd0e9ddffc14e338730620073cdaab9 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:30:50.327572 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f569cc2-3582-40c1-b7c9-5931a701f3f7 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:50.327988 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f569cc2-3582-40c1-b7c9-5931a701f3f7 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:50.328158 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f569cc2-3582-40c1-b7c9-5931a701f3f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:50.329007 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-02ddae40-9ba0-43ea-9c3d-ee3f81dca1d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b5abb2bbb4e476294370724eaf51332', 'request_id': 'req-02ddae40-9ba0-43ea-9c3d-ee3f81dca1d0'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:50.343951 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-02ddae40-9ba0-43ea-9c3d-ee3f81dca1d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b5abb2bbb4e476294370724eaf51332', 'request_id': 'req-02ddae40-9ba0-43ea-9c3d-ee3f81dca1d0'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:50.356626 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-02ddae40-9ba0-43ea-9c3d-ee3f81dca1d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b5abb2bbb4e476294370724eaf51332', 'request_id': 'req-02ddae40-9ba0-43ea-9c3d-ee3f81dca1d0'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:50.359108 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-3f569cc2-3582-40c1-b7c9-5931a701f3f7 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:30:50.360421 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-3f569cc2-3582-40c1-b7c9-5931a701f3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:50.376081 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-02ddae40-9ba0-43ea-9c3d-ee3f81dca1d0 admin admin] The token cache is being invalidate because project 3b5abb2bbb4e476294370724eaf51332 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81383) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:30:50.376433 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-02ddae40-9ba0-43ea-9c3d-ee3f81dca1d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:50.377349 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-02ddae40-9ba0-43ea-9c3d-ee3f81dca1d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:50.378721 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:50.379384 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1009/2031] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:30:50 2022] DELETE /identity/v3/projects/3b5abb2bbb4e476294370724eaf51332 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 05:30:50.386471 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a406c-1f5a-441b-8229-fd9cdb8c645f None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:50.386992 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a406c-1f5a-441b-8229-fd9cdb8c645f None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:50.388548 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a406c-1f5a-441b-8229-fd9cdb8c645f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:50.414798 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-718a406c-1f5a-441b-8229-fd9cdb8c645f None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:30:50.416884 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-718a406c-1f5a-441b-8229-fd9cdb8c645f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:50.451828 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1023/2032] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:30:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 05:30:50.456698 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114641fd-2733-4f0e-a72d-4ad1f2d6bdf2 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:50.457333 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114641fd-2733-4f0e-a72d-4ad1f2d6bdf2 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:50.459020 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114641fd-2733-4f0e-a72d-4ad1f2d6bdf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:50.489993 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-114641fd-2733-4f0e-a72d-4ad1f2d6bdf2 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:30:50.491584 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-114641fd-2733-4f0e-a72d-4ad1f2d6bdf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:50.503025 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1024/2033] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:30:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 05:30:50.508217 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114641fd-2733-4f0e-a72d-4ad1f2d6bdf2 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:50.528191 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114641fd-2733-4f0e-a72d-4ad1f2d6bdf2 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:50.548555 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d421122-638d-4c7c-9572-f8f230d7fe89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:50.549191 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d421122-638d-4c7c-9572-f8f230d7fe89 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:50.549539 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d421122-638d-4c7c-9572-f8f230d7fe89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:50.549985 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d421122-638d-4c7c-9572-f8f230d7fe89 admin admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:50.550801 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d421122-638d-4c7c-9572-f8f230d7fe89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:30:50.551206 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d421122-638d-4c7c-9572-f8f230d7fe89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:50.553149 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d421122-638d-4c7c-9572-f8f230d7fe89 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:50.563958 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1010/2034] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:30:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 05:30:50.566255 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7659d0-7188-4c87-b0fb-bd3cae11d030 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:50.566728 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7659d0-7188-4c87-b0fb-bd3cae11d030 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:50.567167 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7659d0-7188-4c87-b0fb-bd3cae11d030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:50.582653 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1025/2035] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 05:30:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:30:50.583795 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d421122-638d-4c7c-9572-f8f230d7fe89 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:50.590283 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-8f7659d0-7188-4c87-b0fb-bd3cae11d030 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:30:50.591519 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-8f7659d0-7188-4c87-b0fb-bd3cae11d030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:50.596489 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d421122-638d-4c7c-9572-f8f230d7fe89 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:50.600866 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1011/2036] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:30:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:30:50.601803 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db32c50-dcdc-4212-bd7e-fdde2457b0a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:50.602461 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db32c50-dcdc-4212-bd7e-fdde2457b0a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:50.602751 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db32c50-dcdc-4212-bd7e-fdde2457b0a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:50.603017 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db32c50-dcdc-4212-bd7e-fdde2457b0a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:50.604800 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db32c50-dcdc-4212-bd7e-fdde2457b0a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:50.605911 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7659d0-7188-4c87-b0fb-bd3cae11d030 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:50.607154 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db32c50-dcdc-4212-bd7e-fdde2457b0a9 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:50.617109 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7659d0-7188-4c87-b0fb-bd3cae11d030 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:50.623221 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd663eff-84a7-4f4b-9683-d7bb76e65980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:50.624063 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd663eff-84a7-4f4b-9683-d7bb76e65980 admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:50.624220 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd663eff-84a7-4f4b-9683-d7bb76e65980 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:50.624411 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd663eff-84a7-4f4b-9683-d7bb76e65980 admin admin] PATH_INFO: `/v3/domains` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:50.625081 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd663eff-84a7-4f4b-9683-d7bb76e65980 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:30:50.625370 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd663eff-84a7-4f4b-9683-d7bb76e65980 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:50.626967 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd663eff-84a7-4f4b-9683-d7bb76e65980 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:50.640704 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1026/2037] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:30:50 2022] POST /identity/v3/projects => generated 361 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:30:50.645349 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1012/2038] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 05:30:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:30:50.645501 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db32c50-dcdc-4212-bd7e-fdde2457b0a9 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:50.646259 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd663eff-84a7-4f4b-9683-d7bb76e65980 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:50.657051 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd663eff-84a7-4f4b-9683-d7bb76e65980 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:50.710529 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:50.734506 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db32c50-dcdc-4212-bd7e-fdde2457b0a9 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:50.741981 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfb27a2-a04c-4a43-89be-257df5d2cf78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:50.742762 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfb27a2-a04c-4a43-89be-257df5d2cf78 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:50.743216 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfb27a2-a04c-4a43-89be-257df5d2cf78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:50.743826 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfb27a2-a04c-4a43-89be-257df5d2cf78 admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:50.745010 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfb27a2-a04c-4a43-89be-257df5d2cf78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:50.747114 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfb27a2-a04c-4a43-89be-257df5d2cf78 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:50.747228 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7110f7e-4428-4e82-a10e-cf5b0602bde6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:50.747891 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7110f7e-4428-4e82-a10e-cf5b0602bde6 admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:50.748174 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7110f7e-4428-4e82-a10e-cf5b0602bde6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:50.748447 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7110f7e-4428-4e82-a10e-cf5b0602bde6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:50.749109 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7110f7e-4428-4e82-a10e-cf5b0602bde6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:50.753199 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7110f7e-4428-4e82-a10e-cf5b0602bde6 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:50.775426 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1027/2039] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:30:50 2022] POST /identity/v3/users => generated 281 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 05:30:50.776755 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfb27a2-a04c-4a43-89be-257df5d2cf78 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:50.790882 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfb27a2-a04c-4a43-89be-257df5d2cf78 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:50.797959 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1742216-128e-4243-977d-03080b1daa90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:50.798417 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1013/2040] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:30:50 2022] POST /identity/v3/projects => generated 379 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 05:30:50.802913 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1742216-128e-4243-977d-03080b1daa90 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:50.803135 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1742216-128e-4243-977d-03080b1daa90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:50.803425 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1742216-128e-4243-977d-03080b1daa90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:50.803532 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7110f7e-4428-4e82-a10e-cf5b0602bde6 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:50.804137 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1742216-128e-4243-977d-03080b1daa90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:50.805981 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1742216-128e-4243-977d-03080b1daa90 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:50.818009 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1028/2041] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:30:50 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:30:50.822724 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1742216-128e-4243-977d-03080b1daa90 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:50.833668 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1742216-128e-4243-977d-03080b1daa90 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:50.885741 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7110f7e-4428-4e82-a10e-cf5b0602bde6 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:50.890514 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:50.890946 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6188967b-139b-4836-b2df-7d01369ea069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:50.891565 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6188967b-139b-4836-b2df-7d01369ea069 admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:50.891893 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6188967b-139b-4836-b2df-7d01369ea069 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:50.892171 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6188967b-139b-4836-b2df-7d01369ea069 admin admin] PATH_INFO: `/v3/users` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:50.893258 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6188967b-139b-4836-b2df-7d01369ea069 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:50.896009 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6188967b-139b-4836-b2df-7d01369ea069 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:50.898426 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a3c64-d12a-4685-b258-378496d4b5fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:50.899060 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a3c64-d12a-4685-b258-378496d4b5fa admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:50.899756 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a3c64-d12a-4685-b258-378496d4b5fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:50.900026 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a3c64-d12a-4685-b258-378496d4b5fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:50.901222 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17a3c64-d12a-4685-b258-378496d4b5fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:50.905012 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17a3c64-d12a-4685-b258-378496d4b5fa admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:50.914885 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1029/2042] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:30:50 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 05:30:50.919375 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a3c64-d12a-4685-b258-378496d4b5fa admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:50.923727 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1014/2043] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:30:50 2022] POST /identity/v3/users => generated 290 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 05:30:50.927025 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6188967b-139b-4836-b2df-7d01369ea069 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:50.930702 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a3c64-d12a-4685-b258-378496d4b5fa admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:50.936061 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381bb1d7-a5ff-4a5f-a138-aad677a014f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:50.936914 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381bb1d7-a5ff-4a5f-a138-aad677a014f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:50.937280 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381bb1d7-a5ff-4a5f-a138-aad677a014f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:50.937619 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381bb1d7-a5ff-4a5f-a138-aad677a014f9 admin admin] PATH_INFO: `/v3/projects/ef0fe9e49ca1468b899d55427e34c3a3/users/bbb3b3ecf77e4b1dbef584fb26f3db1f/roles/aa7ff8e0ec1e48e5811335b9eb38b448` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:50.938537 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6188967b-139b-4836-b2df-7d01369ea069 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:50.944279 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9485dbc-a8f4-47b8-9391-7ae94a5770d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:50.944900 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9485dbc-a8f4-47b8-9391-7ae94a5770d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:50.945184 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9485dbc-a8f4-47b8-9391-7ae94a5770d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:50.945455 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9485dbc-a8f4-47b8-9391-7ae94a5770d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:50.946103 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9485dbc-a8f4-47b8-9391-7ae94a5770d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:50.948797 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9485dbc-a8f4-47b8-9391-7ae94a5770d3 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:50.954259 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381bb1d7-a5ff-4a5f-a138-aad677a014f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef0fe9e49ca1468b899d55427e34c3a3, user_id=bbb3b3ecf77e4b1dbef584fb26f3db1f, role_id=aa7ff8e0ec1e48e5811335b9eb38b448)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:50.957160 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381bb1d7-a5ff-4a5f-a138-aad677a014f9 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:50.964800 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1015/2044] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:30:50 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 05:30:50.966178 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9485dbc-a8f4-47b8-9391-7ae94a5770d3 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:50.972417 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1030/2045] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:30:50 2022] PUT /identity/v3/projects/ef0fe9e49ca1468b899d55427e34c3a3/users/bbb3b3ecf77e4b1dbef584fb26f3db1f/roles/aa7ff8e0ec1e48e5811335b9eb38b448 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:30:50.982898 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba40c338-f53e-4b12-920f-07bc6ada4617 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:50.983191 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba40c338-f53e-4b12-920f-07bc6ada4617 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:50.983458 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba40c338-f53e-4b12-920f-07bc6ada4617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:50.984116 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9485dbc-a8f4-47b8-9391-7ae94a5770d3 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:51.019938 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-ba40c338-f53e-4b12-920f-07bc6ada4617 None None] MFA Rules not processed for user `bbb3b3ecf77e4b1dbef584fb26f3db1f`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:30:51.021494 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-ba40c338-f53e-4b12-920f-07bc6ada4617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:51.067841 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca72c1f3-ad94-4233-ba80-4545e88a83ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:51.068472 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca72c1f3-ad94-4233-ba80-4545e88a83ae admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:51.068835 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca72c1f3-ad94-4233-ba80-4545e88a83ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:51.069100 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca72c1f3-ad94-4233-ba80-4545e88a83ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:51.071034 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca72c1f3-ad94-4233-ba80-4545e88a83ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:51.073665 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca72c1f3-ad94-4233-ba80-4545e88a83ae admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:51.092184 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1016/2046] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:30:50 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:30:51.093405 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca72c1f3-ad94-4233-ba80-4545e88a83ae admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:51.108352 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca72c1f3-ad94-4233-ba80-4545e88a83ae admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:51.109713 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1031/2047] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:30:50 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 05:30:51.116828 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31259c79-bb47-4878-ad4a-0040b0b9dc24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:51.118391 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31259c79-bb47-4878-ad4a-0040b0b9dc24 admin admin] REQUEST_METHOD: `PUT` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:51.118857 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31259c79-bb47-4878-ad4a-0040b0b9dc24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:51.119320 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31259c79-bb47-4878-ad4a-0040b0b9dc24 admin admin] PATH_INFO: `/v3/projects/8cbaa424ebc94a1cbf43f8327215e4af/users/9b84467150524838aa7f609cc95b935c/roles/aa7ff8e0ec1e48e5811335b9eb38b448` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:51.142839 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31259c79-bb47-4878-ad4a-0040b0b9dc24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cbaa424ebc94a1cbf43f8327215e4af, user_id=9b84467150524838aa7f609cc95b935c, role_id=aa7ff8e0ec1e48e5811335b9eb38b448)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:51.151966 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31259c79-bb47-4878-ad4a-0040b0b9dc24 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:51.152152 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba40c338-f53e-4b12-920f-07bc6ada4617 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:51.153844 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-ba40c338-f53e-4b12-920f-07bc6ada4617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:51.183243 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1017/2048] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:30:51 2022] PUT /identity/v3/projects/8cbaa424ebc94a1cbf43f8327215e4af/users/9b84467150524838aa7f609cc95b935c/roles/aa7ff8e0ec1e48e5811335b9eb38b448 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:30:51.185174 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a695d-5edb-44e5-98fd-acfde2a6f112 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:51.185637 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a695d-5edb-44e5-98fd-acfde2a6f112 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:51.185917 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a695d-5edb-44e5-98fd-acfde2a6f112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:51.202181 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:51.229532 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-b96a695d-5edb-44e5-98fd-acfde2a6f112 None None] MFA Rules not processed for user `9b84467150524838aa7f609cc95b935c`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:30:51.230762 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-b96a695d-5edb-44e5-98fd-acfde2a6f112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:51.246033 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba40c338-f53e-4b12-920f-07bc6ada4617 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:51.315254 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee66ee6-29a2-45a7-b6af-f775933446b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a147e14b61d481db1cac02c58ac3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:51.316001 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee66ee6-29a2-45a7-b6af-f775933446b9 service cinder] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:51.316766 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee66ee6-29a2-45a7-b6af-f775933446b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:51.316981 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee66ee6-29a2-45a7-b6af-f775933446b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:51.323097 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1018/2049] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:30:51 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:30:51.324603 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96a695d-5edb-44e5-98fd-acfde2a6f112 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:51.333167 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-b96a695d-5edb-44e5-98fd-acfde2a6f112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:51.356913 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:51.398967 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee66ee6-29a2-45a7-b6af-f775933446b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:51.401346 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee66ee6-29a2-45a7-b6af-f775933446b9 service cinder] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:51.410342 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96a695d-5edb-44e5-98fd-acfde2a6f112 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:51.411381 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1032/2050] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:30:51 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 05:30:51.412246 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee66ee6-29a2-45a7-b6af-f775933446b9 service cinder] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:51.416279 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9896c863-7d41-48ab-b801-ba698ad82fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:51.417466 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9896c863-7d41-48ab-b801-ba698ad82fa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:51.418439 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9896c863-7d41-48ab-b801-ba698ad82fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:51.418439 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9896c863-7d41-48ab-b801-ba698ad82fa1 admin admin] PATH_INFO: `/v3/users/cb80332552644ad1a57eca9cf136b0f1` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:51.419317 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9896c863-7d41-48ab-b801-ba698ad82fa1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb80332552644ad1a57eca9cf136b0f1)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:51.423010 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9896c863-7d41-48ab-b801-ba698ad82fa1 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:51.425401 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee66ee6-29a2-45a7-b6af-f775933446b9 service cinder] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:51.430457 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2901ff-3bee-4520-8d15-bb929854a8d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:51.431080 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2901ff-3bee-4520-8d15-bb929854a8d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:51.431359 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2901ff-3bee-4520-8d15-bb929854a8d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:51.431632 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2901ff-3bee-4520-8d15-bb929854a8d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:51.432348 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2901ff-3bee-4520-8d15-bb929854a8d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:51.434456 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2901ff-3bee-4520-8d15-bb929854a8d8 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:51.467617 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1033/2051] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:30:51 2022] POST /identity/v3/projects => generated 379 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:30:51.468652 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2901ff-3bee-4520-8d15-bb929854a8d8 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:51.492433 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-9896c863-7d41-48ab-b801-ba698ad82fa1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb80332552644ad1a57eca9cf136b0f1'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:51.508268 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-9896c863-7d41-48ab-b801-ba698ad82fa1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb80332552644ad1a57eca9cf136b0f1'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:51.516977 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-9896c863-7d41-48ab-b801-ba698ad82fa1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb80332552644ad1a57eca9cf136b0f1'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:51.528284 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-9896c863-7d41-48ab-b801-ba698ad82fa1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb80332552644ad1a57eca9cf136b0f1'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:51.529046 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-9896c863-7d41-48ab-b801-ba698ad82fa1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb80332552644ad1a57eca9cf136b0f1'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:51.537800 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1019/2052] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:30:51 2022] DELETE /identity/v3/users/cb80332552644ad1a57eca9cf136b0f1 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:30:51.538381 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9896c863-7d41-48ab-b801-ba698ad82fa1 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:51.539599 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2901ff-3bee-4520-8d15-bb929854a8d8 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:51.539739 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-9896c863-7d41-48ab-b801-ba698ad82fa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:51.558727 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:51.635120 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbd120c-5c63-4145-84b2-4b9ec27f72a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:51.636059 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd120c-5c63-4145-84b2-4b9ec27f72a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:51.636416 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd120c-5c63-4145-84b2-4b9ec27f72a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:51.636753 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd120c-5c63-4145-84b2-4b9ec27f72a5 admin admin] PATH_INFO: `/v3/users/bbb3b3ecf77e4b1dbef584fb26f3db1f` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:51.639028 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbd120c-5c63-4145-84b2-4b9ec27f72a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbb3b3ecf77e4b1dbef584fb26f3db1f)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:51.640864 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9896c863-7d41-48ab-b801-ba698ad82fa1 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:51.641845 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbd120c-5c63-4145-84b2-4b9ec27f72a5 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:51.646362 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7593cad-ee7a-498c-b519-58ba421344ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:51.647071 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7593cad-ee7a-498c-b519-58ba421344ff admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:51.647895 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7593cad-ee7a-498c-b519-58ba421344ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:51.648281 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7593cad-ee7a-498c-b519-58ba421344ff admin admin] PATH_INFO: `/v3/users` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:51.649976 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7593cad-ee7a-498c-b519-58ba421344ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:51.653007 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7593cad-ee7a-498c-b519-58ba421344ff admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:51.686560 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1020/2053] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:30:51 2022] POST /identity/v3/users => generated 296 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:30:51.688066 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5749f-0e75-46b5-96e8-833cacdddfa9 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:51.688793 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5749f-0e75-46b5-96e8-833cacdddfa9 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:51.689702 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5749f-0e75-46b5-96e8-833cacdddfa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:51.710048 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-ffb5749f-0e75-46b5-96e8-833cacdddfa9 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:30:51.711485 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-ffb5749f-0e75-46b5-96e8-833cacdddfa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:51.718155 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-0bbd120c-5c63-4145-84b2-4b9ec27f72a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbb3b3ecf77e4b1dbef584fb26f3db1f'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:51.724634 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1021/2054] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:30:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:30:51.724634 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb5749f-0e75-46b5-96e8-833cacdddfa9 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:51.728055 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:51.738773 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb5749f-0e75-46b5-96e8-833cacdddfa9 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:51.743497 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-0bbd120c-5c63-4145-84b2-4b9ec27f72a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbb3b3ecf77e4b1dbef584fb26f3db1f'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:51.750242 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a625f3d-8886-4690-85ff-55edfb606d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:51.751033 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a625f3d-8886-4690-85ff-55edfb606d0b admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:51.751341 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a625f3d-8886-4690-85ff-55edfb606d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:51.751611 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a625f3d-8886-4690-85ff-55edfb606d0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:51.752348 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a625f3d-8886-4690-85ff-55edfb606d0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:51.754027 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a625f3d-8886-4690-85ff-55edfb606d0b admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:51.757794 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-0bbd120c-5c63-4145-84b2-4b9ec27f72a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbb3b3ecf77e4b1dbef584fb26f3db1f'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:51.765560 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1022/2055] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:30:51 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:30:51.766438 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a625f3d-8886-4690-85ff-55edfb606d0b admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:51.769528 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-0a625f3d-8886-4690-85ff-55edfb606d0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:51.777150 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-0bbd120c-5c63-4145-84b2-4b9ec27f72a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbb3b3ecf77e4b1dbef584fb26f3db1f'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:51.777816 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-0bbd120c-5c63-4145-84b2-4b9ec27f72a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbb3b3ecf77e4b1dbef584fb26f3db1f'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:51.794992 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1034/2056] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:30:51 2022] DELETE /identity/v3/users/bbb3b3ecf77e4b1dbef584fb26f3db1f => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:30:51.795913 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbd120c-5c63-4145-84b2-4b9ec27f72a5 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:51.797287 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-0bbd120c-5c63-4145-84b2-4b9ec27f72a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:51.858901 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a625f3d-8886-4690-85ff-55edfb606d0b admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:51.868380 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbd120c-5c63-4145-84b2-4b9ec27f72a5 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:51.873855 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ee3b31-de13-4632-8c71-592f484b4f1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:51.874797 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee3b31-de13-4632-8c71-592f484b4f1e service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:51.875211 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee3b31-de13-4632-8c71-592f484b4f1e service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:51.875628 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee3b31-de13-4632-8c71-592f484b4f1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:51.878522 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-d1ee3b31-de13-4632-8c71-592f484b4f1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:51.937922 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cbfc48-e243-4859-83aa-e94539d17b42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a147e14b61d481db1cac02c58ac3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:51.938705 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cbfc48-e243-4859-83aa-e94539d17b42 service cinder] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:51.939089 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cbfc48-e243-4859-83aa-e94539d17b42 service cinder] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:51.939456 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cbfc48-e243-4859-83aa-e94539d17b42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:51.941430 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-12cbfc48-e243-4859-83aa-e94539d17b42 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:51.963019 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ee3b31-de13-4632-8c71-592f484b4f1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:51.966411 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ee3b31-de13-4632-8c71-592f484b4f1e service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:51.978834 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1035/2057] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:30:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:30:51.979856 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ee3b31-de13-4632-8c71-592f484b4f1e service neutron] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:51.981382 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-d1ee3b31-de13-4632-8c71-592f484b4f1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:51.993725 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ee3b31-de13-4632-8c71-592f484b4f1e service neutron] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:51.999401 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5b1259-0ed1-4b27-9211-8b95f7ba2f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:52.000458 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b1259-0ed1-4b27-9211-8b95f7ba2f12 admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:52.000746 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b1259-0ed1-4b27-9211-8b95f7ba2f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:52.001020 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b1259-0ed1-4b27-9211-8b95f7ba2f12 admin admin] PATH_INFO: `/v3/projects/eac3dfef631e4e7fa68496a52af3b1e6/users/deea1b9c12c74b20a8e90131167b31ad/roles/5b702713e40145b49e0b42abd0a5fba9` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:52.011635 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:52.024264 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5b1259-0ed1-4b27-9211-8b95f7ba2f12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eac3dfef631e4e7fa68496a52af3b1e6, user_id=deea1b9c12c74b20a8e90131167b31ad, role_id=5b702713e40145b49e0b42abd0a5fba9)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:52.028098 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5b1259-0ed1-4b27-9211-8b95f7ba2f12 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:52.029649 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cbfc48-e243-4859-83aa-e94539d17b42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:52.034003 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cbfc48-e243-4859-83aa-e94539d17b42 service cinder] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:52.048202 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1023/2058] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:30:51 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:30:52.051466 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dec494-1c9e-40d8-874f-79772880ffff None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:52.051466 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dec494-1c9e-40d8-874f-79772880ffff None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:52.051466 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dec494-1c9e-40d8-874f-79772880ffff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:52.052070 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1036/2059] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:30:51 2022] PUT /identity/v3/projects/eac3dfef631e4e7fa68496a52af3b1e6/users/deea1b9c12c74b20a8e90131167b31ad/roles/5b702713e40145b49e0b42abd0a5fba9 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:30:52.053809 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5b1259-0ed1-4b27-9211-8b95f7ba2f12 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:52.082298 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-29dec494-1c9e-40d8-874f-79772880ffff None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:30:52.083705 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-29dec494-1c9e-40d8-874f-79772880ffff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:52.151923 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5b1259-0ed1-4b27-9211-8b95f7ba2f12 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:52.159694 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35746b58-b129-48d0-9869-55be36373f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:52.161877 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35746b58-b129-48d0-9869-55be36373f84 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:52.161877 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35746b58-b129-48d0-9869-55be36373f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:52.161877 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35746b58-b129-48d0-9869-55be36373f84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:52.162969 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35746b58-b129-48d0-9869-55be36373f84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:52.167115 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35746b58-b129-48d0-9869-55be36373f84 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:52.170081 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:52.184224 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1037/2060] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:30:52 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:30:52.186008 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35746b58-b129-48d0-9869-55be36373f84 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:52.204598 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35746b58-b129-48d0-9869-55be36373f84 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:52.212310 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ba0e1-5b89-48ef-a4bc-fb55e1bf1fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:52.214740 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ba0e1-5b89-48ef-a4bc-fb55e1bf1fc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:52.214740 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ba0e1-5b89-48ef-a4bc-fb55e1bf1fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:52.215035 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ba0e1-5b89-48ef-a4bc-fb55e1bf1fc5 admin admin] PATH_INFO: `/v3/projects/eac3dfef631e4e7fa68496a52af3b1e6/users/deea1b9c12c74b20a8e90131167b31ad/roles/5b702713e40145b49e0b42abd0a5fba9` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:52.218122 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085ba0e1-5b89-48ef-a4bc-fb55e1bf1fc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eac3dfef631e4e7fa68496a52af3b1e6, user_id=deea1b9c12c74b20a8e90131167b31ad, role_id=5b702713e40145b49e0b42abd0a5fba9)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:52.222979 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085ba0e1-5b89-48ef-a4bc-fb55e1bf1fc5 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:52.224195 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1024/2061] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:30:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:30:52.245630 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1038/2062] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:30:52 2022] PUT /identity/v3/projects/eac3dfef631e4e7fa68496a52af3b1e6/users/deea1b9c12c74b20a8e90131167b31ad/roles/5b702713e40145b49e0b42abd0a5fba9 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:30:52.255819 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dec494-1c9e-40d8-874f-79772880ffff None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:52.258420 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fcc9b9-e937-49dd-aba1-1212bf1b24eb None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:52.258891 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fcc9b9-e937-49dd-aba1-1212bf1b24eb None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:52.259538 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fcc9b9-e937-49dd-aba1-1212bf1b24eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:52.264819 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-29dec494-1c9e-40d8-874f-79772880ffff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:52.300219 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-31fcc9b9-e937-49dd-aba1-1212bf1b24eb None None] MFA Rules not processed for user `deea1b9c12c74b20a8e90131167b31ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:30:52.301627 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-31fcc9b9-e937-49dd-aba1-1212bf1b24eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:52.383818 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dec494-1c9e-40d8-874f-79772880ffff None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:52.411760 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1039/2063] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:30:52 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:30:52.423712 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fcc9b9-e937-49dd-aba1-1212bf1b24eb None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:52.426175 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-31fcc9b9-e937-49dd-aba1-1212bf1b24eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:52.514022 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6721a9-6388-4f1e-a1db-82aee2810425 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:52.514847 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6721a9-6388-4f1e-a1db-82aee2810425 service neutron] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:52.515148 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6721a9-6388-4f1e-a1db-82aee2810425 service neutron] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:52.515531 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6721a9-6388-4f1e-a1db-82aee2810425 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:52.577165 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fcc9b9-e937-49dd-aba1-1212bf1b24eb None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:52.610274 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5606696-c6d5-40f3-a5ff-b242ae27bfdd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a147e14b61d481db1cac02c58ac3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:52.612124 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5606696-c6d5-40f3-a5ff-b242ae27bfdd service cinder] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:52.612468 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5606696-c6d5-40f3-a5ff-b242ae27bfdd service cinder] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:52.613956 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5606696-c6d5-40f3-a5ff-b242ae27bfdd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:52.636886 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6721a9-6388-4f1e-a1db-82aee2810425 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:52.639396 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6721a9-6388-4f1e-a1db-82aee2810425 service neutron] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:52.649560 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:52.650205 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5606696-c6d5-40f3-a5ff-b242ae27bfdd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:52.652274 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5606696-c6d5-40f3-a5ff-b242ae27bfdd service cinder] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:52.660192 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1025/2064] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:30:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:30:52.661224 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6721a9-6388-4f1e-a1db-82aee2810425 service neutron] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:52.663871 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-de6721a9-6388-4f1e-a1db-82aee2810425 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:52.678329 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1040/2065] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:30:52 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:30:52.683142 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6721a9-6388-4f1e-a1db-82aee2810425 service neutron] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:52.690504 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bf2201-3203-4a3e-b694-cf51cfcbe6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:52.692115 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf2201-3203-4a3e-b694-cf51cfcbe6c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:52.692594 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf2201-3203-4a3e-b694-cf51cfcbe6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:52.693306 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf2201-3203-4a3e-b694-cf51cfcbe6c3 admin admin] PATH_INFO: `/v3/projects/1c31e718720a4daa90399cac2a126d5a` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:52.694769 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bf2201-3203-4a3e-b694-cf51cfcbe6c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c31e718720a4daa90399cac2a126d5a)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:52.696959 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bf2201-3203-4a3e-b694-cf51cfcbe6c3 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:52.858611 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-82bf2201-3203-4a3e-b694-cf51cfcbe6c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c31e718720a4daa90399cac2a126d5a', 'request_id': 'req-82bf2201-3203-4a3e-b694-cf51cfcbe6c3'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:52.869451 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-82bf2201-3203-4a3e-b694-cf51cfcbe6c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c31e718720a4daa90399cac2a126d5a', 'request_id': 'req-82bf2201-3203-4a3e-b694-cf51cfcbe6c3'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:52.879735 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-82bf2201-3203-4a3e-b694-cf51cfcbe6c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c31e718720a4daa90399cac2a126d5a', 'request_id': 'req-82bf2201-3203-4a3e-b694-cf51cfcbe6c3'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:52.911604 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-82bf2201-3203-4a3e-b694-cf51cfcbe6c3 admin admin] The token cache is being invalidate because project 1c31e718720a4daa90399cac2a126d5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81383) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:30:52.911940 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-82bf2201-3203-4a3e-b694-cf51cfcbe6c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:52.912972 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-82bf2201-3203-4a3e-b694-cf51cfcbe6c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:52.916062 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1026/2066] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:30:52 2022] DELETE /identity/v3/projects/1c31e718720a4daa90399cac2a126d5a => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:30:52.922256 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5606696-c6d5-40f3-a5ff-b242ae27bfdd service cinder] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:52.935723 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5606696-c6d5-40f3-a5ff-b242ae27bfdd service cinder] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:53.082689 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4cb658-1145-4cc1-8914-160eec3a1d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:53.083763 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4cb658-1145-4cc1-8914-160eec3a1d9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:53.084907 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4cb658-1145-4cc1-8914-160eec3a1d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:53.085336 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4cb658-1145-4cc1-8914-160eec3a1d9c admin admin] PATH_INFO: `/v3/users/c795e7a48bbc4d4fa6367e6435e0891d` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:53.086749 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4cb658-1145-4cc1-8914-160eec3a1d9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c795e7a48bbc4d4fa6367e6435e0891d)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:53.089568 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4cb658-1145-4cc1-8914-160eec3a1d9c admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:53.112849 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:53.155231 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-ec4cb658-1145-4cc1-8914-160eec3a1d9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c795e7a48bbc4d4fa6367e6435e0891d'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:53.170638 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-ec4cb658-1145-4cc1-8914-160eec3a1d9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c795e7a48bbc4d4fa6367e6435e0891d'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:53.178300 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-ec4cb658-1145-4cc1-8914-160eec3a1d9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c795e7a48bbc4d4fa6367e6435e0891d'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:53.190082 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-ec4cb658-1145-4cc1-8914-160eec3a1d9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c795e7a48bbc4d4fa6367e6435e0891d'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:53.191125 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-ec4cb658-1145-4cc1-8914-160eec3a1d9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c795e7a48bbc4d4fa6367e6435e0891d'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:53.200804 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1041/2067] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:30:52 2022] DELETE /identity/v3/users/c795e7a48bbc4d4fa6367e6435e0891d => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:30:53.268788 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bf2201-3203-4a3e-b694-cf51cfcbe6c3 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:53.272844 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-82bf2201-3203-4a3e-b694-cf51cfcbe6c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:53.295172 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bf2201-3203-4a3e-b694-cf51cfcbe6c3 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:53.368775 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4cb658-1145-4cc1-8914-160eec3a1d9c admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:53.371375 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-ec4cb658-1145-4cc1-8914-160eec3a1d9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:53.388190 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a669520-9573-4fb0-b557-6e12d0f02dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:53.388820 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a669520-9573-4fb0-b557-6e12d0f02dca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:53.389099 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a669520-9573-4fb0-b557-6e12d0f02dca admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:53.389370 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a669520-9573-4fb0-b557-6e12d0f02dca admin admin] PATH_INFO: `/v3/users/9b84467150524838aa7f609cc95b935c` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:53.390579 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a669520-9573-4fb0-b557-6e12d0f02dca admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b84467150524838aa7f609cc95b935c)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:53.392580 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a669520-9573-4fb0-b557-6e12d0f02dca admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:53.452978 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-8a669520-9573-4fb0-b557-6e12d0f02dca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b84467150524838aa7f609cc95b935c'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:53.458376 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4cb658-1145-4cc1-8914-160eec3a1d9c admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:53.463060 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2a9a14-701f-44bf-a256-209c33ec098e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:53.463721 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a9a14-701f-44bf-a256-209c33ec098e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:53.464473 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a9a14-701f-44bf-a256-209c33ec098e admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:53.464473 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a9a14-701f-44bf-a256-209c33ec098e admin admin] PATH_INFO: `/v3/projects/ef0fe9e49ca1468b899d55427e34c3a3` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:53.465604 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2a9a14-701f-44bf-a256-209c33ec098e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef0fe9e49ca1468b899d55427e34c3a3)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:53.467436 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2a9a14-701f-44bf-a256-209c33ec098e admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:53.470256 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-8a669520-9573-4fb0-b557-6e12d0f02dca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b84467150524838aa7f609cc95b935c'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:53.479786 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-8a669520-9573-4fb0-b557-6e12d0f02dca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b84467150524838aa7f609cc95b935c'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:53.490001 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-8a669520-9573-4fb0-b557-6e12d0f02dca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b84467150524838aa7f609cc95b935c'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:53.490748 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-8a669520-9573-4fb0-b557-6e12d0f02dca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b84467150524838aa7f609cc95b935c'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:53.493860 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:53.500711 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1027/2068] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:30:53 2022] DELETE /identity/v3/users/9b84467150524838aa7f609cc95b935c => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:30:53.506588 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c62423-9314-490a-a316-cb8811a2f19f None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:53.507120 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c62423-9314-490a-a316-cb8811a2f19f None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:53.507846 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c62423-9314-490a-a316-cb8811a2f19f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:53.523606 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-ae2a9a14-701f-44bf-a256-209c33ec098e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef0fe9e49ca1468b899d55427e34c3a3', 'request_id': 'req-ae2a9a14-701f-44bf-a256-209c33ec098e'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:53.530378 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-a8c62423-9314-490a-a316-cb8811a2f19f None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:30:53.530378 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-a8c62423-9314-490a-a316-cb8811a2f19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:53.532880 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-ae2a9a14-701f-44bf-a256-209c33ec098e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef0fe9e49ca1468b899d55427e34c3a3', 'request_id': 'req-ae2a9a14-701f-44bf-a256-209c33ec098e'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:53.543098 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-ae2a9a14-701f-44bf-a256-209c33ec098e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef0fe9e49ca1468b899d55427e34c3a3', 'request_id': 'req-ae2a9a14-701f-44bf-a256-209c33ec098e'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:53.565180 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-ae2a9a14-701f-44bf-a256-209c33ec098e admin admin] The token cache is being invalidate because project ef0fe9e49ca1468b899d55427e34c3a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:30:53.565470 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-ae2a9a14-701f-44bf-a256-209c33ec098e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:53.566385 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-ae2a9a14-701f-44bf-a256-209c33ec098e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:53.571273 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1042/2069] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:30:53 2022] DELETE /identity/v3/projects/ef0fe9e49ca1468b899d55427e34c3a3 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:30:53.573208 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee9553-f296-4ea4-8e26-d1468900ca83 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:53.573492 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee9553-f296-4ea4-8e26-d1468900ca83 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:53.573770 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee9553-f296-4ea4-8e26-d1468900ca83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:53.623753 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-66ee9553-f296-4ea4-8e26-d1468900ca83 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:30:53.625088 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-66ee9553-f296-4ea4-8e26-d1468900ca83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:53.640244 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1028/2070] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:30:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 05:30:53.663436 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c62423-9314-490a-a316-cb8811a2f19f None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:53.665463 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-a8c62423-9314-490a-a316-cb8811a2f19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:53.685640 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:53.780949 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1043/2071] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:30:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:30:53.794750 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ee9553-f296-4ea4-8e26-d1468900ca83 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:53.798996 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-66ee9553-f296-4ea4-8e26-d1468900ca83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:53.819124 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ee9553-f296-4ea4-8e26-d1468900ca83 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:53.824540 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5e0883-29ac-4124-97cf-af1e318121be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:53.825197 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e0883-29ac-4124-97cf-af1e318121be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:53.825473 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e0883-29ac-4124-97cf-af1e318121be admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:53.825741 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e0883-29ac-4124-97cf-af1e318121be admin admin] PATH_INFO: `/v3/projects/3cd9238559514b7fa1c56b0fc0546c30` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:53.826911 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5e0883-29ac-4124-97cf-af1e318121be admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cd9238559514b7fa1c56b0fc0546c30)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:53.828953 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5e0883-29ac-4124-97cf-af1e318121be admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:53.846611 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c62423-9314-490a-a316-cb8811a2f19f None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:53.854522 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cedff1-63ec-4529-9667-ffe62c2e0b59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:53.855431 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cedff1-63ec-4529-9667-ffe62c2e0b59 service neutron] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:53.855738 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cedff1-63ec-4529-9667-ffe62c2e0b59 service neutron] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:53.856014 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cedff1-63ec-4529-9667-ffe62c2e0b59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:53.879591 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cedff1-63ec-4529-9667-ffe62c2e0b59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:53.888682 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cedff1-63ec-4529-9667-ffe62c2e0b59 service neutron] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:53.907451 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1029/2072] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:30:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:30:53.908619 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d63fd-4169-4a69-956d-5ab7bee5f1be None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:53.908903 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d63fd-4169-4a69-956d-5ab7bee5f1be None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:53.909182 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d63fd-4169-4a69-956d-5ab7bee5f1be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:53.921564 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-0d5e0883-29ac-4124-97cf-af1e318121be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cd9238559514b7fa1c56b0fc0546c30', 'request_id': 'req-0d5e0883-29ac-4124-97cf-af1e318121be'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:53.929114 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-0d5e0883-29ac-4124-97cf-af1e318121be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cd9238559514b7fa1c56b0fc0546c30', 'request_id': 'req-0d5e0883-29ac-4124-97cf-af1e318121be'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:53.950177 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-581d63fd-4169-4a69-956d-5ab7bee5f1be None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:30:53.951743 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-581d63fd-4169-4a69-956d-5ab7bee5f1be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:53.962127 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-0d5e0883-29ac-4124-97cf-af1e318121be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cd9238559514b7fa1c56b0fc0546c30', 'request_id': 'req-0d5e0883-29ac-4124-97cf-af1e318121be'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:53.990797 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-0d5e0883-29ac-4124-97cf-af1e318121be admin admin] The token cache is being invalidate because project 3cd9238559514b7fa1c56b0fc0546c30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:30:53.991243 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-0d5e0883-29ac-4124-97cf-af1e318121be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:53.994080 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-0d5e0883-29ac-4124-97cf-af1e318121be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:54.001179 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1044/2073] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:30:53 2022] DELETE /identity/v3/projects/3cd9238559514b7fa1c56b0fc0546c30 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:30:54.004545 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5e0883-29ac-4124-97cf-af1e318121be admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:54.006069 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-0d5e0883-29ac-4124-97cf-af1e318121be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:54.071557 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1030/2074] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:30:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:30:54.076149 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581d63fd-4169-4a69-956d-5ab7bee5f1be None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:54.109922 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581d63fd-4169-4a69-956d-5ab7bee5f1be None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:54.115607 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5e0883-29ac-4124-97cf-af1e318121be admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:54.119213 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60558c9b-ac28-4170-902f-ff2723525801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:54.120338 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60558c9b-ac28-4170-902f-ff2723525801 admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:54.120723 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60558c9b-ac28-4170-902f-ff2723525801 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:54.121068 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60558c9b-ac28-4170-902f-ff2723525801 admin admin] PATH_INFO: `/v3/domains` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:54.122295 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60558c9b-ac28-4170-902f-ff2723525801 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:30:54.122797 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60558c9b-ac28-4170-902f-ff2723525801 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:54.125907 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8c4f97-615f-416b-b362-d41ccc0d4c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:54.126813 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60558c9b-ac28-4170-902f-ff2723525801 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:54.127548 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c4f97-615f-416b-b362-d41ccc0d4c6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:54.128043 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c4f97-615f-416b-b362-d41ccc0d4c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:54.128543 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c4f97-615f-416b-b362-d41ccc0d4c6d admin admin] PATH_INFO: `/v3/users/fe25ac9b819b4ad8b7e32133ea8aeaa1` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:54.130090 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8c4f97-615f-416b-b362-d41ccc0d4c6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe25ac9b819b4ad8b7e32133ea8aeaa1)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:54.132035 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8c4f97-615f-416b-b362-d41ccc0d4c6d admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:54.152826 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1031/2075] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 05:30:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:30:54.159023 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60558c9b-ac28-4170-902f-ff2723525801 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:54.176706 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60558c9b-ac28-4170-902f-ff2723525801 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:54.192362 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f773950-5e58-40c7-8351-423fcf031f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:54.192362 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f773950-5e58-40c7-8351-423fcf031f10 admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:54.192362 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f773950-5e58-40c7-8351-423fcf031f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:54.192362 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f773950-5e58-40c7-8351-423fcf031f10 admin admin] PATH_INFO: `/v3/projects` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:54.192693 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f773950-5e58-40c7-8351-423fcf031f10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:54.192693 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f773950-5e58-40c7-8351-423fcf031f10 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:54.221065 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:54.223384 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-be8c4f97-615f-416b-b362-d41ccc0d4c6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe25ac9b819b4ad8b7e32133ea8aeaa1'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:54.234637 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1032/2076] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:30:54 2022] POST /identity/v3/projects => generated 377 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:30:54.240602 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f773950-5e58-40c7-8351-423fcf031f10 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:54.248979 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-be8c4f97-615f-416b-b362-d41ccc0d4c6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe25ac9b819b4ad8b7e32133ea8aeaa1'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:54.255147 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:54.262568 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-be8c4f97-615f-416b-b362-d41ccc0d4c6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe25ac9b819b4ad8b7e32133ea8aeaa1'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:54.273244 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-be8c4f97-615f-416b-b362-d41ccc0d4c6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe25ac9b819b4ad8b7e32133ea8aeaa1'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:54.274214 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-be8c4f97-615f-416b-b362-d41ccc0d4c6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe25ac9b819b4ad8b7e32133ea8aeaa1'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:54.282883 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1045/2077] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:30:54 2022] DELETE /identity/v3/users/fe25ac9b819b4ad8b7e32133ea8aeaa1 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:30:54.364951 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f773950-5e58-40c7-8351-423fcf031f10 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:54.456679 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a227f5c3-0a4e-4c44-a522-4b156bc79904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:54.457417 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a227f5c3-0a4e-4c44-a522-4b156bc79904 admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:54.457999 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a227f5c3-0a4e-4c44-a522-4b156bc79904 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:54.457999 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a227f5c3-0a4e-4c44-a522-4b156bc79904 admin admin] PATH_INFO: `/v3/users` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:54.458730 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a227f5c3-0a4e-4c44-a522-4b156bc79904 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:54.461541 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a227f5c3-0a4e-4c44-a522-4b156bc79904 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:54.499097 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1033/2078] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:30:54 2022] POST /identity/v3/users => generated 289 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:30:54.504180 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8c4f97-615f-416b-b362-d41ccc0d4c6d admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:54.505810 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-be8c4f97-615f-416b-b362-d41ccc0d4c6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:54.527200 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8c4f97-615f-416b-b362-d41ccc0d4c6d admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:54.537610 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf4490e-b0e5-452e-be51-18aec71e7b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:54.539196 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf4490e-b0e5-452e-be51-18aec71e7b03 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:54.539582 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf4490e-b0e5-452e-be51-18aec71e7b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:54.541023 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf4490e-b0e5-452e-be51-18aec71e7b03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:54.542658 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf4490e-b0e5-452e-be51-18aec71e7b03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:54.545856 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf4490e-b0e5-452e-be51-18aec71e7b03 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:54.562971 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1046/2079] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:30:54 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:30:54.564390 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a227f5c3-0a4e-4c44-a522-4b156bc79904 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:54.582299 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a227f5c3-0a4e-4c44-a522-4b156bc79904 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:54.591753 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e834412f-d2d2-435c-83a1-40b65d454afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:54.592533 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e834412f-d2d2-435c-83a1-40b65d454afa admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:54.592848 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e834412f-d2d2-435c-83a1-40b65d454afa admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:54.593160 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e834412f-d2d2-435c-83a1-40b65d454afa admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:54.593836 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e834412f-d2d2-435c-83a1-40b65d454afa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:54.596588 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e834412f-d2d2-435c-83a1-40b65d454afa admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:54.613390 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1034/2080] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:30:54 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:30:54.615901 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf4490e-b0e5-452e-be51-18aec71e7b03 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:54.635047 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf4490e-b0e5-452e-be51-18aec71e7b03 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:54.643484 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d437700-63db-4b90-bb6b-fa1eb28ebef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:54.645116 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d437700-63db-4b90-bb6b-fa1eb28ebef3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:54.651181 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d437700-63db-4b90-bb6b-fa1eb28ebef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:54.651635 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d437700-63db-4b90-bb6b-fa1eb28ebef3 admin admin] PATH_INFO: `/v3/projects/7f21ab2bdff04d20b9f1851f4d06e6ed/users/124fa68ca43543389207e9beb487c388/roles/aa7ff8e0ec1e48e5811335b9eb38b448` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:54.671869 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e834412f-d2d2-435c-83a1-40b65d454afa admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:54.674253 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-e834412f-d2d2-435c-83a1-40b65d454afa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:54.688872 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e834412f-d2d2-435c-83a1-40b65d454afa admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:54.694163 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec3141b-ed15-4c13-8c77-7c242913623a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:54.694522 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d437700-63db-4b90-bb6b-fa1eb28ebef3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f21ab2bdff04d20b9f1851f4d06e6ed, user_id=124fa68ca43543389207e9beb487c388, role_id=aa7ff8e0ec1e48e5811335b9eb38b448)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:54.694852 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec3141b-ed15-4c13-8c77-7c242913623a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:54.695137 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec3141b-ed15-4c13-8c77-7c242913623a admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:54.695435 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec3141b-ed15-4c13-8c77-7c242913623a admin admin] PATH_INFO: `/v3/projects/e3915a25b4794225859d74add5a7d1cd` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:54.696832 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec3141b-ed15-4c13-8c77-7c242913623a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3915a25b4794225859d74add5a7d1cd)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:54.697285 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d437700-63db-4b90-bb6b-fa1eb28ebef3 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:54.698936 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec3141b-ed15-4c13-8c77-7c242913623a admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:54.721198 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1047/2081] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:30:54 2022] PUT /identity/v3/projects/7f21ab2bdff04d20b9f1851f4d06e6ed/users/124fa68ca43543389207e9beb487c388/roles/aa7ff8e0ec1e48e5811335b9eb38b448 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:30:54.736236 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71c6f3b-447c-461b-9417-687d38c30f0d None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:54.736631 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71c6f3b-447c-461b-9417-687d38c30f0d None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:54.736991 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71c6f3b-447c-461b-9417-687d38c30f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:54.776585 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-6ec3141b-ed15-4c13-8c77-7c242913623a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3915a25b4794225859d74add5a7d1cd', 'request_id': 'req-6ec3141b-ed15-4c13-8c77-7c242913623a'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:54.803298 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-6ec3141b-ed15-4c13-8c77-7c242913623a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3915a25b4794225859d74add5a7d1cd', 'request_id': 'req-6ec3141b-ed15-4c13-8c77-7c242913623a'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:54.807502 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-c71c6f3b-447c-461b-9417-687d38c30f0d None None] MFA Rules not processed for user `124fa68ca43543389207e9beb487c388`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:30:54.808872 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-c71c6f3b-447c-461b-9417-687d38c30f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:54.818685 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-6ec3141b-ed15-4c13-8c77-7c242913623a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3915a25b4794225859d74add5a7d1cd', 'request_id': 'req-6ec3141b-ed15-4c13-8c77-7c242913623a'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:54.851648 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-6ec3141b-ed15-4c13-8c77-7c242913623a admin admin] The token cache is being invalidate because project e3915a25b4794225859d74add5a7d1cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81383) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:30:54.852206 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-6ec3141b-ed15-4c13-8c77-7c242913623a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:54.853166 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-6ec3141b-ed15-4c13-8c77-7c242913623a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:54.865067 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1035/2082] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:30:54 2022] DELETE /identity/v3/projects/e3915a25b4794225859d74add5a7d1cd => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:30:54.866228 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec3141b-ed15-4c13-8c77-7c242913623a admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:54.867882 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-6ec3141b-ed15-4c13-8c77-7c242913623a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:54.907471 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:54.939623 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1048/2083] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:30:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:30:54.942754 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c53e0-ebd0-49db-83c5-8426d37c1c71 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:54.943167 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c53e0-ebd0-49db-83c5-8426d37c1c71 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:54.943765 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c53e0-ebd0-49db-83c5-8426d37c1c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:54.966214 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-518c53e0-ebd0-49db-83c5-8426d37c1c71 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:30:54.976268 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-518c53e0-ebd0-49db-83c5-8426d37c1c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:54.981940 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec3141b-ed15-4c13-8c77-7c242913623a admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:54.987402 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4338876-c853-4b6d-bdc6-7b61d9c7b2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:54.987549 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1049/2084] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:30:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:30:54.988159 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4338876-c853-4b6d-bdc6-7b61d9c7b2da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:54.988509 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4338876-c853-4b6d-bdc6-7b61d9c7b2da admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:54.988615 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518c53e0-ebd0-49db-83c5-8426d37c1c71 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:54.988867 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4338876-c853-4b6d-bdc6-7b61d9c7b2da admin admin] PATH_INFO: `/v3/projects/8cbaa424ebc94a1cbf43f8327215e4af` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:54.990339 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4338876-c853-4b6d-bdc6-7b61d9c7b2da admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cbaa424ebc94a1cbf43f8327215e4af)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:54.990659 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-518c53e0-ebd0-49db-83c5-8426d37c1c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:54.993003 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4338876-c853-4b6d-bdc6-7b61d9c7b2da admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:55.062220 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-f4338876-c853-4b6d-bdc6-7b61d9c7b2da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cbaa424ebc94a1cbf43f8327215e4af', 'request_id': 'req-f4338876-c853-4b6d-bdc6-7b61d9c7b2da'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:55.071856 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-f4338876-c853-4b6d-bdc6-7b61d9c7b2da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cbaa424ebc94a1cbf43f8327215e4af', 'request_id': 'req-f4338876-c853-4b6d-bdc6-7b61d9c7b2da'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:55.077156 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518c53e0-ebd0-49db-83c5-8426d37c1c71 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:55.080061 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-f4338876-c853-4b6d-bdc6-7b61d9c7b2da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cbaa424ebc94a1cbf43f8327215e4af', 'request_id': 'req-f4338876-c853-4b6d-bdc6-7b61d9c7b2da'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:55.092788 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-f4338876-c853-4b6d-bdc6-7b61d9c7b2da admin admin] The token cache is being invalidate because project 8cbaa424ebc94a1cbf43f8327215e4af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81383) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:30:55.093166 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-f4338876-c853-4b6d-bdc6-7b61d9c7b2da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:55.094780 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-f4338876-c853-4b6d-bdc6-7b61d9c7b2da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:55.096741 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1036/2085] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:30:54 2022] DELETE /identity/v3/projects/8cbaa424ebc94a1cbf43f8327215e4af => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:30:55.098229 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b46e14-49eb-4225-b88f-2297f4e0e5dd None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:55.098581 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b46e14-49eb-4225-b88f-2297f4e0e5dd None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:55.098931 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b46e14-49eb-4225-b88f-2297f4e0e5dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:55.126708 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-71b46e14-49eb-4225-b88f-2297f4e0e5dd None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:30:55.128540 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-71b46e14-49eb-4225-b88f-2297f4e0e5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:55.146113 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:55.199897 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8131a45a-c5e9-4e06-9499-f34789d98b74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a147e14b61d481db1cac02c58ac3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:55.200580 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131a45a-c5e9-4e06-9499-f34789d98b74 service cinder] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:55.200844 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131a45a-c5e9-4e06-9499-f34789d98b74 service cinder] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:55.201054 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131a45a-c5e9-4e06-9499-f34789d98b74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:55.202969 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-8131a45a-c5e9-4e06-9499-f34789d98b74 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:55.260253 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1037/2086] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:30:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:30:55.261262 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b46e14-49eb-4225-b88f-2297f4e0e5dd None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:55.268362 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-71b46e14-49eb-4225-b88f-2297f4e0e5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:55.295295 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b46e14-49eb-4225-b88f-2297f4e0e5dd None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:55.304314 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8131a45a-c5e9-4e06-9499-f34789d98b74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:55.306217 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8131a45a-c5e9-4e06-9499-f34789d98b74 service cinder] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:55.306608 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a5c4e9-35d0-4ebc-86ac-3e0bbaa64433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:55.307310 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5c4e9-35d0-4ebc-86ac-3e0bbaa64433 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:55.307596 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5c4e9-35d0-4ebc-86ac-3e0bbaa64433 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:55.307899 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5c4e9-35d0-4ebc-86ac-3e0bbaa64433 admin admin] PATH_INFO: `/v3/users/deea1b9c12c74b20a8e90131167b31ad` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:55.309357 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a5c4e9-35d0-4ebc-86ac-3e0bbaa64433 admin admin] RBAC: Authorizing `identity:delete_user(user_id=deea1b9c12c74b20a8e90131167b31ad)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:55.312938 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a5c4e9-35d0-4ebc-86ac-3e0bbaa64433 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:55.318739 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1050/2087] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:30:54 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:30:55.320159 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8131a45a-c5e9-4e06-9499-f34789d98b74 service cinder] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:55.337396 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8131a45a-c5e9-4e06-9499-f34789d98b74 service cinder] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:55.345270 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fe7738-c56c-4e4a-bb37-b0686f873490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:55.346499 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe7738-c56c-4e4a-bb37-b0686f873490 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:55.346782 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe7738-c56c-4e4a-bb37-b0686f873490 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:55.347182 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe7738-c56c-4e4a-bb37-b0686f873490 admin admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:55.347880 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fe7738-c56c-4e4a-bb37-b0686f873490 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:30:55.349006 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fe7738-c56c-4e4a-bb37-b0686f873490 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:55.352107 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fe7738-c56c-4e4a-bb37-b0686f873490 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:55.373834 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1051/2088] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 05:30:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:30:55.378481 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fe7738-c56c-4e4a-bb37-b0686f873490 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:55.396350 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fe7738-c56c-4e4a-bb37-b0686f873490 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:55.409581 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e0ed72-ccce-4320-9319-2554493ea444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:55.410383 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e0ed72-ccce-4320-9319-2554493ea444 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:55.411592 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e0ed72-ccce-4320-9319-2554493ea444 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:55.412071 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e0ed72-ccce-4320-9319-2554493ea444 admin admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:55.413374 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e0ed72-ccce-4320-9319-2554493ea444 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:55.416797 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e0ed72-ccce-4320-9319-2554493ea444 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:55.457788 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:55.465151 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-15a5c4e9-35d0-4ebc-86ac-3e0bbaa64433 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'deea1b9c12c74b20a8e90131167b31ad'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:55.487623 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-15a5c4e9-35d0-4ebc-86ac-3e0bbaa64433 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'deea1b9c12c74b20a8e90131167b31ad'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:55.497291 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1052/2089] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:30:55 2022] POST /identity/v3/projects => generated 371 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 05:30:55.499008 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-15a5c4e9-35d0-4ebc-86ac-3e0bbaa64433 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'deea1b9c12c74b20a8e90131167b31ad'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:55.501568 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e0ed72-ccce-4320-9319-2554493ea444 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:55.513753 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-15a5c4e9-35d0-4ebc-86ac-3e0bbaa64433 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'deea1b9c12c74b20a8e90131167b31ad'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:55.514873 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-15a5c4e9-35d0-4ebc-86ac-3e0bbaa64433 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'deea1b9c12c74b20a8e90131167b31ad'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:55.527545 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1038/2090] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:30:55 2022] DELETE /identity/v3/users/deea1b9c12c74b20a8e90131167b31ad => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:30:55.629315 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e0ed72-ccce-4320-9319-2554493ea444 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:55.699047 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:55.722973 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3fd5d5-17b1-42b3-8e63-d13773e7f06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:55.724167 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3fd5d5-17b1-42b3-8e63-d13773e7f06b admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:55.724474 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a5c4e9-35d0-4ebc-86ac-3e0bbaa64433 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:55.724632 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3fd5d5-17b1-42b3-8e63-d13773e7f06b admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:55.725409 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3fd5d5-17b1-42b3-8e63-d13773e7f06b admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:55.725927 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-15a5c4e9-35d0-4ebc-86ac-3e0bbaa64433 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:55.726390 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3fd5d5-17b1-42b3-8e63-d13773e7f06b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:55.730234 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3fd5d5-17b1-42b3-8e63-d13773e7f06b admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:55.752344 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a5c4e9-35d0-4ebc-86ac-3e0bbaa64433 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:55.778929 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee3036b-813e-40b0-a349-4440e802bc63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:55.779829 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee3036b-813e-40b0-a349-4440e802bc63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:55.780109 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee3036b-813e-40b0-a349-4440e802bc63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:55.780379 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee3036b-813e-40b0-a349-4440e802bc63 admin admin] PATH_INFO: `/v3/users/87ebd7f813984d42aa137de7e1090757` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:55.782930 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee3036b-813e-40b0-a349-4440e802bc63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87ebd7f813984d42aa137de7e1090757)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:55.789671 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee3036b-813e-40b0-a349-4440e802bc63 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:55.789852 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1053/2091] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:30:55 2022] POST /identity/v3/users => generated 286 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:30:55.793089 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3fd5d5-17b1-42b3-8e63-d13773e7f06b admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:55.796521 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-3d3fd5d5-17b1-42b3-8e63-d13773e7f06b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:55.811328 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3fd5d5-17b1-42b3-8e63-d13773e7f06b admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:55.818339 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331bfee7-4491-4b59-9cfe-2c5ece65a692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:55.819001 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331bfee7-4491-4b59-9cfe-2c5ece65a692 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:55.819289 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331bfee7-4491-4b59-9cfe-2c5ece65a692 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:55.819622 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331bfee7-4491-4b59-9cfe-2c5ece65a692 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:55.820330 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331bfee7-4491-4b59-9cfe-2c5ece65a692 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:55.823980 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331bfee7-4491-4b59-9cfe-2c5ece65a692 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:55.835530 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1054/2092] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:30:55 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:30:55.840713 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331bfee7-4491-4b59-9cfe-2c5ece65a692 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:55.855424 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331bfee7-4491-4b59-9cfe-2c5ece65a692 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:55.861068 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70745ba9-0ab3-4f2f-9c19-50d69725e375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:55.861842 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70745ba9-0ab3-4f2f-9c19-50d69725e375 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:55.862130 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70745ba9-0ab3-4f2f-9c19-50d69725e375 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:55.862478 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-8ee3036b-813e-40b0-a349-4440e802bc63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87ebd7f813984d42aa137de7e1090757'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:55.862605 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70745ba9-0ab3-4f2f-9c19-50d69725e375 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:55.863183 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70745ba9-0ab3-4f2f-9c19-50d69725e375 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:55.865713 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70745ba9-0ab3-4f2f-9c19-50d69725e375 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:55.876582 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1055/2093] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:30:55 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 05:30:55.877565 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-8ee3036b-813e-40b0-a349-4440e802bc63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87ebd7f813984d42aa137de7e1090757'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:55.880892 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70745ba9-0ab3-4f2f-9c19-50d69725e375 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:55.885573 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-8ee3036b-813e-40b0-a349-4440e802bc63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87ebd7f813984d42aa137de7e1090757'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:55.891570 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70745ba9-0ab3-4f2f-9c19-50d69725e375 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:55.895408 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-8ee3036b-813e-40b0-a349-4440e802bc63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87ebd7f813984d42aa137de7e1090757'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:55.896393 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-8ee3036b-813e-40b0-a349-4440e802bc63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87ebd7f813984d42aa137de7e1090757'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:55.897076 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e75171-e6b0-4a72-8458-5a7f1cffa50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:55.899382 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e75171-e6b0-4a72-8458-5a7f1cffa50e admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:55.899506 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e75171-e6b0-4a72-8458-5a7f1cffa50e admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:55.899831 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e75171-e6b0-4a72-8458-5a7f1cffa50e admin admin] PATH_INFO: `/v3/projects/e0e61f834d344323a977845b34e33c5c/users/da72fe720a584bba9dc2dafacdeac67d/roles/aa7ff8e0ec1e48e5811335b9eb38b448` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:55.906072 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1039/2094] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:30:55 2022] DELETE /identity/v3/users/87ebd7f813984d42aa137de7e1090757 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 05:30:55.916346 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e75171-e6b0-4a72-8458-5a7f1cffa50e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0e61f834d344323a977845b34e33c5c, user_id=da72fe720a584bba9dc2dafacdeac67d, role_id=aa7ff8e0ec1e48e5811335b9eb38b448)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:55.918789 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e75171-e6b0-4a72-8458-5a7f1cffa50e admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:55.936155 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1056/2095] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:30:55 2022] PUT /identity/v3/projects/e0e61f834d344323a977845b34e33c5c/users/da72fe720a584bba9dc2dafacdeac67d/roles/aa7ff8e0ec1e48e5811335b9eb38b448 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 05:30:55.941664 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af5725d-2d45-4d2e-9067-17cbb0feea68 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:55.941955 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af5725d-2d45-4d2e-9067-17cbb0feea68 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:55.942256 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af5725d-2d45-4d2e-9067-17cbb0feea68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:55.967636 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-0af5725d-2d45-4d2e-9067-17cbb0feea68 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:30:55.968926 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-0af5725d-2d45-4d2e-9067-17cbb0feea68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:55.997062 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e75171-e6b0-4a72-8458-5a7f1cffa50e admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:55.999325 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-c9e75171-e6b0-4a72-8458-5a7f1cffa50e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:56.041762 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1040/2096] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:30:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 05:30:56.051206 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af5725d-2d45-4d2e-9067-17cbb0feea68 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:56.053147 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-0af5725d-2d45-4d2e-9067-17cbb0feea68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:56.086926 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e75171-e6b0-4a72-8458-5a7f1cffa50e admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:56.092539 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79499419-5c93-47c3-a3a1-55fd5d7ab7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:56.093327 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79499419-5c93-47c3-a3a1-55fd5d7ab7c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:56.093717 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79499419-5c93-47c3-a3a1-55fd5d7ab7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:56.094085 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79499419-5c93-47c3-a3a1-55fd5d7ab7c0 admin admin] PATH_INFO: `/v3/projects/eac3dfef631e4e7fa68496a52af3b1e6` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:56.095330 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79499419-5c93-47c3-a3a1-55fd5d7ab7c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eac3dfef631e4e7fa68496a52af3b1e6)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:56.098085 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79499419-5c93-47c3-a3a1-55fd5d7ab7c0 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:56.098466 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:56.129316 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af5725d-2d45-4d2e-9067-17cbb0feea68 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:56.133230 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3600cb-8b07-4a8d-bf0d-53702e801e52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:56.133967 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3600cb-8b07-4a8d-bf0d-53702e801e52 service neutron] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:56.134248 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3600cb-8b07-4a8d-bf0d-53702e801e52 service neutron] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:56.134523 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3600cb-8b07-4a8d-bf0d-53702e801e52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:56.144997 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3600cb-8b07-4a8d-bf0d-53702e801e52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:56.146458 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3600cb-8b07-4a8d-bf0d-53702e801e52 service neutron] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:56.157393 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1041/2097] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:30:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 05:30:56.158242 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3600cb-8b07-4a8d-bf0d-53702e801e52 service neutron] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:56.159523 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-9f3600cb-8b07-4a8d-bf0d-53702e801e52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:56.162892 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-79499419-5c93-47c3-a3a1-55fd5d7ab7c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eac3dfef631e4e7fa68496a52af3b1e6', 'request_id': 'req-79499419-5c93-47c3-a3a1-55fd5d7ab7c0'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:56.169797 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-79499419-5c93-47c3-a3a1-55fd5d7ab7c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eac3dfef631e4e7fa68496a52af3b1e6', 'request_id': 'req-79499419-5c93-47c3-a3a1-55fd5d7ab7c0'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:56.173113 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3600cb-8b07-4a8d-bf0d-53702e801e52 service neutron] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:56.175818 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-79499419-5c93-47c3-a3a1-55fd5d7ab7c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eac3dfef631e4e7fa68496a52af3b1e6', 'request_id': 'req-79499419-5c93-47c3-a3a1-55fd5d7ab7c0'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:56.192266 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-79499419-5c93-47c3-a3a1-55fd5d7ab7c0 admin admin] The token cache is being invalidate because project eac3dfef631e4e7fa68496a52af3b1e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:30:56.192764 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-79499419-5c93-47c3-a3a1-55fd5d7ab7c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:56.193552 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-79499419-5c93-47c3-a3a1-55fd5d7ab7c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:56.195594 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1057/2098] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:30:55 2022] DELETE /identity/v3/projects/eac3dfef631e4e7fa68496a52af3b1e6 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 05:30:56.200500 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba43de3-bd2f-4f8d-a101-f5fcb4977198 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:56.200850 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba43de3-bd2f-4f8d-a101-f5fcb4977198 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:56.201251 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba43de3-bd2f-4f8d-a101-f5fcb4977198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:56.222575 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-aba43de3-bd2f-4f8d-a101-f5fcb4977198 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:30:56.224001 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-aba43de3-bd2f-4f8d-a101-f5fcb4977198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:56.242245 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d2a18c-808a-42b7-8c31-12fa81ab9c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:56.243007 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d2a18c-808a-42b7-8c31-12fa81ab9c54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:56.243406 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d2a18c-808a-42b7-8c31-12fa81ab9c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:56.243784 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d2a18c-808a-42b7-8c31-12fa81ab9c54 admin admin] PATH_INFO: `/v3/projects/c4c8044eca3e4e6485c510ba8e3126de` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:56.245206 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d2a18c-808a-42b7-8c31-12fa81ab9c54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4c8044eca3e4e6485c510ba8e3126de)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:56.247213 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d2a18c-808a-42b7-8c31-12fa81ab9c54 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:56.250319 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:56.298021 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1058/2099] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:30:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:30:56.305507 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a792993-2963-4570-88c1-c5fc4ef4f427 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:56.306118 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a792993-2963-4570-88c1-c5fc4ef4f427 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:56.306118 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a792993-2963-4570-88c1-c5fc4ef4f427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:56.311447 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-56d2a18c-808a-42b7-8c31-12fa81ab9c54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4c8044eca3e4e6485c510ba8e3126de', 'request_id': 'req-56d2a18c-808a-42b7-8c31-12fa81ab9c54'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:56.323787 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-56d2a18c-808a-42b7-8c31-12fa81ab9c54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4c8044eca3e4e6485c510ba8e3126de', 'request_id': 'req-56d2a18c-808a-42b7-8c31-12fa81ab9c54'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:56.328603 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-1a792993-2963-4570-88c1-c5fc4ef4f427 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:30:56.329825 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-1a792993-2963-4570-88c1-c5fc4ef4f427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:56.330802 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-56d2a18c-808a-42b7-8c31-12fa81ab9c54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4c8044eca3e4e6485c510ba8e3126de', 'request_id': 'req-56d2a18c-808a-42b7-8c31-12fa81ab9c54'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:56.345703 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-56d2a18c-808a-42b7-8c31-12fa81ab9c54 admin admin] The token cache is being invalidate because project c4c8044eca3e4e6485c510ba8e3126de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81383) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:30:56.346075 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-56d2a18c-808a-42b7-8c31-12fa81ab9c54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:56.346827 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-56d2a18c-808a-42b7-8c31-12fa81ab9c54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:56.348768 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1042/2100] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:30:56 2022] DELETE /identity/v3/projects/c4c8044eca3e4e6485c510ba8e3126de => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:30:56.354122 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74889f6f-4d82-4593-ad39-15dd1268a0ea None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:56.354413 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74889f6f-4d82-4593-ad39-15dd1268a0ea None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:56.354695 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74889f6f-4d82-4593-ad39-15dd1268a0ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:56.377923 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-74889f6f-4d82-4593-ad39-15dd1268a0ea None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:30:56.379336 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-74889f6f-4d82-4593-ad39-15dd1268a0ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:56.409917 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1059/2101] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:30:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 05:30:56.413902 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a792993-2963-4570-88c1-c5fc4ef4f427 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:56.423609 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a792993-2963-4570-88c1-c5fc4ef4f427 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:56.429033 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea588eb3-f0cc-4ef2-a9ff-ad75e03ab163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:56.429781 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea588eb3-f0cc-4ef2-a9ff-ad75e03ab163 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:56.430124 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea588eb3-f0cc-4ef2-a9ff-ad75e03ab163 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:56.430478 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea588eb3-f0cc-4ef2-a9ff-ad75e03ab163 admin admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:56.431132 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea588eb3-f0cc-4ef2-a9ff-ad75e03ab163 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:30:56.431434 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea588eb3-f0cc-4ef2-a9ff-ad75e03ab163 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:56.433806 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea588eb3-f0cc-4ef2-a9ff-ad75e03ab163 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:56.451978 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1060/2102] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 05:30:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:30:56.453395 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea588eb3-f0cc-4ef2-a9ff-ad75e03ab163 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:56.457345 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1043/2103] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:30:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:30:56.464933 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c59562-4ade-4b66-8a72-de19992751c4 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:56.465548 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c59562-4ade-4b66-8a72-de19992751c4 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:56.465548 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c59562-4ade-4b66-8a72-de19992751c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:56.466549 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea588eb3-f0cc-4ef2-a9ff-ad75e03ab163 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:56.471927 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9612e919-4235-4d99-b06f-578cff025187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:56.472537 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9612e919-4235-4d99-b06f-578cff025187 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:56.472823 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9612e919-4235-4d99-b06f-578cff025187 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:56.473202 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9612e919-4235-4d99-b06f-578cff025187 admin admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:56.473838 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9612e919-4235-4d99-b06f-578cff025187 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:56.475825 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9612e919-4235-4d99-b06f-578cff025187 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:56.500124 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:56.505825 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-f3c59562-4ade-4b66-8a72-de19992751c4 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:30:56.507363 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-f3c59562-4ade-4b66-8a72-de19992751c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:56.519375 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1044/2104] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:30:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 05:30:56.523504 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c59562-4ade-4b66-8a72-de19992751c4 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:56.531723 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1061/2105] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:30:56 2022] POST /identity/v3/projects => generated 363 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:30:56.545088 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9612e919-4235-4d99-b06f-578cff025187 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:56.546047 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c59562-4ade-4b66-8a72-de19992751c4 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:56.651545 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9612e919-4235-4d99-b06f-578cff025187 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:56.657981 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4d328e-90db-485a-a3db-b8f743a6374a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:56.659176 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d328e-90db-485a-a3db-b8f743a6374a admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:56.659561 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d328e-90db-485a-a3db-b8f743a6374a admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:56.659973 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d328e-90db-485a-a3db-b8f743a6374a admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:56.660770 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4d328e-90db-485a-a3db-b8f743a6374a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:56.664200 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4d328e-90db-485a-a3db-b8f743a6374a admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:56.668479 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8268429f-f8a2-4e8e-8a49-1ffc90580138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:56.684037 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268429f-f8a2-4e8e-8a49-1ffc90580138 admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:56.684644 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268429f-f8a2-4e8e-8a49-1ffc90580138 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:56.684796 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268429f-f8a2-4e8e-8a49-1ffc90580138 admin admin] PATH_INFO: `/v3/domains` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:56.685984 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8268429f-f8a2-4e8e-8a49-1ffc90580138 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:30:56.686167 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8268429f-f8a2-4e8e-8a49-1ffc90580138 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:56.688091 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8268429f-f8a2-4e8e-8a49-1ffc90580138 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:56.697019 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1062/2106] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:30:56 2022] POST /identity/v3/users => generated 282 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:30:56.700949 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4d328e-90db-485a-a3db-b8f743a6374a admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:56.717767 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1045/2107] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 05:30:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:30:56.718974 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8268429f-f8a2-4e8e-8a49-1ffc90580138 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:56.719576 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4d328e-90db-485a-a3db-b8f743a6374a admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:56.726914 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e25d337-f696-4253-afab-35c1e396a625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:56.728016 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e25d337-f696-4253-afab-35c1e396a625 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:56.728508 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e25d337-f696-4253-afab-35c1e396a625 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:56.729502 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e25d337-f696-4253-afab-35c1e396a625 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:56.731233 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e25d337-f696-4253-afab-35c1e396a625 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:56.733504 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e25d337-f696-4253-afab-35c1e396a625 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:56.736554 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8268429f-f8a2-4e8e-8a49-1ffc90580138 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:56.746419 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f663cc-9a60-4d81-9eec-94e9d4404700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:56.747068 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f663cc-9a60-4d81-9eec-94e9d4404700 admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:56.747738 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1063/2108] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:30:56 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:30:56.751021 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f663cc-9a60-4d81-9eec-94e9d4404700 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:56.751270 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f663cc-9a60-4d81-9eec-94e9d4404700 admin admin] PATH_INFO: `/v3/projects` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:56.752458 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f663cc-9a60-4d81-9eec-94e9d4404700 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:56.754468 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f663cc-9a60-4d81-9eec-94e9d4404700 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:56.760543 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e25d337-f696-4253-afab-35c1e396a625 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:56.773879 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e25d337-f696-4253-afab-35c1e396a625 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:56.784417 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e48ac30-d240-4e74-a490-514bd0ce4d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:56.785088 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e48ac30-d240-4e74-a490-514bd0ce4d57 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:56.785366 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e48ac30-d240-4e74-a490-514bd0ce4d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:56.785639 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e48ac30-d240-4e74-a490-514bd0ce4d57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:56.786526 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e48ac30-d240-4e74-a490-514bd0ce4d57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:56.789016 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e48ac30-d240-4e74-a490-514bd0ce4d57 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:56.807635 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:56.827840 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1064/2109] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:30:56 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:30:56.829144 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e48ac30-d240-4e74-a490-514bd0ce4d57 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:56.843476 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e48ac30-d240-4e74-a490-514bd0ce4d57 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:56.849079 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1046/2110] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:30:56 2022] POST /identity/v3/projects => generated 365 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:30:56.850217 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f663cc-9a60-4d81-9eec-94e9d4404700 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:56.957947 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f663cc-9a60-4d81-9eec-94e9d4404700 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:56.963446 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77d9340-0cb4-43e1-b448-8fc5820b97c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:56.964021 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2bce9e-064d-4267-8bfc-c40e8ca574a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:56.964413 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d9340-0cb4-43e1-b448-8fc5820b97c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:56.964857 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d9340-0cb4-43e1-b448-8fc5820b97c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:56.964953 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2bce9e-064d-4267-8bfc-c40e8ca574a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:56.965359 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2bce9e-064d-4267-8bfc-c40e8ca574a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:56.965471 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d9340-0cb4-43e1-b448-8fc5820b97c9 admin admin] PATH_INFO: `/v3/projects/fbb7712b94ab4298a2dfc65c722b0f2d/users/38fdeec7615b471cab400ba119e490eb/roles/aa7ff8e0ec1e48e5811335b9eb38b448` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:56.965879 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2bce9e-064d-4267-8bfc-c40e8ca574a3 admin admin] PATH_INFO: `/v3/users` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:56.966535 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2bce9e-064d-4267-8bfc-c40e8ca574a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:56.968581 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2bce9e-064d-4267-8bfc-c40e8ca574a3 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:56.987019 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77d9340-0cb4-43e1-b448-8fc5820b97c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbb7712b94ab4298a2dfc65c722b0f2d, user_id=38fdeec7615b471cab400ba119e490eb, role_id=aa7ff8e0ec1e48e5811335b9eb38b448)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:56.992003 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77d9340-0cb4-43e1-b448-8fc5820b97c9 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:56.999162 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1047/2111] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:30:56 2022] POST /identity/v3/users => generated 283 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:30:57.003800 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2bce9e-064d-4267-8bfc-c40e8ca574a3 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:57.014925 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1065/2112] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:30:56 2022] PUT /identity/v3/projects/fbb7712b94ab4298a2dfc65c722b0f2d/users/38fdeec7615b471cab400ba119e490eb/roles/aa7ff8e0ec1e48e5811335b9eb38b448 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:30:57.030385 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf28e64-630c-4b53-9cce-16f21d1eb0ab None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:57.030733 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf28e64-630c-4b53-9cce-16f21d1eb0ab None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:57.031009 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf28e64-630c-4b53-9cce-16f21d1eb0ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:57.031498 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2bce9e-064d-4267-8bfc-c40e8ca574a3 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:57.065337 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-fcf28e64-630c-4b53-9cce-16f21d1eb0ab None None] MFA Rules not processed for user `38fdeec7615b471cab400ba119e490eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:30:57.067730 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-fcf28e64-630c-4b53-9cce-16f21d1eb0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:57.113907 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2aaf5c-1ea1-498a-94bb-65cd955fc0d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:57.114914 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2aaf5c-1ea1-498a-94bb-65cd955fc0d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:57.115198 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2aaf5c-1ea1-498a-94bb-65cd955fc0d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:57.115471 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2aaf5c-1ea1-498a-94bb-65cd955fc0d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:57.116878 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2aaf5c-1ea1-498a-94bb-65cd955fc0d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:57.118796 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2aaf5c-1ea1-498a-94bb-65cd955fc0d8 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:57.121862 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:57.137375 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1048/2113] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:30:57 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:30:57.139093 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fc0dfa-d2e6-470a-a86f-ea25bcd93ad9 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:57.139352 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fc0dfa-d2e6-470a-a86f-ea25bcd93ad9 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:57.139710 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fc0dfa-d2e6-470a-a86f-ea25bcd93ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:57.158277 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1066/2114] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:30:57 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 05:30:57.159245 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf28e64-630c-4b53-9cce-16f21d1eb0ab None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:57.171494 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf28e64-630c-4b53-9cce-16f21d1eb0ab None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:57.178017 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8244e5-1e88-4510-a29f-4c449becbb35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:57.178786 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8244e5-1e88-4510-a29f-4c449becbb35 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:57.179070 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8244e5-1e88-4510-a29f-4c449becbb35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:57.179348 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8244e5-1e88-4510-a29f-4c449becbb35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:57.180061 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8244e5-1e88-4510-a29f-4c449becbb35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:57.181764 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8244e5-1e88-4510-a29f-4c449becbb35 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:57.198180 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1067/2115] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:30:57 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:30:57.199602 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8244e5-1e88-4510-a29f-4c449becbb35 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:57.202382 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-fe8244e5-1e88-4510-a29f-4c449becbb35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:57.204800 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-37fc0dfa-d2e6-470a-a86f-ea25bcd93ad9 None None] MFA Rules not processed for user `da72fe720a584bba9dc2dafacdeac67d`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:30:57.206011 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-37fc0dfa-d2e6-470a-a86f-ea25bcd93ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:57.278749 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8244e5-1e88-4510-a29f-4c449becbb35 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:57.282058 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1049/2116] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:30:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:30:57.283444 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fc0dfa-d2e6-470a-a86f-ea25bcd93ad9 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:57.286895 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c14652-c848-472d-80bc-48413cb2c8b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a147e14b61d481db1cac02c58ac3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:57.287515 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c14652-c848-472d-80bc-48413cb2c8b7 service cinder] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:57.287799 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c14652-c848-472d-80bc-48413cb2c8b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:57.288080 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c14652-c848-472d-80bc-48413cb2c8b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:57.298903 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c14652-c848-472d-80bc-48413cb2c8b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:57.300493 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c14652-c848-472d-80bc-48413cb2c8b7 service cinder] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:57.301642 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fc0dfa-d2e6-470a-a86f-ea25bcd93ad9 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:57.307151 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405bc54b-42ed-4ad6-a8e5-7294021e6fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:57.307928 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405bc54b-42ed-4ad6-a8e5-7294021e6fcc admin admin] REQUEST_METHOD: `PUT` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:57.308210 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405bc54b-42ed-4ad6-a8e5-7294021e6fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:57.308555 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405bc54b-42ed-4ad6-a8e5-7294021e6fcc admin admin] PATH_INFO: `/v3/projects/e3c157f6721345469b9a0356b9e7c548/users/7fa298cbabe4484ea242a4e1bb5c5a17/roles/aa7ff8e0ec1e48e5811335b9eb38b448` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:57.311946 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1068/2117] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:30:57 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:30:57.312691 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c14652-c848-472d-80bc-48413cb2c8b7 service cinder] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:57.314079 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-f4c14652-c848-472d-80bc-48413cb2c8b7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:57.323052 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:57.326682 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c14652-c848-472d-80bc-48413cb2c8b7 service cinder] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:57.328300 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405bc54b-42ed-4ad6-a8e5-7294021e6fcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3c157f6721345469b9a0356b9e7c548, user_id=7fa298cbabe4484ea242a4e1bb5c5a17, role_id=aa7ff8e0ec1e48e5811335b9eb38b448)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:57.331149 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405bc54b-42ed-4ad6-a8e5-7294021e6fcc admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:57.331907 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2594286b-b9cb-42bb-945d-60a8368e1855 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a147e14b61d481db1cac02c58ac3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:57.332583 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2594286b-b9cb-42bb-945d-60a8368e1855 service cinder] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:57.333789 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2594286b-b9cb-42bb-945d-60a8368e1855 service cinder] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:57.335248 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2594286b-b9cb-42bb-945d-60a8368e1855 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:57.345803 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2594286b-b9cb-42bb-945d-60a8368e1855 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:57.347716 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2594286b-b9cb-42bb-945d-60a8368e1855 service cinder] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:57.348135 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1050/2118] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:30:57 2022] PUT /identity/v3/projects/e3c157f6721345469b9a0356b9e7c548/users/7fa298cbabe4484ea242a4e1bb5c5a17/roles/aa7ff8e0ec1e48e5811335b9eb38b448 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:30:57.359381 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9845ad3d-2d4d-4248-bf7e-e22b2a46fe1f None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:57.359673 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9845ad3d-2d4d-4248-bf7e-e22b2a46fe1f None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:57.359978 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9845ad3d-2d4d-4248-bf7e-e22b2a46fe1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:57.360466 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1069/2119] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:30:57 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:30:57.393618 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-9845ad3d-2d4d-4248-bf7e-e22b2a46fe1f None None] MFA Rules not processed for user `7fa298cbabe4484ea242a4e1bb5c5a17`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:30:57.394868 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-9845ad3d-2d4d-4248-bf7e-e22b2a46fe1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:57.473992 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1051/2120] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:30:57 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:30:57.601889 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2594286b-b9cb-42bb-945d-60a8368e1855 service cinder] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:57.614689 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2594286b-b9cb-42bb-945d-60a8368e1855 service cinder] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:57.667147 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b82e4f6-bb2b-497b-b3ab-2ceae8f1a89d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a147e14b61d481db1cac02c58ac3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:57.667994 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b82e4f6-bb2b-497b-b3ab-2ceae8f1a89d service cinder] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:57.668106 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b82e4f6-bb2b-497b-b3ab-2ceae8f1a89d service cinder] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:57.668332 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b82e4f6-bb2b-497b-b3ab-2ceae8f1a89d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:57.678350 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b82e4f6-bb2b-497b-b3ab-2ceae8f1a89d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:57.680968 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b82e4f6-bb2b-497b-b3ab-2ceae8f1a89d service cinder] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:57.691430 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1070/2121] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:30:57 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:30:57.771971 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9845ad3d-2d4d-4248-bf7e-e22b2a46fe1f None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:57.773630 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-9845ad3d-2d4d-4248-bf7e-e22b2a46fe1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:57.839362 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:57.856921 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9845ad3d-2d4d-4248-bf7e-e22b2a46fe1f None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:57.862367 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426486c3-e5c6-4700-8f43-e0b70037735d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:57.863026 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426486c3-e5c6-4700-8f43-e0b70037735d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:57.863300 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426486c3-e5c6-4700-8f43-e0b70037735d admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:57.863569 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426486c3-e5c6-4700-8f43-e0b70037735d admin admin] PATH_INFO: `/v3/users/351c2bec2de54748abf5c0f1098f48d2` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:57.864983 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426486c3-e5c6-4700-8f43-e0b70037735d admin admin] RBAC: Authorizing `identity:delete_user(user_id=351c2bec2de54748abf5c0f1098f48d2)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:57.866897 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426486c3-e5c6-4700-8f43-e0b70037735d admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:57.921132 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-426486c3-e5c6-4700-8f43-e0b70037735d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '351c2bec2de54748abf5c0f1098f48d2'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:57.936812 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-426486c3-e5c6-4700-8f43-e0b70037735d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '351c2bec2de54748abf5c0f1098f48d2'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:57.945530 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-426486c3-e5c6-4700-8f43-e0b70037735d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '351c2bec2de54748abf5c0f1098f48d2'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:57.954670 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-426486c3-e5c6-4700-8f43-e0b70037735d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '351c2bec2de54748abf5c0f1098f48d2'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:57.955322 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-426486c3-e5c6-4700-8f43-e0b70037735d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '351c2bec2de54748abf5c0f1098f48d2'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:57.963727 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1052/2122] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:30:57 2022] DELETE /identity/v3/users/351c2bec2de54748abf5c0f1098f48d2 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:30:57.967247 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a580a1c9-361c-40fa-8f9d-074431c8a93c None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:57.967603 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a580a1c9-361c-40fa-8f9d-074431c8a93c None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:57.968000 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a580a1c9-361c-40fa-8f9d-074431c8a93c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:57.995952 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-a580a1c9-361c-40fa-8f9d-074431c8a93c None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:30:57.997617 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-a580a1c9-361c-40fa-8f9d-074431c8a93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:58.085121 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1071/2123] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:30:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:30:58.095427 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426486c3-e5c6-4700-8f43-e0b70037735d admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:58.097153 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-426486c3-e5c6-4700-8f43-e0b70037735d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:58.163726 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426486c3-e5c6-4700-8f43-e0b70037735d admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:58.168105 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61299b61-0ac6-4f4f-a3a9-91acf763286b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:58.168707 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61299b61-0ac6-4f4f-a3a9-91acf763286b service neutron] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:58.168985 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61299b61-0ac6-4f4f-a3a9-91acf763286b service neutron] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:58.169256 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61299b61-0ac6-4f4f-a3a9-91acf763286b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:58.178537 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61299b61-0ac6-4f4f-a3a9-91acf763286b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:58.179998 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61299b61-0ac6-4f4f-a3a9-91acf763286b service neutron] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:58.190598 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1053/2124] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:30:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:30:58.479734 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a580a1c9-361c-40fa-8f9d-074431c8a93c None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:58.481303 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-a580a1c9-361c-40fa-8f9d-074431c8a93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:58.495097 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a580a1c9-361c-40fa-8f9d-074431c8a93c None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:58.500557 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b93267-60e9-47e4-a94e-b06a57acf996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:58.501381 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b93267-60e9-47e4-a94e-b06a57acf996 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:58.501713 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b93267-60e9-47e4-a94e-b06a57acf996 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:58.501971 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b93267-60e9-47e4-a94e-b06a57acf996 admin admin] PATH_INFO: `/v3/projects/1db9595200344ed39a8b7a112150b7e7` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:58.503251 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b93267-60e9-47e4-a94e-b06a57acf996 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1db9595200344ed39a8b7a112150b7e7)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:58.505290 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b93267-60e9-47e4-a94e-b06a57acf996 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:58.552781 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-69b93267-60e9-47e4-a94e-b06a57acf996 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1db9595200344ed39a8b7a112150b7e7', 'request_id': 'req-69b93267-60e9-47e4-a94e-b06a57acf996'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:58.558890 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-69b93267-60e9-47e4-a94e-b06a57acf996 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1db9595200344ed39a8b7a112150b7e7', 'request_id': 'req-69b93267-60e9-47e4-a94e-b06a57acf996'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:58.564577 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-69b93267-60e9-47e4-a94e-b06a57acf996 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1db9595200344ed39a8b7a112150b7e7', 'request_id': 'req-69b93267-60e9-47e4-a94e-b06a57acf996'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:58.576951 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-69b93267-60e9-47e4-a94e-b06a57acf996 admin admin] The token cache is being invalidate because project 1db9595200344ed39a8b7a112150b7e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:30:58.577198 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-69b93267-60e9-47e4-a94e-b06a57acf996 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:58.577809 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-69b93267-60e9-47e4-a94e-b06a57acf996 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:58.579378 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1072/2125] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:30:58 2022] DELETE /identity/v3/projects/1db9595200344ed39a8b7a112150b7e7 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:30:58.583598 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61299b61-0ac6-4f4f-a3a9-91acf763286b service neutron] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:58.594144 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61299b61-0ac6-4f4f-a3a9-91acf763286b service neutron] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:58.648304 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb58eae-f92c-42be-b774-2cca83fe4ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:58.648975 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb58eae-f92c-42be-b774-2cca83fe4ce8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:58.649251 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb58eae-f92c-42be-b774-2cca83fe4ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:58.649516 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb58eae-f92c-42be-b774-2cca83fe4ce8 admin admin] PATH_INFO: `/v3/users/61d9c02fab5d466ba026a4c6dfd3631d` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:58.651303 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb58eae-f92c-42be-b774-2cca83fe4ce8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61d9c02fab5d466ba026a4c6dfd3631d)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:58.653294 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb58eae-f92c-42be-b774-2cca83fe4ce8 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:58.668058 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:58.706053 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-ceb58eae-f92c-42be-b774-2cca83fe4ce8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61d9c02fab5d466ba026a4c6dfd3631d'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:58.721539 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-ceb58eae-f92c-42be-b774-2cca83fe4ce8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61d9c02fab5d466ba026a4c6dfd3631d'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:58.728646 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-ceb58eae-f92c-42be-b774-2cca83fe4ce8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61d9c02fab5d466ba026a4c6dfd3631d'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:58.736114 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-ceb58eae-f92c-42be-b774-2cca83fe4ce8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61d9c02fab5d466ba026a4c6dfd3631d'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:58.737015 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-ceb58eae-f92c-42be-b774-2cca83fe4ce8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61d9c02fab5d466ba026a4c6dfd3631d'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:58.743595 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1054/2126] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:30:58 2022] DELETE /identity/v3/users/61d9c02fab5d466ba026a4c6dfd3631d => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:30:58.827466 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be2a67-f357-47c8-b4ce-4f9ba3fe16e9 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:58.828440 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be2a67-f357-47c8-b4ce-4f9ba3fe16e9 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:58.828744 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be2a67-f357-47c8-b4ce-4f9ba3fe16e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:58.851449 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-68be2a67-f357-47c8-b4ce-4f9ba3fe16e9 None None] MFA Rules not processed for user `da72fe720a584bba9dc2dafacdeac67d`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:30:58.852750 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-68be2a67-f357-47c8-b4ce-4f9ba3fe16e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:58.868258 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:58.933031 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1073/2127] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:30:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:30:59.048547 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb58eae-f92c-42be-b774-2cca83fe4ce8 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:59.050027 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-ceb58eae-f92c-42be-b774-2cca83fe4ce8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:59.144777 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb58eae-f92c-42be-b774-2cca83fe4ce8 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:59.152453 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca613e6-c749-491e-956b-3c67354307ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:59.153532 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca613e6-c749-491e-956b-3c67354307ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:59.154198 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca613e6-c749-491e-956b-3c67354307ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:59.155402 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca613e6-c749-491e-956b-3c67354307ae admin admin] PATH_INFO: `/v3/projects/09685839adeb4eaba72b1f90fe1e8ddf` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:59.156352 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca613e6-c749-491e-956b-3c67354307ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=09685839adeb4eaba72b1f90fe1e8ddf)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:59.158646 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca613e6-c749-491e-956b-3c67354307ae admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:59.238752 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-0ca613e6-c749-491e-956b-3c67354307ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09685839adeb4eaba72b1f90fe1e8ddf', 'request_id': 'req-0ca613e6-c749-491e-956b-3c67354307ae'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:59.250401 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-0ca613e6-c749-491e-956b-3c67354307ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09685839adeb4eaba72b1f90fe1e8ddf', 'request_id': 'req-0ca613e6-c749-491e-956b-3c67354307ae'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:59.257707 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-0ca613e6-c749-491e-956b-3c67354307ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09685839adeb4eaba72b1f90fe1e8ddf', 'request_id': 'req-0ca613e6-c749-491e-956b-3c67354307ae'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:59.273015 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-0ca613e6-c749-491e-956b-3c67354307ae admin admin] The token cache is being invalidate because project 09685839adeb4eaba72b1f90fe1e8ddf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81383) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:30:59.273321 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-0ca613e6-c749-491e-956b-3c67354307ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:59.274060 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-0ca613e6-c749-491e-956b-3c67354307ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:30:59.276486 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1055/2128] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:30:59 2022] DELETE /identity/v3/projects/09685839adeb4eaba72b1f90fe1e8ddf => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:30:59.282430 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaedfc5-53df-42c2-a70c-5419e2d13ca2 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:59.282913 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaedfc5-53df-42c2-a70c-5419e2d13ca2 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:59.283286 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaedfc5-53df-42c2-a70c-5419e2d13ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:59.310936 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-fcaedfc5-53df-42c2-a70c-5419e2d13ca2 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:30:59.312275 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-fcaedfc5-53df-42c2-a70c-5419e2d13ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:59.466506 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1074/2129] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:30:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:30:59.479217 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59131305-83ad-42a0-a4fb-3b0ac991e0ce None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:59.481808 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59131305-83ad-42a0-a4fb-3b0ac991e0ce None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:59.482822 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59131305-83ad-42a0-a4fb-3b0ac991e0ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:59.510605 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-59131305-83ad-42a0-a4fb-3b0ac991e0ce None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:30:59.512230 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-59131305-83ad-42a0-a4fb-3b0ac991e0ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:30:59.537485 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1056/2130] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:30:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:30:59.544613 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaedfc5-53df-42c2-a70c-5419e2d13ca2 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:59.559696 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaedfc5-53df-42c2-a70c-5419e2d13ca2 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:59.564674 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b642c71e-66a4-40b9-9a38-29bc84b1f0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:59.565284 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642c71e-66a4-40b9-9a38-29bc84b1f0f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:59.565562 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642c71e-66a4-40b9-9a38-29bc84b1f0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:59.565834 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642c71e-66a4-40b9-9a38-29bc84b1f0f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:59.566487 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b642c71e-66a4-40b9-9a38-29bc84b1f0f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:30:59.566846 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b642c71e-66a4-40b9-9a38-29bc84b1f0f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:59.568491 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b642c71e-66a4-40b9-9a38-29bc84b1f0f7 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:59.587442 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1075/2131] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 05:30:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:30:59.604192 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59131305-83ad-42a0-a4fb-3b0ac991e0ce None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:59.612329 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59131305-83ad-42a0-a4fb-3b0ac991e0ce None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:59.629005 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934a2ffe-61d5-4d17-99e0-dec14ff9dcd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:59.630027 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a2ffe-61d5-4d17-99e0-dec14ff9dcd9 admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:59.630477 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a2ffe-61d5-4d17-99e0-dec14ff9dcd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:59.630765 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a2ffe-61d5-4d17-99e0-dec14ff9dcd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:59.631644 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934a2ffe-61d5-4d17-99e0-dec14ff9dcd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:59.636094 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934a2ffe-61d5-4d17-99e0-dec14ff9dcd9 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:59.678666 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:DELETE=16,keystone:SELECT=81,keystone:INSERT=3 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:59.708577 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1057/2132] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:30:59 2022] POST /identity/v3/projects => generated 385 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:30:59.712904 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b642c71e-66a4-40b9-9a38-29bc84b1f0f7 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:59.730097 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b642c71e-66a4-40b9-9a38-29bc84b1f0f7 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:59.816830 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa9687a-92a6-4480-bd42-6daea73c285b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:59.817471 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9687a-92a6-4480-bd42-6daea73c285b admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:59.817753 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9687a-92a6-4480-bd42-6daea73c285b admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:59.818045 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9687a-92a6-4480-bd42-6daea73c285b admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:59.818663 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa9687a-92a6-4480-bd42-6daea73c285b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:59.820658 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa9687a-92a6-4480-bd42-6daea73c285b admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:59.844761 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1076/2133] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:30:59 2022] POST /identity/v3/users => generated 293 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:30:59.848965 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934a2ffe-61d5-4d17-99e0-dec14ff9dcd9 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:59.860015 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934a2ffe-61d5-4d17-99e0-dec14ff9dcd9 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:59.865067 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e71d223-9b80-4e45-9248-5f7a26675fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:59.865739 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e71d223-9b80-4e45-9248-5f7a26675fc9 admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:59.866089 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e71d223-9b80-4e45-9248-5f7a26675fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:59.866429 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e71d223-9b80-4e45-9248-5f7a26675fc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:59.867140 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e71d223-9b80-4e45-9248-5f7a26675fc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:59.868894 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e71d223-9b80-4e45-9248-5f7a26675fc9 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:59.880348 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1058/2134] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:30:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:30:59.884660 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa9687a-92a6-4480-bd42-6daea73c285b admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:59.895621 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa9687a-92a6-4480-bd42-6daea73c285b admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:59.900531 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4b8bfa-eef3-46c9-92f7-7e3b66d9c457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:59.902271 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b8bfa-eef3-46c9-92f7-7e3b66d9c457 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:59.902919 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b8bfa-eef3-46c9-92f7-7e3b66d9c457 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:59.902919 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b8bfa-eef3-46c9-92f7-7e3b66d9c457 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:59.903639 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4b8bfa-eef3-46c9-92f7-7e3b66d9c457 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:59.905444 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4b8bfa-eef3-46c9-92f7-7e3b66d9c457 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:59.918963 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1077/2135] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:30:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:30:59.923309 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e71d223-9b80-4e45-9248-5f7a26675fc9 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:30:59.934352 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e71d223-9b80-4e45-9248-5f7a26675fc9 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:30:59.943447 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a83aeb1-fdc1-4fcb-aa0b-51912ceea247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:30:59.944507 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a83aeb1-fdc1-4fcb-aa0b-51912ceea247 admin admin] REQUEST_METHOD: `PUT` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:59.944965 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a83aeb1-fdc1-4fcb-aa0b-51912ceea247 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:59.945419 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a83aeb1-fdc1-4fcb-aa0b-51912ceea247 admin admin] PATH_INFO: `/v3/projects/ccb7221a934a431795fbda1b38ff18cb/users/d8532b7145cd44388681c3d8950caf09/roles/aa7ff8e0ec1e48e5811335b9eb38b448` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:30:59.962441 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a83aeb1-fdc1-4fcb-aa0b-51912ceea247 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccb7221a934a431795fbda1b38ff18cb, user_id=d8532b7145cd44388681c3d8950caf09, role_id=aa7ff8e0ec1e48e5811335b9eb38b448)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:30:59.965574 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a83aeb1-fdc1-4fcb-aa0b-51912ceea247 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:30:59.980852 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1059/2136] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:30:59 2022] PUT /identity/v3/projects/ccb7221a934a431795fbda1b38ff18cb/users/d8532b7145cd44388681c3d8950caf09/roles/aa7ff8e0ec1e48e5811335b9eb38b448 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 05:30:59.993345 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c328685-a854-414f-9ace-7f8a3905bf17 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:30:59.993779 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c328685-a854-414f-9ace-7f8a3905bf17 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:30:59.994635 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c328685-a854-414f-9ace-7f8a3905bf17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:00.024955 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-0c328685-a854-414f-9ace-7f8a3905bf17 None None] MFA Rules not processed for user `d8532b7145cd44388681c3d8950caf09`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:31:00.026382 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-0c328685-a854-414f-9ace-7f8a3905bf17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:31:00.045728 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:31:00.097309 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1078/2137] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:30:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:31:00.101870 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a83aeb1-fdc1-4fcb-aa0b-51912ceea247 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:00.173275 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a83aeb1-fdc1-4fcb-aa0b-51912ceea247 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:00.178319 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9b7457-6f61-455b-b7bd-fe792e593f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:00.178933 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9b7457-6f61-455b-b7bd-fe792e593f03 admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:00.179197 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9b7457-6f61-455b-b7bd-fe792e593f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:00.180100 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9b7457-6f61-455b-b7bd-fe792e593f03 admin admin] PATH_INFO: `/v3/projects` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:00.180263 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9b7457-6f61-455b-b7bd-fe792e593f03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:00.182223 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9b7457-6f61-455b-b7bd-fe792e593f03 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:00.213499 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1060/2138] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:31:00 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:31:00.214922 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c328685-a854-414f-9ace-7f8a3905bf17 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:00.226950 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c328685-a854-414f-9ace-7f8a3905bf17 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:00.290459 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e808ed26-d45c-455f-a809-efe3f545a052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:00.291629 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e808ed26-d45c-455f-a809-efe3f545a052 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:00.291944 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e808ed26-d45c-455f-a809-efe3f545a052 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:00.292223 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e808ed26-d45c-455f-a809-efe3f545a052 admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:00.292905 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e808ed26-d45c-455f-a809-efe3f545a052 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:00.294836 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e808ed26-d45c-455f-a809-efe3f545a052 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:00.321593 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1079/2139] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:31:00 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 05:31:00.322820 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9b7457-6f61-455b-b7bd-fe792e593f03 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:00.333055 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9b7457-6f61-455b-b7bd-fe792e593f03 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:00.337924 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd862b6-ebc9-4332-995c-128202bbfd1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:00.338642 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd862b6-ebc9-4332-995c-128202bbfd1b admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:00.339130 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd862b6-ebc9-4332-995c-128202bbfd1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:00.339619 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd862b6-ebc9-4332-995c-128202bbfd1b admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:00.340779 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd862b6-ebc9-4332-995c-128202bbfd1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:00.342752 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd862b6-ebc9-4332-995c-128202bbfd1b admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:00.359182 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1061/2140] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:31:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:31:00.360698 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e808ed26-d45c-455f-a809-efe3f545a052 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:00.372739 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e808ed26-d45c-455f-a809-efe3f545a052 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:00.377905 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d143b99-adb0-4ad2-bb5c-8336577440ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:00.378694 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d143b99-adb0-4ad2-bb5c-8336577440ca admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:00.378971 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d143b99-adb0-4ad2-bb5c-8336577440ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:00.379241 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d143b99-adb0-4ad2-bb5c-8336577440ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:00.379935 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d143b99-adb0-4ad2-bb5c-8336577440ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:00.381527 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d143b99-adb0-4ad2-bb5c-8336577440ca admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:00.391954 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1080/2141] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:31:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 05:31:00.396146 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd862b6-ebc9-4332-995c-128202bbfd1b admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:00.407734 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd862b6-ebc9-4332-995c-128202bbfd1b admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:00.412602 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae936b5-e1ba-411f-b858-5091348c54c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:00.413263 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae936b5-e1ba-411f-b858-5091348c54c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:00.413575 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae936b5-e1ba-411f-b858-5091348c54c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:00.413845 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae936b5-e1ba-411f-b858-5091348c54c6 admin admin] PATH_INFO: `/v3/projects/0af74fa6af954726b57676c7f5291b06/users/8f2ff5d26d944cab8c56da2b6992ee35/roles/aa7ff8e0ec1e48e5811335b9eb38b448` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:00.430440 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae936b5-e1ba-411f-b858-5091348c54c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0af74fa6af954726b57676c7f5291b06, user_id=8f2ff5d26d944cab8c56da2b6992ee35, role_id=aa7ff8e0ec1e48e5811335b9eb38b448)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:00.433381 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae936b5-e1ba-411f-b858-5091348c54c6 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:00.446934 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1062/2142] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:31:00 2022] PUT /identity/v3/projects/0af74fa6af954726b57676c7f5291b06/users/8f2ff5d26d944cab8c56da2b6992ee35/roles/aa7ff8e0ec1e48e5811335b9eb38b448 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:31:00.458343 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be7c73-d5ac-40b7-8332-5f9d9ceb4f12 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:00.458659 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be7c73-d5ac-40b7-8332-5f9d9ceb4f12 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:00.459090 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be7c73-d5ac-40b7-8332-5f9d9ceb4f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:00.488750 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-39be7c73-d5ac-40b7-8332-5f9d9ceb4f12 None None] MFA Rules not processed for user `8f2ff5d26d944cab8c56da2b6992ee35`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:31:00.490349 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-39be7c73-d5ac-40b7-8332-5f9d9ceb4f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:31:00.578147 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1081/2143] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:31:00 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:31:00.584816 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae936b5-e1ba-411f-b858-5091348c54c6 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:00.662823 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae936b5-e1ba-411f-b858-5091348c54c6 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:00.669078 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172460f3-95fe-4c06-85c3-e1e877e0cdcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:00.669827 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172460f3-95fe-4c06-85c3-e1e877e0cdcd admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:00.670180 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172460f3-95fe-4c06-85c3-e1e877e0cdcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:00.670525 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172460f3-95fe-4c06-85c3-e1e877e0cdcd admin admin] PATH_INFO: `/v3/projects` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:00.671252 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172460f3-95fe-4c06-85c3-e1e877e0cdcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:00.675213 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172460f3-95fe-4c06-85c3-e1e877e0cdcd admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:00.696194 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:31:00.712597 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1063/2144] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:31:00 2022] POST /identity/v3/projects => generated 385 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:31:00.717879 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39be7c73-d5ac-40b7-8332-5f9d9ceb4f12 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:00.733141 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39be7c73-d5ac-40b7-8332-5f9d9ceb4f12 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:00.769219 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:31:00.823709 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5737d5-9b38-4e7a-8bd8-f05709ba2a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:00.824815 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5737d5-9b38-4e7a-8bd8-f05709ba2a99 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:00.825305 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5737d5-9b38-4e7a-8bd8-f05709ba2a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:00.825736 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5737d5-9b38-4e7a-8bd8-f05709ba2a99 admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:00.826520 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5737d5-9b38-4e7a-8bd8-f05709ba2a99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:00.832288 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5737d5-9b38-4e7a-8bd8-f05709ba2a99 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:00.862345 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1082/2145] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:31:00 2022] POST /identity/v3/users => generated 299 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:31:00.866991 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172460f3-95fe-4c06-85c3-e1e877e0cdcd admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:00.882214 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172460f3-95fe-4c06-85c3-e1e877e0cdcd admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:00.902140 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd05847a-5c6e-418f-92d3-a09501942422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:00.904916 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd05847a-5c6e-418f-92d3-a09501942422 admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:00.905804 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd05847a-5c6e-418f-92d3-a09501942422 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:00.906233 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd05847a-5c6e-418f-92d3-a09501942422 admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:00.908391 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd05847a-5c6e-418f-92d3-a09501942422 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:00.912328 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd05847a-5c6e-418f-92d3-a09501942422 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:00.943265 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1064/2146] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:31:00 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:31:00.948266 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5737d5-9b38-4e7a-8bd8-f05709ba2a99 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:00.969268 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5737d5-9b38-4e7a-8bd8-f05709ba2a99 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:00.974593 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de3bbac-8112-4f57-a9c4-20992187d89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:00.975022 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de3bbac-8112-4f57-a9c4-20992187d89f admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:00.975354 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de3bbac-8112-4f57-a9c4-20992187d89f admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:00.975629 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de3bbac-8112-4f57-a9c4-20992187d89f admin admin] PATH_INFO: `/v3/projects/bc96bba424b14481bb7ee8e18c68f068/users/15a7ea6dd54f484282298431bb59d3c0/roles/5b702713e40145b49e0b42abd0a5fba9` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:00.997357 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de3bbac-8112-4f57-a9c4-20992187d89f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc96bba424b14481bb7ee8e18c68f068, user_id=15a7ea6dd54f484282298431bb59d3c0, role_id=5b702713e40145b49e0b42abd0a5fba9)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:01.001738 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de3bbac-8112-4f57-a9c4-20992187d89f admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:01.022143 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1083/2147] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:31:00 2022] PUT /identity/v3/projects/bc96bba424b14481bb7ee8e18c68f068/users/15a7ea6dd54f484282298431bb59d3c0/roles/5b702713e40145b49e0b42abd0a5fba9 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:31:01.027499 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd05847a-5c6e-418f-92d3-a09501942422 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:01.052803 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd05847a-5c6e-418f-92d3-a09501942422 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:01.164781 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3437a2-f962-4ae8-ade6-0cf2dc687856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:01.165511 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3437a2-f962-4ae8-ade6-0cf2dc687856 admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:01.165939 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3437a2-f962-4ae8-ade6-0cf2dc687856 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:01.166291 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3437a2-f962-4ae8-ade6-0cf2dc687856 admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:01.167209 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3437a2-f962-4ae8-ade6-0cf2dc687856 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:01.169517 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3437a2-f962-4ae8-ade6-0cf2dc687856 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:01.190559 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de3bbac-8112-4f57-a9c4-20992187d89f admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:01.197262 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1065/2148] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:31:01 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:31:01.210339 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de3bbac-8112-4f57-a9c4-20992187d89f admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:01.223213 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbcc549-2e87-4236-a7a9-456d91bdbacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:01.225494 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbcc549-2e87-4236-a7a9-456d91bdbacf admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:01.225890 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbcc549-2e87-4236-a7a9-456d91bdbacf admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:01.226181 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbcc549-2e87-4236-a7a9-456d91bdbacf admin admin] PATH_INFO: `/v3/projects/bc96bba424b14481bb7ee8e18c68f068/users/15a7ea6dd54f484282298431bb59d3c0/roles/5b702713e40145b49e0b42abd0a5fba9` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:01.231271 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbcc549-2e87-4236-a7a9-456d91bdbacf admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc96bba424b14481bb7ee8e18c68f068, user_id=15a7ea6dd54f484282298431bb59d3c0, role_id=5b702713e40145b49e0b42abd0a5fba9)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:01.240900 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbcc549-2e87-4236-a7a9-456d91bdbacf admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:01.259236 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1084/2149] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:31:01 2022] PUT /identity/v3/projects/bc96bba424b14481bb7ee8e18c68f068/users/15a7ea6dd54f484282298431bb59d3c0/roles/5b702713e40145b49e0b42abd0a5fba9 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:31:01.272133 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021be672-ef3f-43e7-865f-5cea452f95fc None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:01.272435 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021be672-ef3f-43e7-865f-5cea452f95fc None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:01.272721 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021be672-ef3f-43e7-865f-5cea452f95fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:01.318391 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-021be672-ef3f-43e7-865f-5cea452f95fc None None] MFA Rules not processed for user `15a7ea6dd54f484282298431bb59d3c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:31:01.319634 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-021be672-ef3f-43e7-865f-5cea452f95fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:31:01.401561 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1066/2150] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:31:01 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:31:01.417719 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbcc549-2e87-4236-a7a9-456d91bdbacf admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:01.419940 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-dbbcc549-2e87-4236-a7a9-456d91bdbacf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:31:01.516518 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbcc549-2e87-4236-a7a9-456d91bdbacf admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:01.521398 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354ebba2-1afc-4229-96a0-f23a6b5c2710 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a147e14b61d481db1cac02c58ac3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:01.523035 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ebba2-1afc-4229-96a0-f23a6b5c2710 service cinder] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:01.523119 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ebba2-1afc-4229-96a0-f23a6b5c2710 service cinder] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:01.523338 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ebba2-1afc-4229-96a0-f23a6b5c2710 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:01.602833 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354ebba2-1afc-4229-96a0-f23a6b5c2710 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:01.605142 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354ebba2-1afc-4229-96a0-f23a6b5c2710 service cinder] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:01.615247 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1085/2151] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:31:01 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 05:31:03.414840 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021be672-ef3f-43e7-865f-5cea452f95fc None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:03.425880 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021be672-ef3f-43e7-865f-5cea452f95fc None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:03.430071 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac7f166-e310-46a4-88eb-428e8267a0e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a147e14b61d481db1cac02c58ac3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:03.430708 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac7f166-e310-46a4-88eb-428e8267a0e4 service cinder] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:03.430988 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac7f166-e310-46a4-88eb-428e8267a0e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:03.431280 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac7f166-e310-46a4-88eb-428e8267a0e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:03.527225 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac7f166-e310-46a4-88eb-428e8267a0e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:03.528864 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac7f166-e310-46a4-88eb-428e8267a0e4 service cinder] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:03.542724 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1067/2152] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:31:03 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:31:04.135812 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354ebba2-1afc-4229-96a0-f23a6b5c2710 service cinder] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:04.149324 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354ebba2-1afc-4229-96a0-f23a6b5c2710 service cinder] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:04.154759 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b04b8-2295-4f28-8991-40b9f5caf055 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a147e14b61d481db1cac02c58ac3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:04.155590 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b04b8-2295-4f28-8991-40b9f5caf055 service cinder] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:04.156070 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b04b8-2295-4f28-8991-40b9f5caf055 service cinder] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:04.156688 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b04b8-2295-4f28-8991-40b9f5caf055 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:04.168199 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6b04b8-2295-4f28-8991-40b9f5caf055 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:04.170017 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6b04b8-2295-4f28-8991-40b9f5caf055 service cinder] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:04.180887 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1086/2153] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:31:04 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:31:07.040199 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac7f166-e310-46a4-88eb-428e8267a0e4 service cinder] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:07.042457 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-0ac7f166-e310-46a4-88eb-428e8267a0e4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:31:07.049553 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:31:07.112686 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac7f166-e310-46a4-88eb-428e8267a0e4 service cinder] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:07.117704 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868e209c-44d8-42f0-a44f-f741bacb2812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:07.118408 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e209c-44d8-42f0-a44f-f741bacb2812 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:07.119297 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e209c-44d8-42f0-a44f-f741bacb2812 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:07.119572 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e209c-44d8-42f0-a44f-f741bacb2812 admin admin] PATH_INFO: `/v3/users/7fa298cbabe4484ea242a4e1bb5c5a17` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:07.120770 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868e209c-44d8-42f0-a44f-f741bacb2812 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fa298cbabe4484ea242a4e1bb5c5a17)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:07.122732 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868e209c-44d8-42f0-a44f-f741bacb2812 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:07.169626 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-868e209c-44d8-42f0-a44f-f741bacb2812 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fa298cbabe4484ea242a4e1bb5c5a17'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:07.181936 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-868e209c-44d8-42f0-a44f-f741bacb2812 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fa298cbabe4484ea242a4e1bb5c5a17'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:07.188847 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-868e209c-44d8-42f0-a44f-f741bacb2812 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fa298cbabe4484ea242a4e1bb5c5a17'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:07.196551 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-868e209c-44d8-42f0-a44f-f741bacb2812 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fa298cbabe4484ea242a4e1bb5c5a17'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:07.197180 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-868e209c-44d8-42f0-a44f-f741bacb2812 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fa298cbabe4484ea242a4e1bb5c5a17'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:07.203032 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1068/2154] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:31:07 2022] DELETE /identity/v3/users/7fa298cbabe4484ea242a4e1bb5c5a17 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:31:07.207587 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7637fd-57b9-4634-bf4b-86dbeaddf1fd None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:07.208084 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7637fd-57b9-4634-bf4b-86dbeaddf1fd None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:07.208197 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7637fd-57b9-4634-bf4b-86dbeaddf1fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:07.227172 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-eb7637fd-57b9-4634-bf4b-86dbeaddf1fd None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:31:07.229005 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-eb7637fd-57b9-4634-bf4b-86dbeaddf1fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:31:07.243502 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:31:07.290345 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1087/2155] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:31:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 05:31:07.300340 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868e209c-44d8-42f0-a44f-f741bacb2812 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:07.301768 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-868e209c-44d8-42f0-a44f-f741bacb2812 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:31:07.361855 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868e209c-44d8-42f0-a44f-f741bacb2812 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:07.365822 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939d3992-903e-43de-8364-cec4b70ee5db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:07.366429 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d3992-903e-43de-8364-cec4b70ee5db service neutron] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:07.366706 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d3992-903e-43de-8364-cec4b70ee5db service neutron] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:07.366974 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d3992-903e-43de-8364-cec4b70ee5db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:07.376451 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939d3992-903e-43de-8364-cec4b70ee5db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:07.377903 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939d3992-903e-43de-8364-cec4b70ee5db service neutron] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:07.388322 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1069/2156] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:31:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:31:07.673885 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7637fd-57b9-4634-bf4b-86dbeaddf1fd None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:07.675467 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-eb7637fd-57b9-4634-bf4b-86dbeaddf1fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:31:07.693446 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7637fd-57b9-4634-bf4b-86dbeaddf1fd None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:07.702606 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ff9730-d799-441f-b8fb-c7181e1a7ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:07.703283 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ff9730-d799-441f-b8fb-c7181e1a7ed0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:07.703557 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ff9730-d799-441f-b8fb-c7181e1a7ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:07.704068 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ff9730-d799-441f-b8fb-c7181e1a7ed0 admin admin] PATH_INFO: `/v3/projects/e3c157f6721345469b9a0356b9e7c548` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:07.705161 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ff9730-d799-441f-b8fb-c7181e1a7ed0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3c157f6721345469b9a0356b9e7c548)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:07.707081 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ff9730-d799-441f-b8fb-c7181e1a7ed0 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:07.773042 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-f1ff9730-d799-441f-b8fb-c7181e1a7ed0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3c157f6721345469b9a0356b9e7c548', 'request_id': 'req-f1ff9730-d799-441f-b8fb-c7181e1a7ed0'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:07.780325 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-f1ff9730-d799-441f-b8fb-c7181e1a7ed0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3c157f6721345469b9a0356b9e7c548', 'request_id': 'req-f1ff9730-d799-441f-b8fb-c7181e1a7ed0'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:07.793641 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-f1ff9730-d799-441f-b8fb-c7181e1a7ed0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3c157f6721345469b9a0356b9e7c548', 'request_id': 'req-f1ff9730-d799-441f-b8fb-c7181e1a7ed0'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:07.808409 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-f1ff9730-d799-441f-b8fb-c7181e1a7ed0 admin admin] The token cache is being invalidate because project e3c157f6721345469b9a0356b9e7c548 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:31:07.808706 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-f1ff9730-d799-441f-b8fb-c7181e1a7ed0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:07.812327 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-f1ff9730-d799-441f-b8fb-c7181e1a7ed0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:07.812327 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1088/2157] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:31:07 2022] DELETE /identity/v3/projects/e3c157f6721345469b9a0356b9e7c548 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:31:07.818661 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4464e8e-0a63-4c05-be28-55966f1c8317 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:07.819226 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4464e8e-0a63-4c05-be28-55966f1c8317 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:07.819382 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4464e8e-0a63-4c05-be28-55966f1c8317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:07.867299 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ff9730-d799-441f-b8fb-c7181e1a7ed0 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:07.869940 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-f1ff9730-d799-441f-b8fb-c7181e1a7ed0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:31:07.872339 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-d4464e8e-0a63-4c05-be28-55966f1c8317 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:31:07.873538 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-d4464e8e-0a63-4c05-be28-55966f1c8317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:31:07.906196 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:31:07.980620 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ff9730-d799-441f-b8fb-c7181e1a7ed0 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:07.985213 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1070/2158] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:31:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:31:07.986698 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebe6064-7e85-42b5-8931-3ce43a14c0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:07.987346 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe6064-7e85-42b5-8931-3ce43a14c0b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:07.987647 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe6064-7e85-42b5-8931-3ce43a14c0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:07.987937 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe6064-7e85-42b5-8931-3ce43a14c0b7 admin admin] PATH_INFO: `/v3/users/124fa68ca43543389207e9beb487c388` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:07.989357 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebe6064-7e85-42b5-8931-3ce43a14c0b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=124fa68ca43543389207e9beb487c388)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:07.991822 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebe6064-7e85-42b5-8931-3ce43a14c0b7 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:07.996219 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0634edb-3ea1-4453-a2a7-78d02d2d4b44 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:07.997666 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0634edb-3ea1-4453-a2a7-78d02d2d4b44 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:07.997950 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0634edb-3ea1-4453-a2a7-78d02d2d4b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:08.025222 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-c0634edb-3ea1-4453-a2a7-78d02d2d4b44 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:31:08.026442 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-c0634edb-3ea1-4453-a2a7-78d02d2d4b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:31:08.043109 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1071/2159] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:31:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 05:31:08.043923 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0634edb-3ea1-4453-a2a7-78d02d2d4b44 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:08.056564 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0634edb-3ea1-4453-a2a7-78d02d2d4b44 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:08.058598 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:31:08.061690 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-0ebe6064-7e85-42b5-8931-3ce43a14c0b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '124fa68ca43543389207e9beb487c388'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:08.076483 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2880df-4b0c-4950-9435-4634bc3205f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:08.076483 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2880df-4b0c-4950-9435-4634bc3205f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:08.076483 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2880df-4b0c-4950-9435-4634bc3205f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:08.076483 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2880df-4b0c-4950-9435-4634bc3205f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:08.076911 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2880df-4b0c-4950-9435-4634bc3205f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:31:08.076911 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2880df-4b0c-4950-9435-4634bc3205f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:08.076911 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2880df-4b0c-4950-9435-4634bc3205f6 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:08.082007 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1072/2160] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 05:31:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:31:08.085800 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2880df-4b0c-4950-9435-4634bc3205f6 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:08.086069 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-0ebe6064-7e85-42b5-8931-3ce43a14c0b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '124fa68ca43543389207e9beb487c388'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:08.093986 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-0ebe6064-7e85-42b5-8931-3ce43a14c0b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '124fa68ca43543389207e9beb487c388'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:08.105239 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2880df-4b0c-4950-9435-4634bc3205f6 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:08.107076 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-0ebe6064-7e85-42b5-8931-3ce43a14c0b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '124fa68ca43543389207e9beb487c388'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:08.107919 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-0ebe6064-7e85-42b5-8931-3ce43a14c0b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '124fa68ca43543389207e9beb487c388'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:08.111800 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c28183-a108-4d2d-aff1-15acbbecb614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:08.112477 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c28183-a108-4d2d-aff1-15acbbecb614 admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:08.112904 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c28183-a108-4d2d-aff1-15acbbecb614 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:08.113617 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c28183-a108-4d2d-aff1-15acbbecb614 admin admin] PATH_INFO: `/v3/projects` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:08.114682 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c28183-a108-4d2d-aff1-15acbbecb614 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:08.120000 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1089/2161] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:31:07 2022] DELETE /identity/v3/users/124fa68ca43543389207e9beb487c388 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:31:08.120135 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c28183-a108-4d2d-aff1-15acbbecb614 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:08.122154 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e290bca0-70b2-4269-9029-2280b86968b2 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:08.127731 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e290bca0-70b2-4269-9029-2280b86968b2 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:08.127731 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e290bca0-70b2-4269-9029-2280b86968b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:08.151668 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1073/2162] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:31:08 2022] POST /identity/v3/projects => generated 371 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 05:31:08.157004 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c28183-a108-4d2d-aff1-15acbbecb614 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:08.158362 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-a0c28183-a108-4d2d-aff1-15acbbecb614 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:31:08.158524 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-e290bca0-70b2-4269-9029-2280b86968b2 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:31:08.159776 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-e290bca0-70b2-4269-9029-2280b86968b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:31:08.237431 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1090/2163] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:31:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:31:08.238732 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e290bca0-70b2-4269-9029-2280b86968b2 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:08.240313 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-e290bca0-70b2-4269-9029-2280b86968b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:31:08.250050 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c28183-a108-4d2d-aff1-15acbbecb614 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:08.253717 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e290bca0-70b2-4269-9029-2280b86968b2 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:08.254947 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba3115d-79b5-4a4b-a942-08dbe1514c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:08.255565 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3115d-79b5-4a4b-a942-08dbe1514c1a admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:08.255877 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3115d-79b5-4a4b-a942-08dbe1514c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:08.256156 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3115d-79b5-4a4b-a942-08dbe1514c1a admin admin] PATH_INFO: `/v3/users` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:08.256796 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba3115d-79b5-4a4b-a942-08dbe1514c1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:08.258480 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2afde9c-be47-4a7d-92d9-2d987662df5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:08.258751 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba3115d-79b5-4a4b-a942-08dbe1514c1a admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:08.259102 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2afde9c-be47-4a7d-92d9-2d987662df5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:08.259987 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2afde9c-be47-4a7d-92d9-2d987662df5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:08.260267 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2afde9c-be47-4a7d-92d9-2d987662df5a admin admin] PATH_INFO: `/v3/users/d8532b7145cd44388681c3d8950caf09` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:08.261428 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2afde9c-be47-4a7d-92d9-2d987662df5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8532b7145cd44388681c3d8950caf09)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:08.263396 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2afde9c-be47-4a7d-92d9-2d987662df5a admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:08.283922 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1074/2164] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:31:08 2022] POST /identity/v3/users => generated 286 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:31:08.283922 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba3115d-79b5-4a4b-a942-08dbe1514c1a admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:08.285551 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-2ba3115d-79b5-4a4b-a942-08dbe1514c1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:31:08.318439 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-c2afde9c-be47-4a7d-92d9-2d987662df5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8532b7145cd44388681c3d8950caf09'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:08.331910 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-c2afde9c-be47-4a7d-92d9-2d987662df5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8532b7145cd44388681c3d8950caf09'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:08.339913 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-c2afde9c-be47-4a7d-92d9-2d987662df5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8532b7145cd44388681c3d8950caf09'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:08.347731 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-c2afde9c-be47-4a7d-92d9-2d987662df5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8532b7145cd44388681c3d8950caf09'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:08.348381 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-c2afde9c-be47-4a7d-92d9-2d987662df5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8532b7145cd44388681c3d8950caf09'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:08.348750 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba3115d-79b5-4a4b-a942-08dbe1514c1a admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:08.353626 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc70e74-9c04-4989-a19d-073fe8203a1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:08.354259 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc70e74-9c04-4989-a19d-073fe8203a1f service neutron] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:08.354535 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc70e74-9c04-4989-a19d-073fe8203a1f service neutron] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:08.354801 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc70e74-9c04-4989-a19d-073fe8203a1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:08.355726 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1091/2165] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:31:08 2022] DELETE /identity/v3/users/d8532b7145cd44388681c3d8950caf09 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:31:08.358724 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2afde9c-be47-4a7d-92d9-2d987662df5a admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:08.359327 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-ecc70e74-9c04-4989-a19d-073fe8203a1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:31:08.359569 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-c2afde9c-be47-4a7d-92d9-2d987662df5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:31:08.372327 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc70e74-9c04-4989-a19d-073fe8203a1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:08.373869 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc70e74-9c04-4989-a19d-073fe8203a1f service neutron] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:08.383526 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1075/2166] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:31:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:31:08.385036 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d2ed50-0a02-4134-9c33-e5c469dd30bc None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:08.385327 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d2ed50-0a02-4134-9c33-e5c469dd30bc None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:08.385602 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d2ed50-0a02-4134-9c33-e5c469dd30bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:08.404537 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-25d2ed50-0a02-4134-9c33-e5c469dd30bc None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:31:08.405735 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-25d2ed50-0a02-4134-9c33-e5c469dd30bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:31:08.408249 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:31:08.422601 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:31:08.439101 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2afde9c-be47-4a7d-92d9-2d987662df5a admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:08.445601 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af26582-49d0-49f5-bb30-df9ad4293882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:08.446032 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af26582-49d0-49f5-bb30-df9ad4293882 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:08.446373 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af26582-49d0-49f5-bb30-df9ad4293882 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:08.447018 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af26582-49d0-49f5-bb30-df9ad4293882 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:08.447670 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af26582-49d0-49f5-bb30-df9ad4293882 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:08.450100 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af26582-49d0-49f5-bb30-df9ad4293882 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:08.461865 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1092/2167] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:31:08.466810 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af26582-49d0-49f5-bb30-df9ad4293882 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:08.477551 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af26582-49d0-49f5-bb30-df9ad4293882 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:08.482735 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1076/2168] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:31:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:31:08.484344 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2fa12e-1cbe-40e3-8834-f002ec39c57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:08.484958 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2fa12e-1cbe-40e3-8834-f002ec39c57d admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:08.485238 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2fa12e-1cbe-40e3-8834-f002ec39c57d admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:08.485513 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2fa12e-1cbe-40e3-8834-f002ec39c57d admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:08.486166 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2fa12e-1cbe-40e3-8834-f002ec39c57d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:08.487959 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2fa12e-1cbe-40e3-8834-f002ec39c57d admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:08.494411 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d2ed50-0a02-4134-9c33-e5c469dd30bc None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:08.496785 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-25d2ed50-0a02-4134-9c33-e5c469dd30bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:31:08.500116 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1093/2169] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 05:31:08.504115 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2fa12e-1cbe-40e3-8834-f002ec39c57d admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:08.515084 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2fa12e-1cbe-40e3-8834-f002ec39c57d admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:08.520663 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d5968-2873-40c9-b012-6578b4e2350a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:08.521348 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d5968-2873-40c9-b012-6578b4e2350a admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:08.521603 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d5968-2873-40c9-b012-6578b4e2350a admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:08.521905 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d5968-2873-40c9-b012-6578b4e2350a admin admin] PATH_INFO: `/v3/projects/c4461c316bfc44118c73ba656056984d/users/8f259a7d50734a129b27954e33fb1200/roles/aa7ff8e0ec1e48e5811335b9eb38b448` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:08.537385 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96d5968-2873-40c9-b012-6578b4e2350a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4461c316bfc44118c73ba656056984d, user_id=8f259a7d50734a129b27954e33fb1200, role_id=aa7ff8e0ec1e48e5811335b9eb38b448)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:08.540149 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96d5968-2873-40c9-b012-6578b4e2350a admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:08.558106 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1094/2170] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:31:08 2022] PUT /identity/v3/projects/c4461c316bfc44118c73ba656056984d/users/8f259a7d50734a129b27954e33fb1200/roles/aa7ff8e0ec1e48e5811335b9eb38b448 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 05:31:08.568182 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cafb65-a3c7-444f-a79b-19d81f27a003 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:08.569008 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cafb65-a3c7-444f-a79b-19d81f27a003 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:08.569163 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cafb65-a3c7-444f-a79b-19d81f27a003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:08.573342 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d2ed50-0a02-4134-9c33-e5c469dd30bc None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:08.600016 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-65cafb65-a3c7-444f-a79b-19d81f27a003 None None] MFA Rules not processed for user `8f259a7d50734a129b27954e33fb1200`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:31:08.601248 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-65cafb65-a3c7-444f-a79b-19d81f27a003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:31:08.626777 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b786a3f-abe3-4cb4-b759-1b7977407cf1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:08.627409 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b786a3f-abe3-4cb4-b759-1b7977407cf1 service neutron] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:08.627670 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b786a3f-abe3-4cb4-b759-1b7977407cf1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:08.627970 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b786a3f-abe3-4cb4-b759-1b7977407cf1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:08.679553 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1095/2171] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:31:08 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 05:31:08.683614 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cafb65-a3c7-444f-a79b-19d81f27a003 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:08.699646 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b786a3f-abe3-4cb4-b759-1b7977407cf1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:08.701131 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b786a3f-abe3-4cb4-b759-1b7977407cf1 service neutron] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:08.714576 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1077/2172] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:31:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 05:31:08.716876 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b786a3f-abe3-4cb4-b759-1b7977407cf1 service neutron] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:08.719132 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-0b786a3f-abe3-4cb4-b759-1b7977407cf1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:31:08.732791 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b786a3f-abe3-4cb4-b759-1b7977407cf1 service neutron] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:08.739360 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96db2621-575f-400d-8e96-0e0a68af1d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:08.740044 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db2621-575f-400d-8e96-0e0a68af1d6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:08.740387 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db2621-575f-400d-8e96-0e0a68af1d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:08.740571 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db2621-575f-400d-8e96-0e0a68af1d6e admin admin] PATH_INFO: `/v3/projects/7f21ab2bdff04d20b9f1851f4d06e6ed` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:08.752811 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96db2621-575f-400d-8e96-0e0a68af1d6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f21ab2bdff04d20b9f1851f4d06e6ed)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:08.755699 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96db2621-575f-400d-8e96-0e0a68af1d6e admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:08.773789 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cafb65-a3c7-444f-a79b-19d81f27a003 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:08.789874 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:31:08.795946 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3768b06c-4639-40de-a264-74ec0511cfba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:08.796922 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3768b06c-4639-40de-a264-74ec0511cfba admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:08.797441 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3768b06c-4639-40de-a264-74ec0511cfba admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:08.797879 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3768b06c-4639-40de-a264-74ec0511cfba admin admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:08.798805 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3768b06c-4639-40de-a264-74ec0511cfba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:08.801795 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3768b06c-4639-40de-a264-74ec0511cfba admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:08.825232 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-96db2621-575f-400d-8e96-0e0a68af1d6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f21ab2bdff04d20b9f1851f4d06e6ed', 'request_id': 'req-96db2621-575f-400d-8e96-0e0a68af1d6e'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:08.835902 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-96db2621-575f-400d-8e96-0e0a68af1d6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f21ab2bdff04d20b9f1851f4d06e6ed', 'request_id': 'req-96db2621-575f-400d-8e96-0e0a68af1d6e'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:08.846144 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1096/2173] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:31:08 2022] POST /identity/v3/projects => generated 373 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 05:31:08.850120 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3768b06c-4639-40de-a264-74ec0511cfba admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:08.863496 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-96db2621-575f-400d-8e96-0e0a68af1d6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f21ab2bdff04d20b9f1851f4d06e6ed', 'request_id': 'req-96db2621-575f-400d-8e96-0e0a68af1d6e'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:08.866476 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:31:08.890264 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-96db2621-575f-400d-8e96-0e0a68af1d6e admin admin] The token cache is being invalidate because project 7f21ab2bdff04d20b9f1851f4d06e6ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81383) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:31:08.890637 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-96db2621-575f-400d-8e96-0e0a68af1d6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:08.902034 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-96db2621-575f-400d-8e96-0e0a68af1d6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:08.907754 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1078/2174] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:31:08 2022] DELETE /identity/v3/projects/7f21ab2bdff04d20b9f1851f4d06e6ed => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:31:08.910052 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4811b957-3c65-4ef8-8165-45cfe245bf22 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:08.910345 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4811b957-3c65-4ef8-8165-45cfe245bf22 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:08.910626 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4811b957-3c65-4ef8-8165-45cfe245bf22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:08.934058 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3768b06c-4639-40de-a264-74ec0511cfba admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:08.944287 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e79f892-a74c-42ae-a91d-ecb043af6f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:08.944951 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e79f892-a74c-42ae-a91d-ecb043af6f48 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:08.945235 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e79f892-a74c-42ae-a91d-ecb043af6f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:08.945509 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e79f892-a74c-42ae-a91d-ecb043af6f48 admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:08.946155 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e79f892-a74c-42ae-a91d-ecb043af6f48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:08.949663 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e79f892-a74c-42ae-a91d-ecb043af6f48 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:08.950126 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-4811b957-3c65-4ef8-8165-45cfe245bf22 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:31:08.951393 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-4811b957-3c65-4ef8-8165-45cfe245bf22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:31:08.965532 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1079/2175] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:31:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:31:08.973580 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd0c362-4d69-401c-8078-ff3d47b64d99 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:08.973870 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd0c362-4d69-401c-8078-ff3d47b64d99 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:08.974282 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd0c362-4d69-401c-8078-ff3d47b64d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:08.992525 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1097/2176] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:31:08 2022] POST /identity/v3/users => generated 293 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 05:31:08.996222 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e79f892-a74c-42ae-a91d-ecb043af6f48 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:09.000788 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-0e79f892-a74c-42ae-a91d-ecb043af6f48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:31:09.016057 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-8dd0c362-4d69-401c-8078-ff3d47b64d99 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:31:09.017913 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-8dd0c362-4d69-401c-8078-ff3d47b64d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:31:09.028132 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e79f892-a74c-42ae-a91d-ecb043af6f48 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:09.030574 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1080/2177] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:31:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:31:09.035386 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd0c362-4d69-401c-8078-ff3d47b64d99 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:09.050378 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d40578-4c45-413a-9003-3c87a728520f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:09.050566 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd0c362-4d69-401c-8078-ff3d47b64d99 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:09.050947 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d40578-4c45-413a-9003-3c87a728520f admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:09.051247 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d40578-4c45-413a-9003-3c87a728520f admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:09.052174 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d40578-4c45-413a-9003-3c87a728520f admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:09.052892 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d40578-4c45-413a-9003-3c87a728520f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:09.054567 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d40578-4c45-413a-9003-3c87a728520f admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:09.055079 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc568d61-b8cc-4784-bf41-8ca73a4ef33d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:09.055722 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc568d61-b8cc-4784-bf41-8ca73a4ef33d admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:09.056044 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc568d61-b8cc-4784-bf41-8ca73a4ef33d admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:09.056325 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc568d61-b8cc-4784-bf41-8ca73a4ef33d admin admin] PATH_INFO: `/v3/domains` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:09.057176 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc568d61-b8cc-4784-bf41-8ca73a4ef33d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:31:09.057859 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc568d61-b8cc-4784-bf41-8ca73a4ef33d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:09.059463 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc568d61-b8cc-4784-bf41-8ca73a4ef33d admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:09.068161 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1098/2178] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:31:09.073309 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d40578-4c45-413a-9003-3c87a728520f admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:09.076880 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1081/2179] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 05:31:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:31:09.080657 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc568d61-b8cc-4784-bf41-8ca73a4ef33d admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:09.091373 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d40578-4c45-413a-9003-3c87a728520f admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:09.094014 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc568d61-b8cc-4784-bf41-8ca73a4ef33d admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:09.100166 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ce1554-2dee-4f6e-a21f-f4e6caac54c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:09.100369 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c0432e-1ad4-4508-953c-84f383d7653f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:09.100793 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce1554-2dee-4f6e-a21f-f4e6caac54c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:09.100941 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c0432e-1ad4-4508-953c-84f383d7653f admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:09.101103 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce1554-2dee-4f6e-a21f-f4e6caac54c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:09.101201 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c0432e-1ad4-4508-953c-84f383d7653f admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:09.101366 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce1554-2dee-4f6e-a21f-f4e6caac54c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:09.101460 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c0432e-1ad4-4508-953c-84f383d7653f admin admin] PATH_INFO: `/v3/projects/d08ebd3d624142c88a2b69d02f65b520/users/afaae9ecebcd4f178adb8d9171207c3a/roles/5b702713e40145b49e0b42abd0a5fba9` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:09.101992 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ce1554-2dee-4f6e-a21f-f4e6caac54c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:09.104072 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ce1554-2dee-4f6e-a21f-f4e6caac54c1 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:09.120251 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c0432e-1ad4-4508-953c-84f383d7653f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d08ebd3d624142c88a2b69d02f65b520, user_id=afaae9ecebcd4f178adb8d9171207c3a, role_id=5b702713e40145b49e0b42abd0a5fba9)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:09.123031 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c0432e-1ad4-4508-953c-84f383d7653f admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:09.145365 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1099/2180] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:31:09 2022] PUT /identity/v3/projects/d08ebd3d624142c88a2b69d02f65b520/users/afaae9ecebcd4f178adb8d9171207c3a/roles/5b702713e40145b49e0b42abd0a5fba9 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:31:09.146093 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c0432e-1ad4-4508-953c-84f383d7653f admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:09.148721 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1082/2181] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:31:09 2022] POST /identity/v3/projects => generated 373 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:31:09.149908 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ce1554-2dee-4f6e-a21f-f4e6caac54c1 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:09.153816 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-46c0432e-1ad4-4508-953c-84f383d7653f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:31:09.240479 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ce1554-2dee-4f6e-a21f-f4e6caac54c1 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:09.248436 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124969d6-0675-429e-b42b-09e0d05759a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:09.249299 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124969d6-0675-429e-b42b-09e0d05759a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:09.249689 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124969d6-0675-429e-b42b-09e0d05759a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:09.249974 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124969d6-0675-429e-b42b-09e0d05759a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:09.250642 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124969d6-0675-429e-b42b-09e0d05759a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:09.252387 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124969d6-0675-429e-b42b-09e0d05759a0 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:09.256720 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c0432e-1ad4-4508-953c-84f383d7653f admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:09.263851 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1083/2182] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:31:09 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:31:09.264606 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124969d6-0675-429e-b42b-09e0d05759a0 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:09.271636 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae54989-ef3c-41dd-a92e-c847815f06a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:09.272319 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae54989-ef3c-41dd-a92e-c847815f06a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:09.272601 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae54989-ef3c-41dd-a92e-c847815f06a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:09.272875 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae54989-ef3c-41dd-a92e-c847815f06a8 admin admin] PATH_INFO: `/v3/projects/ccb7221a934a431795fbda1b38ff18cb` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:09.276453 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae54989-ef3c-41dd-a92e-c847815f06a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccb7221a934a431795fbda1b38ff18cb)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:09.276705 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124969d6-0675-429e-b42b-09e0d05759a0 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:09.281961 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b09276-813f-43bd-aea3-a688937a3231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:09.282572 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b09276-813f-43bd-aea3-a688937a3231 admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:09.282855 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b09276-813f-43bd-aea3-a688937a3231 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:09.283124 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b09276-813f-43bd-aea3-a688937a3231 admin admin] PATH_INFO: `/v3/users` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:09.283817 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b09276-813f-43bd-aea3-a688937a3231 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:09.284205 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae54989-ef3c-41dd-a92e-c847815f06a8 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:09.285730 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b09276-813f-43bd-aea3-a688937a3231 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:09.335153 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1084/2183] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:31:09 2022] POST /identity/v3/users => generated 287 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:31:09.336238 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b09276-813f-43bd-aea3-a688937a3231 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:09.349834 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b09276-813f-43bd-aea3-a688937a3231 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:09.354331 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-5ae54989-ef3c-41dd-a92e-c847815f06a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccb7221a934a431795fbda1b38ff18cb', 'request_id': 'req-5ae54989-ef3c-41dd-a92e-c847815f06a8'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:09.361449 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-5ae54989-ef3c-41dd-a92e-c847815f06a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccb7221a934a431795fbda1b38ff18cb', 'request_id': 'req-5ae54989-ef3c-41dd-a92e-c847815f06a8'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:09.368940 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-5ae54989-ef3c-41dd-a92e-c847815f06a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccb7221a934a431795fbda1b38ff18cb', 'request_id': 'req-5ae54989-ef3c-41dd-a92e-c847815f06a8'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:09.377087 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:31:09.393873 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-5ae54989-ef3c-41dd-a92e-c847815f06a8 admin admin] The token cache is being invalidate because project ccb7221a934a431795fbda1b38ff18cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:31:09.394173 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-5ae54989-ef3c-41dd-a92e-c847815f06a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:09.396097 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-5ae54989-ef3c-41dd-a92e-c847815f06a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:09.398886 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1100/2184] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:31:09 2022] DELETE /identity/v3/projects/ccb7221a934a431795fbda1b38ff18cb => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:31:09.399881 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae54989-ef3c-41dd-a92e-c847815f06a8 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:09.401436 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-5ae54989-ef3c-41dd-a92e-c847815f06a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:31:09.415581 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:31:09.460035 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ccb8d7-5a19-4d8f-a9eb-67f7ae11f1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:09.461115 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ccb8d7-5a19-4d8f-a9eb-67f7ae11f1e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:09.461403 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ccb8d7-5a19-4d8f-a9eb-67f7ae11f1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:09.461712 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ccb8d7-5a19-4d8f-a9eb-67f7ae11f1e3 admin admin] PATH_INFO: `/v3/projects/d08ebd3d624142c88a2b69d02f65b520/users/afaae9ecebcd4f178adb8d9171207c3a/roles/5b702713e40145b49e0b42abd0a5fba9` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:09.463851 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ccb8d7-5a19-4d8f-a9eb-67f7ae11f1e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d08ebd3d624142c88a2b69d02f65b520, user_id=afaae9ecebcd4f178adb8d9171207c3a, role_id=5b702713e40145b49e0b42abd0a5fba9)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:09.466530 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ccb8d7-5a19-4d8f-a9eb-67f7ae11f1e3 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:09.478617 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1085/2185] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:31:09 2022] PUT /identity/v3/projects/d08ebd3d624142c88a2b69d02f65b520/users/afaae9ecebcd4f178adb8d9171207c3a/roles/5b702713e40145b49e0b42abd0a5fba9 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:31:09.479455 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ccb8d7-5a19-4d8f-a9eb-67f7ae11f1e3 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:09.481209 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-c3ccb8d7-5a19-4d8f-a9eb-67f7ae11f1e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:31:09.503594 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae54989-ef3c-41dd-a92e-c847815f06a8 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:09.569282 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64da8a3f-e428-43a0-a78f-604783f509c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:09.569919 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da8a3f-e428-43a0-a78f-604783f509c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:09.570186 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da8a3f-e428-43a0-a78f-604783f509c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:09.570959 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da8a3f-e428-43a0-a78f-604783f509c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:09.571162 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64da8a3f-e428-43a0-a78f-604783f509c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:09.572876 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64da8a3f-e428-43a0-a78f-604783f509c3 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:09.576905 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ccb8d7-5a19-4d8f-a9eb-67f7ae11f1e3 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:09.582853 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d2d946-df83-4ec9-88fc-f2c55f49686e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:09.583501 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d2d946-df83-4ec9-88fc-f2c55f49686e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:09.583858 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d2d946-df83-4ec9-88fc-f2c55f49686e admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:09.584164 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d2d946-df83-4ec9-88fc-f2c55f49686e admin admin] PATH_INFO: `/v3/users/8f2ff5d26d944cab8c56da2b6992ee35` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:09.584609 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1101/2186] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:31:09 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:31:09.585502 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d2d946-df83-4ec9-88fc-f2c55f49686e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f2ff5d26d944cab8c56da2b6992ee35)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:09.588020 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d2d946-df83-4ec9-88fc-f2c55f49686e admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:09.589465 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f504aaa-a8e0-4b16-9ab4-ce799245c6f9 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:09.589746 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f504aaa-a8e0-4b16-9ab4-ce799245c6f9 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:09.590038 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f504aaa-a8e0-4b16-9ab4-ce799245c6f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:09.620168 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-1f504aaa-a8e0-4b16-9ab4-ce799245c6f9 None None] MFA Rules not processed for user `afaae9ecebcd4f178adb8d9171207c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:31:09.621575 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-1f504aaa-a8e0-4b16-9ab4-ce799245c6f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:31:09.638736 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-52d2d946-df83-4ec9-88fc-f2c55f49686e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f2ff5d26d944cab8c56da2b6992ee35'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:09.652000 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-52d2d946-df83-4ec9-88fc-f2c55f49686e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f2ff5d26d944cab8c56da2b6992ee35'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:09.659715 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-52d2d946-df83-4ec9-88fc-f2c55f49686e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f2ff5d26d944cab8c56da2b6992ee35'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:09.668565 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-52d2d946-df83-4ec9-88fc-f2c55f49686e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f2ff5d26d944cab8c56da2b6992ee35'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:09.669199 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-52d2d946-df83-4ec9-88fc-f2c55f49686e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f2ff5d26d944cab8c56da2b6992ee35'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:09.675357 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1086/2187] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:31:09 2022] DELETE /identity/v3/users/8f2ff5d26d944cab8c56da2b6992ee35 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:31:09.678946 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d2d946-df83-4ec9-88fc-f2c55f49686e admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:09.680406 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-52d2d946-df83-4ec9-88fc-f2c55f49686e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:31:09.693233 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1102/2188] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:31:09 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:31:09.705915 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f504aaa-a8e0-4b16-9ab4-ce799245c6f9 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:09.708200 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-1f504aaa-a8e0-4b16-9ab4-ce799245c6f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:31:09.745413 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:31:09.747532 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:31:09.779340 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d2d946-df83-4ec9-88fc-f2c55f49686e admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:09.787727 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c803c4f8-e5fc-4c50-a75c-e7d089287ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:09.787727 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c803c4f8-e5fc-4c50-a75c-e7d089287ba6 admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:09.787727 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c803c4f8-e5fc-4c50-a75c-e7d089287ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:09.787727 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c803c4f8-e5fc-4c50-a75c-e7d089287ba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:09.788120 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c803c4f8-e5fc-4c50-a75c-e7d089287ba6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:09.788881 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c803c4f8-e5fc-4c50-a75c-e7d089287ba6 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:09.799638 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f504aaa-a8e0-4b16-9ab4-ce799245c6f9 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:09.828956 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1087/2189] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:31:09 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:31:09.837969 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c803c4f8-e5fc-4c50-a75c-e7d089287ba6 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:09.882114 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c803c4f8-e5fc-4c50-a75c-e7d089287ba6 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:09.886025 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed12b09-6e5f-4aca-8f24-2be2aab4cfcb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a147e14b61d481db1cac02c58ac3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:09.886850 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed12b09-6e5f-4aca-8f24-2be2aab4cfcb service cinder] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:09.887206 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed12b09-6e5f-4aca-8f24-2be2aab4cfcb service cinder] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:09.887929 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed12b09-6e5f-4aca-8f24-2be2aab4cfcb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:09.894538 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522d4bb2-5a5a-4248-a05b-39d45ad66d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:09.896302 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d4bb2-5a5a-4248-a05b-39d45ad66d1e admin admin] REQUEST_METHOD: `PUT` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:09.896834 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d4bb2-5a5a-4248-a05b-39d45ad66d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:09.897669 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d4bb2-5a5a-4248-a05b-39d45ad66d1e admin admin] PATH_INFO: `/v3/projects/3fe0749e43f04de6877a332363e00788/users/d710f196af184bd0a8cce3c204f14114/roles/aa7ff8e0ec1e48e5811335b9eb38b448` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:09.935343 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522d4bb2-5a5a-4248-a05b-39d45ad66d1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fe0749e43f04de6877a332363e00788, user_id=d710f196af184bd0a8cce3c204f14114, role_id=aa7ff8e0ec1e48e5811335b9eb38b448)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:09.940102 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522d4bb2-5a5a-4248-a05b-39d45ad66d1e admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:09.965131 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1088/2190] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:31:09 2022] PUT /identity/v3/projects/3fe0749e43f04de6877a332363e00788/users/d710f196af184bd0a8cce3c204f14114/roles/aa7ff8e0ec1e48e5811335b9eb38b448 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:31:09.976581 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ee0a7b-f81b-4c82-90df-d543616d2ba0 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:09.977064 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ee0a7b-f81b-4c82-90df-d543616d2ba0 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:09.978511 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ee0a7b-f81b-4c82-90df-d543616d2ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:09.980703 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed12b09-6e5f-4aca-8f24-2be2aab4cfcb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:09.982391 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed12b09-6e5f-4aca-8f24-2be2aab4cfcb service cinder] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:09.997618 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1103/2191] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:31:09 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 05:31:10.014113 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-87ee0a7b-f81b-4c82-90df-d543616d2ba0 None None] MFA Rules not processed for user `d710f196af184bd0a8cce3c204f14114`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:31:10.016619 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-87ee0a7b-f81b-4c82-90df-d543616d2ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:31:10.104038 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed12b09-6e5f-4aca-8f24-2be2aab4cfcb service cinder] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:10.106297 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-eed12b09-6e5f-4aca-8f24-2be2aab4cfcb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:31:10.145282 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed12b09-6e5f-4aca-8f24-2be2aab4cfcb service cinder] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:10.147123 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1089/2192] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:31:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:31:10.154331 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ee0a7b-f81b-4c82-90df-d543616d2ba0 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:10.156486 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-87ee0a7b-f81b-4c82-90df-d543616d2ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:31:10.241690 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ee0a7b-f81b-4c82-90df-d543616d2ba0 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:10.250208 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65a5d9a-3476-4d5c-a0e2-3673dda8d338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:10.251719 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a5d9a-3476-4d5c-a0e2-3673dda8d338 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:10.251719 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a5d9a-3476-4d5c-a0e2-3673dda8d338 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:10.251719 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a5d9a-3476-4d5c-a0e2-3673dda8d338 admin admin] PATH_INFO: `/v3/projects/0af74fa6af954726b57676c7f5291b06` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:10.252029 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0aae03-a55d-421d-8f46-01b16920eabb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a147e14b61d481db1cac02c58ac3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:10.252029 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0aae03-a55d-421d-8f46-01b16920eabb service cinder] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:10.252301 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0aae03-a55d-421d-8f46-01b16920eabb service cinder] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:10.252494 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65a5d9a-3476-4d5c-a0e2-3673dda8d338 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0af74fa6af954726b57676c7f5291b06)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:10.253465 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0aae03-a55d-421d-8f46-01b16920eabb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:10.254595 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65a5d9a-3476-4d5c-a0e2-3673dda8d338 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:10.255503 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-cd0aae03-a55d-421d-8f46-01b16920eabb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:31:10.300805 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:31:10.324426 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-f65a5d9a-3476-4d5c-a0e2-3673dda8d338 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0af74fa6af954726b57676c7f5291b06', 'request_id': 'req-f65a5d9a-3476-4d5c-a0e2-3673dda8d338'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:10.336438 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-f65a5d9a-3476-4d5c-a0e2-3673dda8d338 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0af74fa6af954726b57676c7f5291b06', 'request_id': 'req-f65a5d9a-3476-4d5c-a0e2-3673dda8d338'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:10.345306 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-f65a5d9a-3476-4d5c-a0e2-3673dda8d338 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0af74fa6af954726b57676c7f5291b06', 'request_id': 'req-f65a5d9a-3476-4d5c-a0e2-3673dda8d338'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:10.365210 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-f65a5d9a-3476-4d5c-a0e2-3673dda8d338 admin admin] The token cache is being invalidate because project 0af74fa6af954726b57676c7f5291b06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:31:10.365980 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-f65a5d9a-3476-4d5c-a0e2-3673dda8d338 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:10.367461 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-f65a5d9a-3476-4d5c-a0e2-3673dda8d338 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:10.373711 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1104/2193] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:31:10 2022] DELETE /identity/v3/projects/0af74fa6af954726b57676c7f5291b06 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 05:31:10.375214 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65a5d9a-3476-4d5c-a0e2-3673dda8d338 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:10.376720 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0aae03-a55d-421d-8f46-01b16920eabb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:10.379365 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0aae03-a55d-421d-8f46-01b16920eabb service cinder] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:10.380473 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-f65a5d9a-3476-4d5c-a0e2-3673dda8d338 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:31:10.394683 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1090/2194] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:31:10 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:31:10.483550 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65a5d9a-3476-4d5c-a0e2-3673dda8d338 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:10.501115 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60390e65-9738-45ee-8b84-ee4c53a623c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:10.501785 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60390e65-9738-45ee-8b84-ee4c53a623c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:10.502072 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60390e65-9738-45ee-8b84-ee4c53a623c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:10.502355 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60390e65-9738-45ee-8b84-ee4c53a623c2 admin admin] PATH_INFO: `/v3/users/15a7ea6dd54f484282298431bb59d3c0` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:10.512489 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60390e65-9738-45ee-8b84-ee4c53a623c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15a7ea6dd54f484282298431bb59d3c0)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:10.514478 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60390e65-9738-45ee-8b84-ee4c53a623c2 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:10.591709 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-60390e65-9738-45ee-8b84-ee4c53a623c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15a7ea6dd54f484282298431bb59d3c0'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:10.623912 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0aae03-a55d-421d-8f46-01b16920eabb service cinder] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:10.624343 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-60390e65-9738-45ee-8b84-ee4c53a623c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15a7ea6dd54f484282298431bb59d3c0'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:10.633432 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-60390e65-9738-45ee-8b84-ee4c53a623c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15a7ea6dd54f484282298431bb59d3c0'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:10.640729 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0aae03-a55d-421d-8f46-01b16920eabb service cinder] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:10.654015 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:31:10.674326 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-60390e65-9738-45ee-8b84-ee4c53a623c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15a7ea6dd54f484282298431bb59d3c0'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:10.682682 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-60390e65-9738-45ee-8b84-ee4c53a623c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15a7ea6dd54f484282298431bb59d3c0'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:10.695819 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1105/2195] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:31:10 2022] DELETE /identity/v3/users/15a7ea6dd54f484282298431bb59d3c0 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:31:10.766422 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588bc1a4-66a9-43ef-b46a-4860d061d3db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a147e14b61d481db1cac02c58ac3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:10.768443 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588bc1a4-66a9-43ef-b46a-4860d061d3db service cinder] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:10.768733 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588bc1a4-66a9-43ef-b46a-4860d061d3db service cinder] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:10.769012 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588bc1a4-66a9-43ef-b46a-4860d061d3db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:10.770880 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-588bc1a4-66a9-43ef-b46a-4860d061d3db service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:31:10.856199 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588bc1a4-66a9-43ef-b46a-4860d061d3db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:10.857847 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588bc1a4-66a9-43ef-b46a-4860d061d3db service cinder] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:10.867393 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1091/2196] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:31:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:31:11.068689 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60390e65-9738-45ee-8b84-ee4c53a623c2 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:11.070596 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-60390e65-9738-45ee-8b84-ee4c53a623c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:31:11.127809 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:31:11.173189 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60390e65-9738-45ee-8b84-ee4c53a623c2 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:11.178333 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494c5b0d-a123-45db-9d11-61a0db7262ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:11.178968 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494c5b0d-a123-45db-9d11-61a0db7262ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:11.179261 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494c5b0d-a123-45db-9d11-61a0db7262ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:11.179516 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494c5b0d-a123-45db-9d11-61a0db7262ab admin admin] PATH_INFO: `/v3/projects/bc96bba424b14481bb7ee8e18c68f068` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:11.180933 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494c5b0d-a123-45db-9d11-61a0db7262ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc96bba424b14481bb7ee8e18c68f068)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:11.183330 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494c5b0d-a123-45db-9d11-61a0db7262ab admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:11.255045 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-494c5b0d-a123-45db-9d11-61a0db7262ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc96bba424b14481bb7ee8e18c68f068', 'request_id': 'req-494c5b0d-a123-45db-9d11-61a0db7262ab'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:11.262246 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-494c5b0d-a123-45db-9d11-61a0db7262ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc96bba424b14481bb7ee8e18c68f068', 'request_id': 'req-494c5b0d-a123-45db-9d11-61a0db7262ab'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:11.273475 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-494c5b0d-a123-45db-9d11-61a0db7262ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc96bba424b14481bb7ee8e18c68f068', 'request_id': 'req-494c5b0d-a123-45db-9d11-61a0db7262ab'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:11.287018 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-494c5b0d-a123-45db-9d11-61a0db7262ab admin admin] The token cache is being invalidate because project bc96bba424b14481bb7ee8e18c68f068 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:31:11.287313 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-494c5b0d-a123-45db-9d11-61a0db7262ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:11.287977 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-494c5b0d-a123-45db-9d11-61a0db7262ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:11.289478 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1106/2197] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:31:11 2022] DELETE /identity/v3/projects/bc96bba424b14481bb7ee8e18c68f068 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 05:31:11.296038 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1099795-7b9f-4dda-9d9d-3f8a04e95b63 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:11.296569 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1099795-7b9f-4dda-9d9d-3f8a04e95b63 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:11.296569 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1099795-7b9f-4dda-9d9d-3f8a04e95b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:11.316623 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-e1099795-7b9f-4dda-9d9d-3f8a04e95b63 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:31:11.317814 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-e1099795-7b9f-4dda-9d9d-3f8a04e95b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:31:11.377147 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1092/2198] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:31:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 05:31:11.385579 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137aba94-b766-4bc0-83bd-ca08ee63f862 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:11.386174 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137aba94-b766-4bc0-83bd-ca08ee63f862 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:11.386174 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137aba94-b766-4bc0-83bd-ca08ee63f862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:11.405976 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-137aba94-b766-4bc0-83bd-ca08ee63f862 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:31:11.407176 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-137aba94-b766-4bc0-83bd-ca08ee63f862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:31:11.415169 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1107/2199] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:31:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:31:11.419216 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1099795-7b9f-4dda-9d9d-3f8a04e95b63 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:11.428902 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1099795-7b9f-4dda-9d9d-3f8a04e95b63 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:11.433667 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60230f10-67bf-43cc-baf8-ab78c46091ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:11.434351 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60230f10-67bf-43cc-baf8-ab78c46091ef admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:11.434636 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60230f10-67bf-43cc-baf8-ab78c46091ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:11.434921 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60230f10-67bf-43cc-baf8-ab78c46091ef admin admin] PATH_INFO: `/v3/domains` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:11.435568 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60230f10-67bf-43cc-baf8-ab78c46091ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:31:11.435903 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60230f10-67bf-43cc-baf8-ab78c46091ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:11.437657 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60230f10-67bf-43cc-baf8-ab78c46091ef admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:11.455912 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1093/2200] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 05:31:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:31:11.457037 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137aba94-b766-4bc0-83bd-ca08ee63f862 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:11.467144 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137aba94-b766-4bc0-83bd-ca08ee63f862 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:11.472838 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df481f7a-aedb-481f-86dd-3efd6e98d8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:11.473482 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df481f7a-aedb-481f-86dd-3efd6e98d8e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:11.473778 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df481f7a-aedb-481f-86dd-3efd6e98d8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:11.474053 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df481f7a-aedb-481f-86dd-3efd6e98d8e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:11.474774 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df481f7a-aedb-481f-86dd-3efd6e98d8e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:11.476846 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df481f7a-aedb-481f-86dd-3efd6e98d8e4 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:11.504516 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1108/2201] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:31:11 2022] POST /identity/v3/projects => generated 399 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 05:31:11.509542 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60230f10-67bf-43cc-baf8-ab78c46091ef admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:11.519349 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60230f10-67bf-43cc-baf8-ab78c46091ef admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:11.567110 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:31:11.580294 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f05aa02-8eb1-4da6-ba3b-fbea37313430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:11.580910 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f05aa02-8eb1-4da6-ba3b-fbea37313430 admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:11.581184 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f05aa02-8eb1-4da6-ba3b-fbea37313430 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:11.581455 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f05aa02-8eb1-4da6-ba3b-fbea37313430 admin admin] PATH_INFO: `/v3/users` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:11.582095 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f05aa02-8eb1-4da6-ba3b-fbea37313430 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:11.584023 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f05aa02-8eb1-4da6-ba3b-fbea37313430 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:11.609913 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1094/2202] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:31:11 2022] POST /identity/v3/users => generated 300 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:31:11.614216 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df481f7a-aedb-481f-86dd-3efd6e98d8e4 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:11.625797 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df481f7a-aedb-481f-86dd-3efd6e98d8e4 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:11.630836 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8930e730-9d25-4079-9f2f-f7ee5a5f2e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:11.631482 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8930e730-9d25-4079-9f2f-f7ee5a5f2e0b admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:11.631790 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8930e730-9d25-4079-9f2f-f7ee5a5f2e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:11.632067 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8930e730-9d25-4079-9f2f-f7ee5a5f2e0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:11.632716 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8930e730-9d25-4079-9f2f-f7ee5a5f2e0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:11.634894 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8930e730-9d25-4079-9f2f-f7ee5a5f2e0b admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:11.647712 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1109/2203] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:31:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:31:11.649380 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f05aa02-8eb1-4da6-ba3b-fbea37313430 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:11.659935 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f05aa02-8eb1-4da6-ba3b-fbea37313430 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:11.664635 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0f0769-a907-4e12-9f09-aeea3e97ca78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:11.665269 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0f0769-a907-4e12-9f09-aeea3e97ca78 admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:11.665573 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0f0769-a907-4e12-9f09-aeea3e97ca78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:11.666196 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0f0769-a907-4e12-9f09-aeea3e97ca78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:11.666491 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0f0769-a907-4e12-9f09-aeea3e97ca78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:11.668141 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0f0769-a907-4e12-9f09-aeea3e97ca78 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:11.683099 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1095/2204] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:31:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:31:11.684320 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8930e730-9d25-4079-9f2f-f7ee5a5f2e0b admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:11.695373 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8930e730-9d25-4079-9f2f-f7ee5a5f2e0b admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:11.700964 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3220f3-c294-4985-8310-781b09e71efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:11.701622 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3220f3-c294-4985-8310-781b09e71efd admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:11.701920 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3220f3-c294-4985-8310-781b09e71efd admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:11.702182 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3220f3-c294-4985-8310-781b09e71efd admin admin] PATH_INFO: `/v3/projects/ac9a98caaa9745d7b1eaaadd6b191798/users/e856a777de1d442abd55d1c4fd58e192/roles/aa7ff8e0ec1e48e5811335b9eb38b448` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:11.717532 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3220f3-c294-4985-8310-781b09e71efd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac9a98caaa9745d7b1eaaadd6b191798, user_id=e856a777de1d442abd55d1c4fd58e192, role_id=aa7ff8e0ec1e48e5811335b9eb38b448)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:11.720289 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3220f3-c294-4985-8310-781b09e71efd admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:11.748046 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1110/2205] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:31:11 2022] PUT /identity/v3/projects/ac9a98caaa9745d7b1eaaadd6b191798/users/e856a777de1d442abd55d1c4fd58e192/roles/aa7ff8e0ec1e48e5811335b9eb38b448 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:31:11.757746 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af33a8-fc4e-4a6f-a3b0-30f0f224b908 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:11.758256 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af33a8-fc4e-4a6f-a3b0-30f0f224b908 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:11.758705 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af33a8-fc4e-4a6f-a3b0-30f0f224b908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:11.828824 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-a9af33a8-fc4e-4a6f-a3b0-30f0f224b908 None None] MFA Rules not processed for user `e856a777de1d442abd55d1c4fd58e192`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:31:11.830104 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-a9af33a8-fc4e-4a6f-a3b0-30f0f224b908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:31:11.949234 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1096/2206] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:31:11 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:31:11.960110 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3220f3-c294-4985-8310-781b09e71efd admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:11.963365 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-3c3220f3-c294-4985-8310-781b09e71efd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:31:12.034232 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3220f3-c294-4985-8310-781b09e71efd admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:12.039964 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3b64e4-7b83-4a65-9688-58a1292f05f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a147e14b61d481db1cac02c58ac3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:12.041104 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3b64e4-7b83-4a65-9688-58a1292f05f8 service cinder] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:12.041378 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3b64e4-7b83-4a65-9688-58a1292f05f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:12.041642 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3b64e4-7b83-4a65-9688-58a1292f05f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:12.051162 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3b64e4-7b83-4a65-9688-58a1292f05f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:12.052764 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3b64e4-7b83-4a65-9688-58a1292f05f8 service cinder] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:12.067967 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1111/2207] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:31:11 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:31:14.131952 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9af33a8-fc4e-4a6f-a3b0-30f0f224b908 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:14.133455 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-a9af33a8-fc4e-4a6f-a3b0-30f0f224b908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:31:14.206794 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9af33a8-fc4e-4a6f-a3b0-30f0f224b908 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:14.211228 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce9b495-9015-4626-8fdb-78a9784dcb8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:14.211892 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce9b495-9015-4626-8fdb-78a9784dcb8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:14.212206 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce9b495-9015-4626-8fdb-78a9784dcb8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:14.212481 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce9b495-9015-4626-8fdb-78a9784dcb8f admin admin] PATH_INFO: `/v3/users/d710f196af184bd0a8cce3c204f14114` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:14.213611 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce9b495-9015-4626-8fdb-78a9784dcb8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d710f196af184bd0a8cce3c204f14114)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:14.215548 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce9b495-9015-4626-8fdb-78a9784dcb8f admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:14.264251 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-3ce9b495-9015-4626-8fdb-78a9784dcb8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd710f196af184bd0a8cce3c204f14114'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:14.272232 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:31:14.277775 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-3ce9b495-9015-4626-8fdb-78a9784dcb8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd710f196af184bd0a8cce3c204f14114'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:14.285778 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-3ce9b495-9015-4626-8fdb-78a9784dcb8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd710f196af184bd0a8cce3c204f14114'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:14.293510 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-3ce9b495-9015-4626-8fdb-78a9784dcb8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd710f196af184bd0a8cce3c204f14114'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:14.294179 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-3ce9b495-9015-4626-8fdb-78a9784dcb8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd710f196af184bd0a8cce3c204f14114'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:14.305429 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1097/2208] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:31:14 2022] DELETE /identity/v3/users/d710f196af184bd0a8cce3c204f14114 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:31:14.311010 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7d293-9432-41e1-b170-ee2717e690bb None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:14.311505 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7d293-9432-41e1-b170-ee2717e690bb None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:14.311732 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7d293-9432-41e1-b170-ee2717e690bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:14.332609 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-88f7d293-9432-41e1-b170-ee2717e690bb None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:31:14.333808 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-88f7d293-9432-41e1-b170-ee2717e690bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:31:14.337733 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:31:14.393454 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1112/2209] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:31:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:31:14.403104 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce9b495-9015-4626-8fdb-78a9784dcb8f admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:14.404582 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-3ce9b495-9015-4626-8fdb-78a9784dcb8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:31:14.466149 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce9b495-9015-4626-8fdb-78a9784dcb8f admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:14.469857 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4abd3b1-f9ab-485d-8e51-d3daeca1e48f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:14.470473 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4abd3b1-f9ab-485d-8e51-d3daeca1e48f service neutron] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:14.470754 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4abd3b1-f9ab-485d-8e51-d3daeca1e48f service neutron] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:14.471029 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4abd3b1-f9ab-485d-8e51-d3daeca1e48f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:14.481512 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4abd3b1-f9ab-485d-8e51-d3daeca1e48f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:14.482964 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4abd3b1-f9ab-485d-8e51-d3daeca1e48f service neutron] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:14.493143 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1098/2210] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:31:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:31:14.775084 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f7d293-9432-41e1-b170-ee2717e690bb None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:14.776580 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-88f7d293-9432-41e1-b170-ee2717e690bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:31:14.797551 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f7d293-9432-41e1-b170-ee2717e690bb None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:14.814174 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e73533a-a38a-4ad4-a402-2ec48377bedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:14.814838 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e73533a-a38a-4ad4-a402-2ec48377bedd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:14.815104 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e73533a-a38a-4ad4-a402-2ec48377bedd admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:14.815377 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e73533a-a38a-4ad4-a402-2ec48377bedd admin admin] PATH_INFO: `/v3/projects/3fe0749e43f04de6877a332363e00788` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:14.816667 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e73533a-a38a-4ad4-a402-2ec48377bedd admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fe0749e43f04de6877a332363e00788)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:14.818563 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e73533a-a38a-4ad4-a402-2ec48377bedd admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:14.869214 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-7e73533a-a38a-4ad4-a402-2ec48377bedd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fe0749e43f04de6877a332363e00788', 'request_id': 'req-7e73533a-a38a-4ad4-a402-2ec48377bedd'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:14.875341 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-7e73533a-a38a-4ad4-a402-2ec48377bedd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fe0749e43f04de6877a332363e00788', 'request_id': 'req-7e73533a-a38a-4ad4-a402-2ec48377bedd'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:14.883412 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-7e73533a-a38a-4ad4-a402-2ec48377bedd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fe0749e43f04de6877a332363e00788', 'request_id': 'req-7e73533a-a38a-4ad4-a402-2ec48377bedd'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:14.896681 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-7e73533a-a38a-4ad4-a402-2ec48377bedd admin admin] The token cache is being invalidate because project 3fe0749e43f04de6877a332363e00788 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:31:14.896963 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-7e73533a-a38a-4ad4-a402-2ec48377bedd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:14.897579 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-7e73533a-a38a-4ad4-a402-2ec48377bedd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:14.899239 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1113/2211] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:31:14 2022] DELETE /identity/v3/projects/3fe0749e43f04de6877a332363e00788 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 05:31:14.905379 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba3fc8-d467-4e01-979b-dab0afab1a70 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:14.905665 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba3fc8-d467-4e01-979b-dab0afab1a70 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:14.905927 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba3fc8-d467-4e01-979b-dab0afab1a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:14.927719 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-34ba3fc8-d467-4e01-979b-dab0afab1a70 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:31:14.929382 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-34ba3fc8-d467-4e01-979b-dab0afab1a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:31:15.001239 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1099/2212] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:31:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:31:15.009931 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9c2b05-96d1-4e24-8f69-6b4cc2b13168 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:15.010250 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9c2b05-96d1-4e24-8f69-6b4cc2b13168 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:15.010540 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9c2b05-96d1-4e24-8f69-6b4cc2b13168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:15.058870 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-5a9c2b05-96d1-4e24-8f69-6b4cc2b13168 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:31:15.060297 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-5a9c2b05-96d1-4e24-8f69-6b4cc2b13168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:31:15.076594 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1114/2213] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:31:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:31:15.081637 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ba3fc8-d467-4e01-979b-dab0afab1a70 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:15.094024 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ba3fc8-d467-4e01-979b-dab0afab1a70 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:15.105032 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb09016e-5ce2-48b6-8c60-4063d8000cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:15.105663 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb09016e-5ce2-48b6-8c60-4063d8000cc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:15.106017 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb09016e-5ce2-48b6-8c60-4063d8000cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:15.106430 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb09016e-5ce2-48b6-8c60-4063d8000cc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:15.107083 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb09016e-5ce2-48b6-8c60-4063d8000cc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:31:15.107391 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb09016e-5ce2-48b6-8c60-4063d8000cc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:15.109484 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb09016e-5ce2-48b6-8c60-4063d8000cc2 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:15.135240 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1100/2214] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 05:31:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:31:15.140025 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9c2b05-96d1-4e24-8f69-6b4cc2b13168 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:15.158208 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9c2b05-96d1-4e24-8f69-6b4cc2b13168 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:15.167296 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714daf0e-f267-4c46-be6d-7747eabca829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:15.172864 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714daf0e-f267-4c46-be6d-7747eabca829 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:15.173311 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714daf0e-f267-4c46-be6d-7747eabca829 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:15.173592 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714daf0e-f267-4c46-be6d-7747eabca829 admin admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:15.174232 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714daf0e-f267-4c46-be6d-7747eabca829 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:15.176185 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714daf0e-f267-4c46-be6d-7747eabca829 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:15.209338 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1115/2215] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:31:15 2022] POST /identity/v3/projects => generated 369 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:31:15.210537 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb09016e-5ce2-48b6-8c60-4063d8000cc2 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:15.227460 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb09016e-5ce2-48b6-8c60-4063d8000cc2 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:15.358521 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc65b73-fb30-4e69-a3f5-7eaefc3ae26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:15.359139 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc65b73-fb30-4e69-a3f5-7eaefc3ae26c admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:15.359419 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc65b73-fb30-4e69-a3f5-7eaefc3ae26c admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:15.359731 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc65b73-fb30-4e69-a3f5-7eaefc3ae26c admin admin] PATH_INFO: `/v3/users` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:15.360428 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc65b73-fb30-4e69-a3f5-7eaefc3ae26c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:15.362512 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc65b73-fb30-4e69-a3f5-7eaefc3ae26c admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:15.374791 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:31:15.391662 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1101/2216] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:31:15 2022] POST /identity/v3/users => generated 285 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:31:15.392972 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714daf0e-f267-4c46-be6d-7747eabca829 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:15.404360 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714daf0e-f267-4c46-be6d-7747eabca829 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:15.409240 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3120ca03-029a-4840-897d-bb0e817fb952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:15.409847 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3120ca03-029a-4840-897d-bb0e817fb952 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:15.410146 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3120ca03-029a-4840-897d-bb0e817fb952 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:15.410415 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3120ca03-029a-4840-897d-bb0e817fb952 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:15.411112 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3120ca03-029a-4840-897d-bb0e817fb952 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:15.412800 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3120ca03-029a-4840-897d-bb0e817fb952 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:15.429345 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1116/2217] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:31:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:31:15.430564 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc65b73-fb30-4e69-a3f5-7eaefc3ae26c admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:15.441586 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc65b73-fb30-4e69-a3f5-7eaefc3ae26c admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:15.448840 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f21f972-c0cd-47ce-82e3-96825032954f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:15.449500 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f21f972-c0cd-47ce-82e3-96825032954f admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:15.449783 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f21f972-c0cd-47ce-82e3-96825032954f admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:15.450050 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f21f972-c0cd-47ce-82e3-96825032954f admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:15.450722 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f21f972-c0cd-47ce-82e3-96825032954f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:15.452346 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f21f972-c0cd-47ce-82e3-96825032954f admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:15.464203 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1102/2218] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:31:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:31:15.468350 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3120ca03-029a-4840-897d-bb0e817fb952 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:15.478553 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3120ca03-029a-4840-897d-bb0e817fb952 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:15.483951 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45721059-40d2-48cc-b405-d3a5dd7c034a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:15.484620 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45721059-40d2-48cc-b405-d3a5dd7c034a admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:15.484904 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45721059-40d2-48cc-b405-d3a5dd7c034a admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:15.485179 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45721059-40d2-48cc-b405-d3a5dd7c034a admin admin] PATH_INFO: `/v3/projects/fea5fdcc7ea24a3a9c28492cf72d2de8/users/91a510eae3fd4799b8a2b84f59dc4794/roles/aa7ff8e0ec1e48e5811335b9eb38b448` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:15.501232 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45721059-40d2-48cc-b405-d3a5dd7c034a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fea5fdcc7ea24a3a9c28492cf72d2de8, user_id=91a510eae3fd4799b8a2b84f59dc4794, role_id=aa7ff8e0ec1e48e5811335b9eb38b448)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:15.503983 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45721059-40d2-48cc-b405-d3a5dd7c034a admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:15.518183 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1117/2219] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:31:15 2022] PUT /identity/v3/projects/fea5fdcc7ea24a3a9c28492cf72d2de8/users/91a510eae3fd4799b8a2b84f59dc4794/roles/aa7ff8e0ec1e48e5811335b9eb38b448 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:31:15.529421 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f2a27-3479-46d5-9f40-a4d6ec84eb13 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:15.529705 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f2a27-3479-46d5-9f40-a4d6ec84eb13 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:15.530001 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f2a27-3479-46d5-9f40-a4d6ec84eb13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:15.558851 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-b10f2a27-3479-46d5-9f40-a4d6ec84eb13 None None] MFA Rules not processed for user `91a510eae3fd4799b8a2b84f59dc4794`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:31:15.560130 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-b10f2a27-3479-46d5-9f40-a4d6ec84eb13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:31:15.634641 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1103/2220] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:31:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:31:15.648824 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45721059-40d2-48cc-b405-d3a5dd7c034a admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:15.650639 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-45721059-40d2-48cc-b405-d3a5dd7c034a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:31:15.686654 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:31:15.717563 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45721059-40d2-48cc-b405-d3a5dd7c034a admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:15.721557 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecd0f68-fe74-429a-be99-7adf9932b2e8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdd09106382447e9bf8b3a6a9ada89b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:15.722173 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd0f68-fe74-429a-be99-7adf9932b2e8 service glance] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:15.722448 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd0f68-fe74-429a-be99-7adf9932b2e8 service glance] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:15.722716 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd0f68-fe74-429a-be99-7adf9932b2e8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:15.731724 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecd0f68-fe74-429a-be99-7adf9932b2e8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:15.733105 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecd0f68-fe74-429a-be99-7adf9932b2e8 service glance] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:15.748616 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1118/2221] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:31:15 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:31:17.556307 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10625207-c58b-49cd-96ed-fa92ffb63c73 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:17.556786 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10625207-c58b-49cd-96ed-fa92ffb63c73 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:17.556972 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10625207-c58b-49cd-96ed-fa92ffb63c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:17.579276 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecd0f68-fe74-429a-be99-7adf9932b2e8 service glance] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:17.580841 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-6ecd0f68-fe74-429a-be99-7adf9932b2e8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:31:17.582192 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-10625207-c58b-49cd-96ed-fa92ffb63c73 None None] MFA Rules not processed for user `da72fe720a584bba9dc2dafacdeac67d`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:31:17.583363 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-10625207-c58b-49cd-96ed-fa92ffb63c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:31:17.652486 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1104/2222] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:31:17 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:31:17.661277 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecd0f68-fe74-429a-be99-7adf9932b2e8 service glance] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:17.665940 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e56cc4-9d9a-4174-9819-28ba6e1833f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:17.666659 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e56cc4-9d9a-4174-9819-28ba6e1833f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:17.667003 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e56cc4-9d9a-4174-9819-28ba6e1833f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:17.667344 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e56cc4-9d9a-4174-9819-28ba6e1833f4 admin admin] PATH_INFO: `/v3/users/e856a777de1d442abd55d1c4fd58e192` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:17.668565 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e56cc4-9d9a-4174-9819-28ba6e1833f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e856a777de1d442abd55d1c4fd58e192)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:17.670553 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e56cc4-9d9a-4174-9819-28ba6e1833f4 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:17.718833 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-c6e56cc4-9d9a-4174-9819-28ba6e1833f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e856a777de1d442abd55d1c4fd58e192'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:17.730446 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-c6e56cc4-9d9a-4174-9819-28ba6e1833f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e856a777de1d442abd55d1c4fd58e192'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:17.737515 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-c6e56cc4-9d9a-4174-9819-28ba6e1833f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e856a777de1d442abd55d1c4fd58e192'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:17.746083 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-c6e56cc4-9d9a-4174-9819-28ba6e1833f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e856a777de1d442abd55d1c4fd58e192'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:17.746765 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-c6e56cc4-9d9a-4174-9819-28ba6e1833f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e856a777de1d442abd55d1c4fd58e192'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:17.753363 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1119/2223] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:31:17 2022] DELETE /identity/v3/users/e856a777de1d442abd55d1c4fd58e192 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 05:31:17.757886 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e411ae61-e583-4bfa-8cc6-1568707a1142 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:17.758175 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e411ae61-e583-4bfa-8cc6-1568707a1142 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:17.758452 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e411ae61-e583-4bfa-8cc6-1568707a1142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:17.777957 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-e411ae61-e583-4bfa-8cc6-1568707a1142 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:31:17.779181 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-e411ae61-e583-4bfa-8cc6-1568707a1142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:31:17.842875 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1105/2224] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:31:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:31:17.852762 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e56cc4-9d9a-4174-9819-28ba6e1833f4 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:17.854171 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-c6e56cc4-9d9a-4174-9819-28ba6e1833f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:31:17.914315 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e56cc4-9d9a-4174-9819-28ba6e1833f4 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:17.918026 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb72c2b8-fcab-42cb-8183-2c73a391e80c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:17.918653 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb72c2b8-fcab-42cb-8183-2c73a391e80c service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:17.918935 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb72c2b8-fcab-42cb-8183-2c73a391e80c service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:17.919210 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb72c2b8-fcab-42cb-8183-2c73a391e80c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:17.925989 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:31:17.933484 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb72c2b8-fcab-42cb-8183-2c73a391e80c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:17.935626 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb72c2b8-fcab-42cb-8183-2c73a391e80c service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:17.948786 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1120/2225] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:31:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:31:18.250201 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e411ae61-e583-4bfa-8cc6-1568707a1142 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:18.251693 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-e411ae61-e583-4bfa-8cc6-1568707a1142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:31:18.265529 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e411ae61-e583-4bfa-8cc6-1568707a1142 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:18.276763 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c5e0c8-ec82-4b22-b94d-70e5f6fca7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:18.278388 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c5e0c8-ec82-4b22-b94d-70e5f6fca7cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:18.278831 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c5e0c8-ec82-4b22-b94d-70e5f6fca7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:18.280059 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c5e0c8-ec82-4b22-b94d-70e5f6fca7cd admin admin] PATH_INFO: `/v3/projects/ac9a98caaa9745d7b1eaaadd6b191798` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:18.281426 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c5e0c8-ec82-4b22-b94d-70e5f6fca7cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac9a98caaa9745d7b1eaaadd6b191798)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:18.283598 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c5e0c8-ec82-4b22-b94d-70e5f6fca7cd admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:18.309150 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:31:18.341064 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-77c5e0c8-ec82-4b22-b94d-70e5f6fca7cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac9a98caaa9745d7b1eaaadd6b191798', 'request_id': 'req-77c5e0c8-ec82-4b22-b94d-70e5f6fca7cd'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:18.348292 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-77c5e0c8-ec82-4b22-b94d-70e5f6fca7cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac9a98caaa9745d7b1eaaadd6b191798', 'request_id': 'req-77c5e0c8-ec82-4b22-b94d-70e5f6fca7cd'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:18.354717 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-77c5e0c8-ec82-4b22-b94d-70e5f6fca7cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac9a98caaa9745d7b1eaaadd6b191798', 'request_id': 'req-77c5e0c8-ec82-4b22-b94d-70e5f6fca7cd'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:18.367251 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-77c5e0c8-ec82-4b22-b94d-70e5f6fca7cd admin admin] The token cache is being invalidate because project ac9a98caaa9745d7b1eaaadd6b191798 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81383) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:31:18.367606 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-77c5e0c8-ec82-4b22-b94d-70e5f6fca7cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:18.369071 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-77c5e0c8-ec82-4b22-b94d-70e5f6fca7cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:18.372314 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1106/2226] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:31:18 2022] DELETE /identity/v3/projects/ac9a98caaa9745d7b1eaaadd6b191798 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:31:27.943444 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=3 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:31:28.363119 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=18,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:31:39.232770 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb72c2b8-fcab-42cb-8183-2c73a391e80c service neutron] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:39.234251 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-eb72c2b8-fcab-42cb-8183-2c73a391e80c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:31:39.248272 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb72c2b8-fcab-42cb-8183-2c73a391e80c service neutron] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:39.319282 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b971c0-55af-4dc8-8618-b255f43e79c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:39.319962 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b971c0-55af-4dc8-8618-b255f43e79c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:39.320242 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b971c0-55af-4dc8-8618-b255f43e79c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:39.320513 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b971c0-55af-4dc8-8618-b255f43e79c2 admin admin] PATH_INFO: `/v3/users/38fdeec7615b471cab400ba119e490eb` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:39.321691 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b971c0-55af-4dc8-8618-b255f43e79c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38fdeec7615b471cab400ba119e490eb)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:39.323631 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b971c0-55af-4dc8-8618-b255f43e79c2 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:39.373949 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-87b971c0-55af-4dc8-8618-b255f43e79c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38fdeec7615b471cab400ba119e490eb'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:39.386464 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-87b971c0-55af-4dc8-8618-b255f43e79c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38fdeec7615b471cab400ba119e490eb'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:39.394463 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-87b971c0-55af-4dc8-8618-b255f43e79c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38fdeec7615b471cab400ba119e490eb'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:39.402578 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-87b971c0-55af-4dc8-8618-b255f43e79c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38fdeec7615b471cab400ba119e490eb'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:39.403266 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-87b971c0-55af-4dc8-8618-b255f43e79c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38fdeec7615b471cab400ba119e490eb'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:39.409618 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1121/2227] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:31:39 2022] DELETE /identity/v3/users/38fdeec7615b471cab400ba119e490eb => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:31:39.414037 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c10db-cf61-4b5d-898b-83b85c7b69d4 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:39.414528 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c10db-cf61-4b5d-898b-83b85c7b69d4 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:39.414623 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c10db-cf61-4b5d-898b-83b85c7b69d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:39.438325 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-6e5c10db-cf61-4b5d-898b-83b85c7b69d4 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:31:39.439670 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-6e5c10db-cf61-4b5d-898b-83b85c7b69d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:31:39.502080 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1107/2228] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:31:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 05:31:39.512342 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b971c0-55af-4dc8-8618-b255f43e79c2 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:39.514775 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-87b971c0-55af-4dc8-8618-b255f43e79c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:31:39.593938 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b971c0-55af-4dc8-8618-b255f43e79c2 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:39.599933 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebd20cb-b1b4-44c9-9720-79a9a538d892 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:39.601008 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebd20cb-b1b4-44c9-9720-79a9a538d892 service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:39.601451 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebd20cb-b1b4-44c9-9720-79a9a538d892 service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:39.602423 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebd20cb-b1b4-44c9-9720-79a9a538d892 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:39.615067 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebd20cb-b1b4-44c9-9720-79a9a538d892 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:39.616726 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebd20cb-b1b4-44c9-9720-79a9a538d892 service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:39.632111 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1122/2229] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:31:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:31:40.635157 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c10db-cf61-4b5d-898b-83b85c7b69d4 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:40.635157 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-6e5c10db-cf61-4b5d-898b-83b85c7b69d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:31:40.656404 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c10db-cf61-4b5d-898b-83b85c7b69d4 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:40.662298 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14ba387-3533-4888-876d-dd2eb48d3035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:40.663048 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ba387-3533-4888-876d-dd2eb48d3035 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:40.663400 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ba387-3533-4888-876d-dd2eb48d3035 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:40.664045 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ba387-3533-4888-876d-dd2eb48d3035 admin admin] PATH_INFO: `/v3/projects/fbb7712b94ab4298a2dfc65c722b0f2d` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:40.667414 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14ba387-3533-4888-876d-dd2eb48d3035 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbb7712b94ab4298a2dfc65c722b0f2d)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:40.670385 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14ba387-3533-4888-876d-dd2eb48d3035 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:40.743969 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-f14ba387-3533-4888-876d-dd2eb48d3035 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbb7712b94ab4298a2dfc65c722b0f2d', 'request_id': 'req-f14ba387-3533-4888-876d-dd2eb48d3035'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:40.753460 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-f14ba387-3533-4888-876d-dd2eb48d3035 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbb7712b94ab4298a2dfc65c722b0f2d', 'request_id': 'req-f14ba387-3533-4888-876d-dd2eb48d3035'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:40.764451 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-f14ba387-3533-4888-876d-dd2eb48d3035 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbb7712b94ab4298a2dfc65c722b0f2d', 'request_id': 'req-f14ba387-3533-4888-876d-dd2eb48d3035'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:40.775968 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-f14ba387-3533-4888-876d-dd2eb48d3035 admin admin] The token cache is being invalidate because project fbb7712b94ab4298a2dfc65c722b0f2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81383) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:31:40.776264 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-f14ba387-3533-4888-876d-dd2eb48d3035 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:40.776920 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-f14ba387-3533-4888-876d-dd2eb48d3035 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:40.778412 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1108/2230] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:31:40 2022] DELETE /identity/v3/projects/fbb7712b94ab4298a2dfc65c722b0f2d => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:31:40.784059 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189edf90-ac1a-4874-b24d-2b0e772aa324 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:40.784537 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189edf90-ac1a-4874-b24d-2b0e772aa324 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:40.784627 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189edf90-ac1a-4874-b24d-2b0e772aa324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:40.810810 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-189edf90-ac1a-4874-b24d-2b0e772aa324 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:31:40.812344 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-189edf90-ac1a-4874-b24d-2b0e772aa324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:31:40.830174 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:31:40.863522 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14ba387-3533-4888-876d-dd2eb48d3035 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:40.865224 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-f14ba387-3533-4888-876d-dd2eb48d3035 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:31:40.881213 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1123/2231] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:31:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:31:40.889329 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f63c86-c58c-4423-a5e2-4f90cd3d1314 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:40.889612 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f63c86-c58c-4423-a5e2-4f90cd3d1314 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:40.889884 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f63c86-c58c-4423-a5e2-4f90cd3d1314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:40.908697 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-d0f63c86-c58c-4423-a5e2-4f90cd3d1314 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:31:40.910460 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-d0f63c86-c58c-4423-a5e2-4f90cd3d1314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:31:40.918240 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1124/2232] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:31:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 05:31:40.922349 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f63c86-c58c-4423-a5e2-4f90cd3d1314 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:40.931337 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f63c86-c58c-4423-a5e2-4f90cd3d1314 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:40.936472 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fae176e-260d-442d-b633-4c033f7c02bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:40.937047 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fae176e-260d-442d-b633-4c033f7c02bb admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:40.937318 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fae176e-260d-442d-b633-4c033f7c02bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:40.937583 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fae176e-260d-442d-b633-4c033f7c02bb admin admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:40.938213 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fae176e-260d-442d-b633-4c033f7c02bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:31:40.938512 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fae176e-260d-442d-b633-4c033f7c02bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:40.938967 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14ba387-3533-4888-876d-dd2eb48d3035 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:40.940126 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fae176e-260d-442d-b633-4c033f7c02bb admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:40.943809 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2ffeac-f31a-4ff0-8771-339a7d3d9d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:40.944444 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ffeac-f31a-4ff0-8771-339a7d3d9d0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:40.944726 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ffeac-f31a-4ff0-8771-339a7d3d9d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:40.945008 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ffeac-f31a-4ff0-8771-339a7d3d9d0a admin admin] PATH_INFO: `/v3/users/8f259a7d50734a129b27954e33fb1200` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:40.946161 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2ffeac-f31a-4ff0-8771-339a7d3d9d0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f259a7d50734a129b27954e33fb1200)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:40.948714 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2ffeac-f31a-4ff0-8771-339a7d3d9d0a admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:40.952404 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1125/2233] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 05:31:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:31:40.958228 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fae176e-260d-442d-b633-4c033f7c02bb admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:40.968223 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fae176e-260d-442d-b633-4c033f7c02bb admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:40.972937 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b606d5f-9393-4d0a-b309-bc1880b37587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:40.973636 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b606d5f-9393-4d0a-b309-bc1880b37587 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:40.973975 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b606d5f-9393-4d0a-b309-bc1880b37587 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:40.974317 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b606d5f-9393-4d0a-b309-bc1880b37587 admin admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:40.975013 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b606d5f-9393-4d0a-b309-bc1880b37587 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:40.977655 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b606d5f-9393-4d0a-b309-bc1880b37587 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:40.981139 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:31:41.008034 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-6f2ffeac-f31a-4ff0-8771-339a7d3d9d0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f259a7d50734a129b27954e33fb1200'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:41.011717 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1126/2234] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:31:40 2022] POST /identity/v3/projects => generated 371 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 05:31:41.016281 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b606d5f-9393-4d0a-b309-bc1880b37587 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:41.025404 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-6f2ffeac-f31a-4ff0-8771-339a7d3d9d0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f259a7d50734a129b27954e33fb1200'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:41.034217 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-6f2ffeac-f31a-4ff0-8771-339a7d3d9d0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f259a7d50734a129b27954e33fb1200'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:41.044367 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-6f2ffeac-f31a-4ff0-8771-339a7d3d9d0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f259a7d50734a129b27954e33fb1200'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:41.049424 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-6f2ffeac-f31a-4ff0-8771-339a7d3d9d0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f259a7d50734a129b27954e33fb1200'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:41.064891 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1109/2235] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:31:40 2022] DELETE /identity/v3/users/8f259a7d50734a129b27954e33fb1200 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 05:31:41.069864 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea24b5-cbf0-4ba9-9546-eed43137cd3a None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:41.070289 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea24b5-cbf0-4ba9-9546-eed43137cd3a None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:41.070674 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea24b5-cbf0-4ba9-9546-eed43137cd3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:41.095140 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-25ea24b5-cbf0-4ba9-9546-eed43137cd3a None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:31:41.096564 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-25ea24b5-cbf0-4ba9-9546-eed43137cd3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:31:41.111645 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b606d5f-9393-4d0a-b309-bc1880b37587 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:41.168339 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1110/2236] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:31:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 05:31:41.185805 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ea24b5-cbf0-4ba9-9546-eed43137cd3a None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:41.187984 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-25ea24b5-cbf0-4ba9-9546-eed43137cd3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:31:41.194069 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd94e2b8-e1dd-4e96-8877-4fd89b66c642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:41.194833 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd94e2b8-e1dd-4e96-8877-4fd89b66c642 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:41.195462 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd94e2b8-e1dd-4e96-8877-4fd89b66c642 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:41.195462 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd94e2b8-e1dd-4e96-8877-4fd89b66c642 admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:41.196064 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd94e2b8-e1dd-4e96-8877-4fd89b66c642 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:41.198028 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd94e2b8-e1dd-4e96-8877-4fd89b66c642 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:41.230370 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1127/2237] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:31:41 2022] POST /identity/v3/users => generated 286 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 05:31:41.236577 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd94e2b8-e1dd-4e96-8877-4fd89b66c642 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:41.240309 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-dd94e2b8-e1dd-4e96-8877-4fd89b66c642 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:31:41.265561 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd94e2b8-e1dd-4e96-8877-4fd89b66c642 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:41.270774 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ea24b5-cbf0-4ba9-9546-eed43137cd3a None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:41.272467 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71f1c15-c970-4ff1-afc3-f9fac5e82003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:41.273477 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f1c15-c970-4ff1-afc3-f9fac5e82003 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:41.273745 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f1c15-c970-4ff1-afc3-f9fac5e82003 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:41.274009 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f1c15-c970-4ff1-afc3-f9fac5e82003 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:41.274682 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71f1c15-c970-4ff1-afc3-f9fac5e82003 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:41.275805 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f385c8dd-c7ca-4b9b-b9ec-6171f329acfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:41.276542 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f385c8dd-c7ca-4b9b-b9ec-6171f329acfa service neutron] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:41.276676 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71f1c15-c970-4ff1-afc3-f9fac5e82003 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:41.277814 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f385c8dd-c7ca-4b9b-b9ec-6171f329acfa service neutron] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:41.278165 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f385c8dd-c7ca-4b9b-b9ec-6171f329acfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:41.289618 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f385c8dd-c7ca-4b9b-b9ec-6171f329acfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:41.291163 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f385c8dd-c7ca-4b9b-b9ec-6171f329acfa service neutron] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:41.296116 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1128/2238] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:31:41 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:31:41.297588 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71f1c15-c970-4ff1-afc3-f9fac5e82003 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:41.302831 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1111/2239] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:31:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 05:31:41.309582 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71f1c15-c970-4ff1-afc3-f9fac5e82003 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:41.316375 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3960c7f2-5dd5-407b-a7ed-a4700c952488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:41.317323 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3960c7f2-5dd5-407b-a7ed-a4700c952488 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:41.317609 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3960c7f2-5dd5-407b-a7ed-a4700c952488 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:41.318038 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3960c7f2-5dd5-407b-a7ed-a4700c952488 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:41.318834 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3960c7f2-5dd5-407b-a7ed-a4700c952488 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:41.320507 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3960c7f2-5dd5-407b-a7ed-a4700c952488 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:41.322227 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:31:41.336073 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1129/2240] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:31:41 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 05:31:41.340073 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f385c8dd-c7ca-4b9b-b9ec-6171f329acfa service neutron] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:41.364306 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f385c8dd-c7ca-4b9b-b9ec-6171f329acfa service neutron] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:41.373355 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce554364-6f7a-4dad-bb7f-dee1d2b7a2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:41.374407 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce554364-6f7a-4dad-bb7f-dee1d2b7a2a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:41.374662 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce554364-6f7a-4dad-bb7f-dee1d2b7a2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:41.374996 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce554364-6f7a-4dad-bb7f-dee1d2b7a2a6 admin admin] PATH_INFO: `/v3/projects/207cc394047b481780821a78dbb74a9e/users/fef020b60a6e455ba6f0117410a9f696/roles/aa7ff8e0ec1e48e5811335b9eb38b448` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:41.398636 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce554364-6f7a-4dad-bb7f-dee1d2b7a2a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=207cc394047b481780821a78dbb74a9e, user_id=fef020b60a6e455ba6f0117410a9f696, role_id=aa7ff8e0ec1e48e5811335b9eb38b448)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:41.402258 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce554364-6f7a-4dad-bb7f-dee1d2b7a2a6 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:41.439254 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1112/2241] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:31:41 2022] PUT /identity/v3/projects/207cc394047b481780821a78dbb74a9e/users/fef020b60a6e455ba6f0117410a9f696/roles/aa7ff8e0ec1e48e5811335b9eb38b448 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 05:31:41.449288 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a30dc74-88f0-4e54-8708-e5a2995ae448 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:41.449627 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a30dc74-88f0-4e54-8708-e5a2995ae448 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:41.450311 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a30dc74-88f0-4e54-8708-e5a2995ae448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:41.504418 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-6a30dc74-88f0-4e54-8708-e5a2995ae448 None None] MFA Rules not processed for user `fef020b60a6e455ba6f0117410a9f696`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:31:41.505664 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-6a30dc74-88f0-4e54-8708-e5a2995ae448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:31:41.630272 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1130/2242] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:31:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:31:41.652458 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce554364-6f7a-4dad-bb7f-dee1d2b7a2a6 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:41.654303 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-ce554364-6f7a-4dad-bb7f-dee1d2b7a2a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:31:41.662423 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a30dc74-88f0-4e54-8708-e5a2995ae448 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:41.664364 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-6a30dc74-88f0-4e54-8708-e5a2995ae448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:31:41.695040 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:31:41.769648 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce554364-6f7a-4dad-bb7f-dee1d2b7a2a6 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:41.773981 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a30dc74-88f0-4e54-8708-e5a2995ae448 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:41.779694 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d26dfc-cb2a-45ce-a12a-6a77232da0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:41.780351 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d26dfc-cb2a-45ce-a12a-6a77232da0f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:41.780629 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d26dfc-cb2a-45ce-a12a-6a77232da0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:41.781000 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d26dfc-cb2a-45ce-a12a-6a77232da0f0 admin admin] PATH_INFO: `/v3/projects/c4461c316bfc44118c73ba656056984d` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:41.783035 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e1452-4e64-4123-a9ae-a6214fc6c836 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a147e14b61d481db1cac02c58ac3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:41.783401 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d26dfc-cb2a-45ce-a12a-6a77232da0f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4461c316bfc44118c73ba656056984d)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:41.783730 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e1452-4e64-4123-a9ae-a6214fc6c836 service cinder] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:41.785665 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d26dfc-cb2a-45ce-a12a-6a77232da0f0 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:41.790204 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e1452-4e64-4123-a9ae-a6214fc6c836 service cinder] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:41.790487 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e1452-4e64-4123-a9ae-a6214fc6c836 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:41.806335 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519e1452-4e64-4123-a9ae-a6214fc6c836 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:41.807812 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519e1452-4e64-4123-a9ae-a6214fc6c836 service cinder] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:41.831749 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1113/2243] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:31:41 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:31:41.856236 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-07d26dfc-cb2a-45ce-a12a-6a77232da0f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4461c316bfc44118c73ba656056984d', 'request_id': 'req-07d26dfc-cb2a-45ce-a12a-6a77232da0f0'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:41.865380 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e1452-4e64-4123-a9ae-a6214fc6c836 service cinder] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:41.874422 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-07d26dfc-cb2a-45ce-a12a-6a77232da0f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4461c316bfc44118c73ba656056984d', 'request_id': 'req-07d26dfc-cb2a-45ce-a12a-6a77232da0f0'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:41.880879 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e1452-4e64-4123-a9ae-a6214fc6c836 service cinder] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:41.886466 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-07d26dfc-cb2a-45ce-a12a-6a77232da0f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4461c316bfc44118c73ba656056984d', 'request_id': 'req-07d26dfc-cb2a-45ce-a12a-6a77232da0f0'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:41.905747 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-07d26dfc-cb2a-45ce-a12a-6a77232da0f0 admin admin] The token cache is being invalidate because project c4461c316bfc44118c73ba656056984d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:31:41.905747 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-07d26dfc-cb2a-45ce-a12a-6a77232da0f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:41.906431 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-07d26dfc-cb2a-45ce-a12a-6a77232da0f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:41.908240 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1131/2244] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:31:41 2022] DELETE /identity/v3/projects/c4461c316bfc44118c73ba656056984d => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:31:41.911942 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d26dfc-cb2a-45ce-a12a-6a77232da0f0 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:41.913363 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-07d26dfc-cb2a-45ce-a12a-6a77232da0f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:31:41.937313 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:31:41.967587 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6de3ba-672f-42ff-840c-497b3353c3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:41.968266 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6de3ba-672f-42ff-840c-497b3353c3b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:41.968547 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6de3ba-672f-42ff-840c-497b3353c3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:41.968819 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6de3ba-672f-42ff-840c-497b3353c3b0 admin admin] PATH_INFO: `/v3/users/fef020b60a6e455ba6f0117410a9f696` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:41.970129 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6de3ba-672f-42ff-840c-497b3353c3b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fef020b60a6e455ba6f0117410a9f696)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:41.972314 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6de3ba-672f-42ff-840c-497b3353c3b0 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:41.987253 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d26dfc-cb2a-45ce-a12a-6a77232da0f0 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:41.992371 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f074b90-800d-4aa5-b426-e2994d30a82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:41.993001 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f074b90-800d-4aa5-b426-e2994d30a82f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:41.993282 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f074b90-800d-4aa5-b426-e2994d30a82f admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:41.993563 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f074b90-800d-4aa5-b426-e2994d30a82f admin admin] PATH_INFO: `/v3/users/afaae9ecebcd4f178adb8d9171207c3a` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:41.994707 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f074b90-800d-4aa5-b426-e2994d30a82f admin admin] RBAC: Authorizing `identity:delete_user(user_id=afaae9ecebcd4f178adb8d9171207c3a)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:41.997099 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f074b90-800d-4aa5-b426-e2994d30a82f admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:42.022870 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-2f6de3ba-672f-42ff-840c-497b3353c3b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fef020b60a6e455ba6f0117410a9f696'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:42.037195 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-2f6de3ba-672f-42ff-840c-497b3353c3b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fef020b60a6e455ba6f0117410a9f696'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:42.045100 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-2f6de3ba-672f-42ff-840c-497b3353c3b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fef020b60a6e455ba6f0117410a9f696'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:42.052733 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-7f074b90-800d-4aa5-b426-e2994d30a82f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afaae9ecebcd4f178adb8d9171207c3a'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:42.053570 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-2f6de3ba-672f-42ff-840c-497b3353c3b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fef020b60a6e455ba6f0117410a9f696'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:42.054287 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-2f6de3ba-672f-42ff-840c-497b3353c3b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fef020b60a6e455ba6f0117410a9f696'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:42.061201 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1114/2245] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:31:41 2022] DELETE /identity/v3/users/fef020b60a6e455ba6f0117410a9f696 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:31:42.065595 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f803d-f82d-4d45-9238-93394375a9b6 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:42.065999 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f803d-f82d-4d45-9238-93394375a9b6 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:42.066357 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f803d-f82d-4d45-9238-93394375a9b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:42.068603 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-7f074b90-800d-4aa5-b426-e2994d30a82f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afaae9ecebcd4f178adb8d9171207c3a'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:42.075716 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-7f074b90-800d-4aa5-b426-e2994d30a82f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afaae9ecebcd4f178adb8d9171207c3a'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:42.083735 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-7f074b90-800d-4aa5-b426-e2994d30a82f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afaae9ecebcd4f178adb8d9171207c3a'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:42.084397 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-7f074b90-800d-4aa5-b426-e2994d30a82f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afaae9ecebcd4f178adb8d9171207c3a'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:42.086182 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-9a4f803d-f82d-4d45-9238-93394375a9b6 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:31:42.087471 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-9a4f803d-f82d-4d45-9238-93394375a9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:31:42.090936 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1132/2246] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:31:41 2022] DELETE /identity/v3/users/afaae9ecebcd4f178adb8d9171207c3a => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 05:31:42.132106 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:31:42.154282 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1115/2247] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:31:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:31:42.165478 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f074b90-800d-4aa5-b426-e2994d30a82f admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:42.167167 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-7f074b90-800d-4aa5-b426-e2994d30a82f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:31:42.228694 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f074b90-800d-4aa5-b426-e2994d30a82f admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:42.232588 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714850be-9611-4eaf-a9a3-e440f86a992b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:42.233201 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714850be-9611-4eaf-a9a3-e440f86a992b service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:42.233482 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714850be-9611-4eaf-a9a3-e440f86a992b service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:42.233782 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714850be-9611-4eaf-a9a3-e440f86a992b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:42.292608 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:31:42.313166 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714850be-9611-4eaf-a9a3-e440f86a992b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:42.314614 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714850be-9611-4eaf-a9a3-e440f86a992b service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:42.327271 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1133/2248] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:31:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 05:31:42.380933 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4f803d-f82d-4d45-9238-93394375a9b6 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:42.382478 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-9a4f803d-f82d-4d45-9238-93394375a9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:31:42.405789 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4f803d-f82d-4d45-9238-93394375a9b6 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:42.412308 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7de429-c117-43cb-a131-69e05d86f2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:42.413194 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7de429-c117-43cb-a131-69e05d86f2b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:42.413499 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7de429-c117-43cb-a131-69e05d86f2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:42.413788 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7de429-c117-43cb-a131-69e05d86f2b0 admin admin] PATH_INFO: `/v3/projects/d08ebd3d624142c88a2b69d02f65b520` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:42.415322 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7de429-c117-43cb-a131-69e05d86f2b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d08ebd3d624142c88a2b69d02f65b520)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:42.417607 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7de429-c117-43cb-a131-69e05d86f2b0 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:42.472501 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-1e7de429-c117-43cb-a131-69e05d86f2b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd08ebd3d624142c88a2b69d02f65b520', 'request_id': 'req-1e7de429-c117-43cb-a131-69e05d86f2b0'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:42.485314 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-1e7de429-c117-43cb-a131-69e05d86f2b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd08ebd3d624142c88a2b69d02f65b520', 'request_id': 'req-1e7de429-c117-43cb-a131-69e05d86f2b0'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:42.495553 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-1e7de429-c117-43cb-a131-69e05d86f2b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd08ebd3d624142c88a2b69d02f65b520', 'request_id': 'req-1e7de429-c117-43cb-a131-69e05d86f2b0'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:42.507526 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-1e7de429-c117-43cb-a131-69e05d86f2b0 admin admin] The token cache is being invalidate because project d08ebd3d624142c88a2b69d02f65b520 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81383) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:31:42.507851 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-1e7de429-c117-43cb-a131-69e05d86f2b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:42.508617 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-1e7de429-c117-43cb-a131-69e05d86f2b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:42.510337 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1116/2249] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:31:42 2022] DELETE /identity/v3/projects/d08ebd3d624142c88a2b69d02f65b520 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:31:42.515239 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e1e601-44f1-42e0-8827-d958306824e6 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:42.515583 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e1e601-44f1-42e0-8827-d958306824e6 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:42.515872 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e1e601-44f1-42e0-8827-d958306824e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:42.537258 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-22e1e601-44f1-42e0-8827-d958306824e6 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:31:42.538703 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-22e1e601-44f1-42e0-8827-d958306824e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:31:42.609030 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1134/2250] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:31:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 05:31:42.617004 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55809b51-39af-4bdd-b4fb-50b732a108f4 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:42.617297 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55809b51-39af-4bdd-b4fb-50b732a108f4 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:42.617579 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55809b51-39af-4bdd-b4fb-50b732a108f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:42.637865 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-55809b51-39af-4bdd-b4fb-50b732a108f4 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:31:42.639635 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-55809b51-39af-4bdd-b4fb-50b732a108f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:31:42.652532 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1117/2251] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:31:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:31:42.653717 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e1e601-44f1-42e0-8827-d958306824e6 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:42.673056 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e1e601-44f1-42e0-8827-d958306824e6 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:42.688663 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b658dc83-3f8e-443d-bce6-8cc11ea5d2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:42.689269 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b658dc83-3f8e-443d-bce6-8cc11ea5d2ca admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:42.689670 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b658dc83-3f8e-443d-bce6-8cc11ea5d2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:42.690040 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b658dc83-3f8e-443d-bce6-8cc11ea5d2ca admin admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:42.690926 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b658dc83-3f8e-443d-bce6-8cc11ea5d2ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:31:42.691259 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b658dc83-3f8e-443d-bce6-8cc11ea5d2ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:42.693083 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b658dc83-3f8e-443d-bce6-8cc11ea5d2ca admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:42.717257 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1135/2252] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 05:31:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:31:42.717434 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55809b51-39af-4bdd-b4fb-50b732a108f4 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:42.717434 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-55809b51-39af-4bdd-b4fb-50b732a108f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:31:42.718292 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b658dc83-3f8e-443d-bce6-8cc11ea5d2ca admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:42.728402 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55809b51-39af-4bdd-b4fb-50b732a108f4 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:42.730373 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b658dc83-3f8e-443d-bce6-8cc11ea5d2ca admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:42.733844 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dc3e54-cca2-4b8e-8fa0-82a941b695cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:42.734626 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc3e54-cca2-4b8e-8fa0-82a941b695cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:42.734960 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc3e54-cca2-4b8e-8fa0-82a941b695cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:42.735172 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc3e54-cca2-4b8e-8fa0-82a941b695cc admin admin] PATH_INFO: `/v3/projects/207cc394047b481780821a78dbb74a9e` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:42.736347 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dc3e54-cca2-4b8e-8fa0-82a941b695cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=207cc394047b481780821a78dbb74a9e)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:42.737632 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42400358-f3d4-4b69-8c55-0a4f1d2aa8fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:42.738246 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42400358-f3d4-4b69-8c55-0a4f1d2aa8fd admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:42.738351 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dc3e54-cca2-4b8e-8fa0-82a941b695cc admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:42.738774 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42400358-f3d4-4b69-8c55-0a4f1d2aa8fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:42.739045 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42400358-f3d4-4b69-8c55-0a4f1d2aa8fd admin admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:42.739703 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42400358-f3d4-4b69-8c55-0a4f1d2aa8fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:42.741617 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42400358-f3d4-4b69-8c55-0a4f1d2aa8fd admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:42.788572 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1136/2253] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:31:42 2022] POST /identity/v3/projects => generated 355 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:31:42.792610 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42400358-f3d4-4b69-8c55-0a4f1d2aa8fd admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:42.800394 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-c4dc3e54-cca2-4b8e-8fa0-82a941b695cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '207cc394047b481780821a78dbb74a9e', 'request_id': 'req-c4dc3e54-cca2-4b8e-8fa0-82a941b695cc'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:42.809767 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-c4dc3e54-cca2-4b8e-8fa0-82a941b695cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '207cc394047b481780821a78dbb74a9e', 'request_id': 'req-c4dc3e54-cca2-4b8e-8fa0-82a941b695cc'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:42.818987 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-c4dc3e54-cca2-4b8e-8fa0-82a941b695cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '207cc394047b481780821a78dbb74a9e', 'request_id': 'req-c4dc3e54-cca2-4b8e-8fa0-82a941b695cc'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:42.834153 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-c4dc3e54-cca2-4b8e-8fa0-82a941b695cc admin admin] The token cache is being invalidate because project 207cc394047b481780821a78dbb74a9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81383) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:31:42.834554 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-c4dc3e54-cca2-4b8e-8fa0-82a941b695cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:42.835116 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-c4dc3e54-cca2-4b8e-8fa0-82a941b695cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:42.837745 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1118/2254] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:31:42 2022] DELETE /identity/v3/projects/207cc394047b481780821a78dbb74a9e => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:31:42.905846 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42400358-f3d4-4b69-8c55-0a4f1d2aa8fd admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:42.911074 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48bfa9f-dd0f-4ca4-959f-a9cf99ee010c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:42.911913 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48bfa9f-dd0f-4ca4-959f-a9cf99ee010c admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:42.912258 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48bfa9f-dd0f-4ca4-959f-a9cf99ee010c admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:42.912599 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48bfa9f-dd0f-4ca4-959f-a9cf99ee010c admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:42.913320 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48bfa9f-dd0f-4ca4-959f-a9cf99ee010c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:42.915423 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48bfa9f-dd0f-4ca4-959f-a9cf99ee010c admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:42.943080 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1137/2255] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:31:42 2022] POST /identity/v3/users => generated 278 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:31:42.946962 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dc3e54-cca2-4b8e-8fa0-82a941b695cc admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:42.948730 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-c4dc3e54-cca2-4b8e-8fa0-82a941b695cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:31:43.038135 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:31:43.077482 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dc3e54-cca2-4b8e-8fa0-82a941b695cc admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:43.084502 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89a888d-5784-41df-a3cc-cf52ef0b88e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:43.085147 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a888d-5784-41df-a3cc-cf52ef0b88e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:43.085450 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a888d-5784-41df-a3cc-cf52ef0b88e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:43.085713 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a888d-5784-41df-a3cc-cf52ef0b88e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:43.086661 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89a888d-5784-41df-a3cc-cf52ef0b88e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:43.088335 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89a888d-5784-41df-a3cc-cf52ef0b88e4 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:43.105317 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1119/2256] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:31:42 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:31:43.105514 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48bfa9f-dd0f-4ca4-959f-a9cf99ee010c admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:43.117808 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48bfa9f-dd0f-4ca4-959f-a9cf99ee010c admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:43.122975 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65e0a10-f6c9-4c14-8e75-411b457c01d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:43.123581 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e0a10-f6c9-4c14-8e75-411b457c01d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:43.123886 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e0a10-f6c9-4c14-8e75-411b457c01d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:43.124156 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e0a10-f6c9-4c14-8e75-411b457c01d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:43.124801 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65e0a10-f6c9-4c14-8e75-411b457c01d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:43.126752 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65e0a10-f6c9-4c14-8e75-411b457c01d7 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:43.137645 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1138/2257] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:31:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:31:43.141976 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89a888d-5784-41df-a3cc-cf52ef0b88e4 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:43.154221 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89a888d-5784-41df-a3cc-cf52ef0b88e4 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:43.159098 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14cd01f-98a8-4032-be54-364d0e82349d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:43.159879 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14cd01f-98a8-4032-be54-364d0e82349d admin admin] REQUEST_METHOD: `PUT` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:43.160161 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14cd01f-98a8-4032-be54-364d0e82349d admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:43.160437 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14cd01f-98a8-4032-be54-364d0e82349d admin admin] PATH_INFO: `/v3/projects/848f91dbd2a5426c915f29d52183e8de/users/e6b0ef60c2444f108066da1e296ff910/roles/aa7ff8e0ec1e48e5811335b9eb38b448` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:43.180266 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14cd01f-98a8-4032-be54-364d0e82349d admin admin] RBAC: Authorizing `identity:create_grant(project_id=848f91dbd2a5426c915f29d52183e8de, user_id=e6b0ef60c2444f108066da1e296ff910, role_id=aa7ff8e0ec1e48e5811335b9eb38b448)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:43.183319 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14cd01f-98a8-4032-be54-364d0e82349d admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:43.198904 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1120/2258] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:31:43 2022] PUT /identity/v3/projects/848f91dbd2a5426c915f29d52183e8de/users/e6b0ef60c2444f108066da1e296ff910/roles/aa7ff8e0ec1e48e5811335b9eb38b448 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 05:31:43.209623 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343507e7-11ba-47d2-85e2-62bcee2aa893 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:43.209912 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343507e7-11ba-47d2-85e2-62bcee2aa893 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:43.210193 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343507e7-11ba-47d2-85e2-62bcee2aa893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:43.241654 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-343507e7-11ba-47d2-85e2-62bcee2aa893 None None] MFA Rules not processed for user `e6b0ef60c2444f108066da1e296ff910`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:31:43.242947 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-343507e7-11ba-47d2-85e2-62bcee2aa893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:31:43.261245 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:31:43.327027 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1139/2259] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:31:43 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:31:43.332052 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14cd01f-98a8-4032-be54-364d0e82349d admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:43.396221 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14cd01f-98a8-4032-be54-364d0e82349d admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:43.400826 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de356754-bc87-4ba6-adf4-bada5174d6d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:43.401424 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de356754-bc87-4ba6-adf4-bada5174d6d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:43.401730 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de356754-bc87-4ba6-adf4-bada5174d6d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:43.401998 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de356754-bc87-4ba6-adf4-bada5174d6d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:43.402625 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de356754-bc87-4ba6-adf4-bada5174d6d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:43.404552 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de356754-bc87-4ba6-adf4-bada5174d6d6 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:43.430978 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1121/2260] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:31:43 2022] POST /identity/v3/projects => generated 357 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:31:43.435629 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343507e7-11ba-47d2-85e2-62bcee2aa893 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:43.446100 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343507e7-11ba-47d2-85e2-62bcee2aa893 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:43.501783 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87b84f8-9188-4cc7-a26c-b01f712b9dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:43.502317 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b84f8-9188-4cc7-a26c-b01f712b9dce admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:43.502592 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b84f8-9188-4cc7-a26c-b01f712b9dce admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:43.502861 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b84f8-9188-4cc7-a26c-b01f712b9dce admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:43.503545 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87b84f8-9188-4cc7-a26c-b01f712b9dce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:43.505512 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87b84f8-9188-4cc7-a26c-b01f712b9dce admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:43.529838 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1140/2261] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:31:43 2022] POST /identity/v3/users => generated 285 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:31:43.530990 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de356754-bc87-4ba6-adf4-bada5174d6d6 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:43.541444 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de356754-bc87-4ba6-adf4-bada5174d6d6 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:43.546633 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a309fa55-d943-4e04-a87c-bbcb3ddf0c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:43.547239 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a309fa55-d943-4e04-a87c-bbcb3ddf0c8e admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:43.547519 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a309fa55-d943-4e04-a87c-bbcb3ddf0c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:43.547827 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a309fa55-d943-4e04-a87c-bbcb3ddf0c8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:43.548473 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a309fa55-d943-4e04-a87c-bbcb3ddf0c8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:43.550062 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a309fa55-d943-4e04-a87c-bbcb3ddf0c8e admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:43.561608 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1122/2262] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:31:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:31:43.565723 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87b84f8-9188-4cc7-a26c-b01f712b9dce admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:43.576157 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87b84f8-9188-4cc7-a26c-b01f712b9dce admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:43.581035 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9f62b9-fa91-436e-9ef5-16626d76ec74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:43.581746 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f62b9-fa91-436e-9ef5-16626d76ec74 admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:43.582026 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f62b9-fa91-436e-9ef5-16626d76ec74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:43.582295 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f62b9-fa91-436e-9ef5-16626d76ec74 admin admin] PATH_INFO: `/v3/projects/bb1cc6ace1a146308c1ca4999222f5e2/users/dc21b3da6c0c4bc58c63f0ee021b935c/roles/5b702713e40145b49e0b42abd0a5fba9` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:43.601008 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9f62b9-fa91-436e-9ef5-16626d76ec74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb1cc6ace1a146308c1ca4999222f5e2, user_id=dc21b3da6c0c4bc58c63f0ee021b935c, role_id=5b702713e40145b49e0b42abd0a5fba9)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:43.604134 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9f62b9-fa91-436e-9ef5-16626d76ec74 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:43.620976 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1141/2263] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:31:43 2022] PUT /identity/v3/projects/bb1cc6ace1a146308c1ca4999222f5e2/users/dc21b3da6c0c4bc58c63f0ee021b935c/roles/5b702713e40145b49e0b42abd0a5fba9 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:31:43.622318 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a309fa55-d943-4e04-a87c-bbcb3ddf0c8e admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:43.632942 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a309fa55-d943-4e04-a87c-bbcb3ddf0c8e admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:43.712906 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef68e201-9406-454a-8938-e9a8ce501624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:43.713837 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef68e201-9406-454a-8938-e9a8ce501624 admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:43.714359 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef68e201-9406-454a-8938-e9a8ce501624 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:43.714894 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef68e201-9406-454a-8938-e9a8ce501624 admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:43.715841 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef68e201-9406-454a-8938-e9a8ce501624 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:43.719433 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef68e201-9406-454a-8938-e9a8ce501624 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:43.730460 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1123/2264] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:31:43 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:31:43.734569 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9f62b9-fa91-436e-9ef5-16626d76ec74 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:43.758450 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9f62b9-fa91-436e-9ef5-16626d76ec74 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:43.764774 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cb358a-83f1-4ffa-b8cf-0cf3ad09707c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:43.765446 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb358a-83f1-4ffa-b8cf-0cf3ad09707c admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:43.765717 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb358a-83f1-4ffa-b8cf-0cf3ad09707c admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:43.765987 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb358a-83f1-4ffa-b8cf-0cf3ad09707c admin admin] PATH_INFO: `/v3/projects/bb1cc6ace1a146308c1ca4999222f5e2/users/dc21b3da6c0c4bc58c63f0ee021b935c/roles/5b702713e40145b49e0b42abd0a5fba9` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:43.767923 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cb358a-83f1-4ffa-b8cf-0cf3ad09707c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb1cc6ace1a146308c1ca4999222f5e2, user_id=dc21b3da6c0c4bc58c63f0ee021b935c, role_id=5b702713e40145b49e0b42abd0a5fba9)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:43.770738 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cb358a-83f1-4ffa-b8cf-0cf3ad09707c admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:43.781982 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1142/2265] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:31:43 2022] PUT /identity/v3/projects/bb1cc6ace1a146308c1ca4999222f5e2/users/dc21b3da6c0c4bc58c63f0ee021b935c/roles/5b702713e40145b49e0b42abd0a5fba9 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:31:43.793051 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c9a7e4-2a87-45aa-bd00-2757a84cc2e9 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:43.793340 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c9a7e4-2a87-45aa-bd00-2757a84cc2e9 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:43.793613 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c9a7e4-2a87-45aa-bd00-2757a84cc2e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:43.823363 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-f0c9a7e4-2a87-45aa-bd00-2757a84cc2e9 None None] MFA Rules not processed for user `dc21b3da6c0c4bc58c63f0ee021b935c`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:31:43.824709 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-f0c9a7e4-2a87-45aa-bd00-2757a84cc2e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:31:43.838710 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:31:43.898820 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1124/2266] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:31:43 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 05:31:43.910107 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cb358a-83f1-4ffa-b8cf-0cf3ad09707c admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:43.912005 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-f5cb358a-83f1-4ffa-b8cf-0cf3ad09707c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:31:43.973661 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cb358a-83f1-4ffa-b8cf-0cf3ad09707c admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:43.977733 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469fcd72-d49f-4a99-b6c2-b7f47ba0c299 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a147e14b61d481db1cac02c58ac3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:43.978469 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469fcd72-d49f-4a99-b6c2-b7f47ba0c299 service cinder] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:43.978748 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469fcd72-d49f-4a99-b6c2-b7f47ba0c299 service cinder] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:43.979037 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469fcd72-d49f-4a99-b6c2-b7f47ba0c299 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:43.989327 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469fcd72-d49f-4a99-b6c2-b7f47ba0c299 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:43.990796 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469fcd72-d49f-4a99-b6c2-b7f47ba0c299 service cinder] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:44.000845 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1143/2267] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:31:43 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:31:44.090582 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c9a7e4-2a87-45aa-bd00-2757a84cc2e9 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:44.100737 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c9a7e4-2a87-45aa-bd00-2757a84cc2e9 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:44.104291 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a99f945-a3fc-4f32-8aba-ac98ec426bae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a147e14b61d481db1cac02c58ac3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:44.104887 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a99f945-a3fc-4f32-8aba-ac98ec426bae service cinder] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:44.105190 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a99f945-a3fc-4f32-8aba-ac98ec426bae service cinder] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:44.105457 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a99f945-a3fc-4f32-8aba-ac98ec426bae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:44.164948 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a99f945-a3fc-4f32-8aba-ac98ec426bae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:44.166379 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a99f945-a3fc-4f32-8aba-ac98ec426bae service cinder] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:44.175286 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1125/2268] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:31:44 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:31:48.645260 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a672e-4891-4608-a530-2775f42c8e12 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:48.645920 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a672e-4891-4608-a530-2775f42c8e12 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:48.645920 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a672e-4891-4608-a530-2775f42c8e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:48.665516 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-e52a672e-4891-4608-a530-2775f42c8e12 None None] MFA Rules not processed for user `dae006738da54b26a64097de95bef254`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:31:48.666714 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-e52a672e-4891-4608-a530-2775f42c8e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:31:48.675380 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:31:48.724302 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1144/2269] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:31:48 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:31:49.065154 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a99f945-a3fc-4f32-8aba-ac98ec426bae service cinder] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:49.067249 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-5a99f945-a3fc-4f32-8aba-ac98ec426bae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:31:49.147198 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a99f945-a3fc-4f32-8aba-ac98ec426bae service cinder] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:49.156447 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140194f4-6963-4a3b-8526-eed79b0ed3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:49.157306 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140194f4-6963-4a3b-8526-eed79b0ed3f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:49.157660 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140194f4-6963-4a3b-8526-eed79b0ed3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:49.158006 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140194f4-6963-4a3b-8526-eed79b0ed3f1 admin admin] PATH_INFO: `/v3/users/91a510eae3fd4799b8a2b84f59dc4794` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:49.159236 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140194f4-6963-4a3b-8526-eed79b0ed3f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91a510eae3fd4799b8a2b84f59dc4794)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:49.161323 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140194f4-6963-4a3b-8526-eed79b0ed3f1 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:49.214410 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-140194f4-6963-4a3b-8526-eed79b0ed3f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91a510eae3fd4799b8a2b84f59dc4794'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:49.218962 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:31:49.229375 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-140194f4-6963-4a3b-8526-eed79b0ed3f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91a510eae3fd4799b8a2b84f59dc4794'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:49.243806 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-140194f4-6963-4a3b-8526-eed79b0ed3f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91a510eae3fd4799b8a2b84f59dc4794'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:49.257320 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-140194f4-6963-4a3b-8526-eed79b0ed3f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91a510eae3fd4799b8a2b84f59dc4794'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:49.258202 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-140194f4-6963-4a3b-8526-eed79b0ed3f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91a510eae3fd4799b8a2b84f59dc4794'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:49.266854 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1126/2270] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:31:49 2022] DELETE /identity/v3/users/91a510eae3fd4799b8a2b84f59dc4794 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 05:31:49.270521 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db53331b-9ef3-4e5c-8496-162ea40cb54f None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:49.270815 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db53331b-9ef3-4e5c-8496-162ea40cb54f None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:49.271128 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db53331b-9ef3-4e5c-8496-162ea40cb54f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:49.295955 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-db53331b-9ef3-4e5c-8496-162ea40cb54f None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:31:49.297202 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-db53331b-9ef3-4e5c-8496-162ea40cb54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:31:49.385992 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1145/2271] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:31:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:31:49.396286 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140194f4-6963-4a3b-8526-eed79b0ed3f1 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:49.397890 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-140194f4-6963-4a3b-8526-eed79b0ed3f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:31:49.468318 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140194f4-6963-4a3b-8526-eed79b0ed3f1 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:49.472146 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61125a1-cde1-4bd0-806d-4e054e1e0724 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:49.472767 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61125a1-cde1-4bd0-806d-4e054e1e0724 service neutron] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:49.473074 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61125a1-cde1-4bd0-806d-4e054e1e0724 service neutron] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:49.473319 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61125a1-cde1-4bd0-806d-4e054e1e0724 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:49.484577 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61125a1-cde1-4bd0-806d-4e054e1e0724 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:49.486222 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61125a1-cde1-4bd0-806d-4e054e1e0724 service neutron] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:49.498283 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1127/2272] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:31:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:31:49.986592 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db53331b-9ef3-4e5c-8496-162ea40cb54f None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:49.988186 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-db53331b-9ef3-4e5c-8496-162ea40cb54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:31:50.002475 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db53331b-9ef3-4e5c-8496-162ea40cb54f None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:50.008228 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c367117e-677a-4be4-be04-ee9ab253939f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:50.009229 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c367117e-677a-4be4-be04-ee9ab253939f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:50.010700 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c367117e-677a-4be4-be04-ee9ab253939f admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:50.011166 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c367117e-677a-4be4-be04-ee9ab253939f admin admin] PATH_INFO: `/v3/projects/fea5fdcc7ea24a3a9c28492cf72d2de8` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:50.013597 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c367117e-677a-4be4-be04-ee9ab253939f admin admin] RBAC: Authorizing `identity:delete_project(project_id=fea5fdcc7ea24a3a9c28492cf72d2de8)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:50.017612 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c367117e-677a-4be4-be04-ee9ab253939f admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:50.137108 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-c367117e-677a-4be4-be04-ee9ab253939f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fea5fdcc7ea24a3a9c28492cf72d2de8', 'request_id': 'req-c367117e-677a-4be4-be04-ee9ab253939f'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:50.152801 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-c367117e-677a-4be4-be04-ee9ab253939f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fea5fdcc7ea24a3a9c28492cf72d2de8', 'request_id': 'req-c367117e-677a-4be4-be04-ee9ab253939f'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:50.175422 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-c367117e-677a-4be4-be04-ee9ab253939f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fea5fdcc7ea24a3a9c28492cf72d2de8', 'request_id': 'req-c367117e-677a-4be4-be04-ee9ab253939f'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:50.205489 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-c367117e-677a-4be4-be04-ee9ab253939f admin admin] The token cache is being invalidate because project fea5fdcc7ea24a3a9c28492cf72d2de8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:31:50.205797 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-c367117e-677a-4be4-be04-ee9ab253939f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:50.207147 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-c367117e-677a-4be4-be04-ee9ab253939f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:31:50.212814 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1146/2273] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:31:49 2022] DELETE /identity/v3/projects/fea5fdcc7ea24a3a9c28492cf72d2de8 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:31:50.218926 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e8b37-78b5-48f0-a52b-c304804e4187 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:50.219873 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e8b37-78b5-48f0-a52b-c304804e4187 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:50.220292 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e8b37-78b5-48f0-a52b-c304804e4187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:50.265373 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-377e8b37-78b5-48f0-a52b-c304804e4187 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:31:50.269065 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-377e8b37-78b5-48f0-a52b-c304804e4187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:31:50.378710 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1128/2274] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:31:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:31:50.383712 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37674869-666d-43f7-b825-59b75efe82af None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:50.384274 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37674869-666d-43f7-b825-59b75efe82af None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:50.384717 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37674869-666d-43f7-b825-59b75efe82af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:50.407481 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-37674869-666d-43f7-b825-59b75efe82af None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:31:50.409176 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-37674869-666d-43f7-b825-59b75efe82af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:31:50.417312 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1147/2275] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:31:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:31:50.422360 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377e8b37-78b5-48f0-a52b-c304804e4187 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:50.435810 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377e8b37-78b5-48f0-a52b-c304804e4187 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:50.441470 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5115041d-a7e7-442e-879c-9a31b7e58673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:50.442090 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5115041d-a7e7-442e-879c-9a31b7e58673 admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:50.442369 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5115041d-a7e7-442e-879c-9a31b7e58673 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:50.442645 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5115041d-a7e7-442e-879c-9a31b7e58673 admin admin] PATH_INFO: `/v3/domains` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:50.443299 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5115041d-a7e7-442e-879c-9a31b7e58673 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:31:50.443755 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5115041d-a7e7-442e-879c-9a31b7e58673 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:50.445353 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5115041d-a7e7-442e-879c-9a31b7e58673 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:50.458262 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1129/2276] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 05:31:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:31:50.462730 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37674869-666d-43f7-b825-59b75efe82af None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:50.472156 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37674869-666d-43f7-b825-59b75efe82af None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:50.476866 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c50054-84aa-4cc5-9a71-75d0161de750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:50.477469 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c50054-84aa-4cc5-9a71-75d0161de750 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:50.477927 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c50054-84aa-4cc5-9a71-75d0161de750 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:50.478205 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c50054-84aa-4cc5-9a71-75d0161de750 admin admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:50.478838 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c50054-84aa-4cc5-9a71-75d0161de750 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:50.480796 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c50054-84aa-4cc5-9a71-75d0161de750 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:50.509940 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1148/2277] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:31:50 2022] POST /identity/v3/projects => generated 391 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:31:50.513997 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5115041d-a7e7-442e-879c-9a31b7e58673 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:50.526401 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5115041d-a7e7-442e-879c-9a31b7e58673 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:50.594023 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de890b57-03ab-40a5-b7ee-3a3bc2eabe95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:50.594537 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de890b57-03ab-40a5-b7ee-3a3bc2eabe95 admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:50.595764 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de890b57-03ab-40a5-b7ee-3a3bc2eabe95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:50.596053 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de890b57-03ab-40a5-b7ee-3a3bc2eabe95 admin admin] PATH_INFO: `/v3/users` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:50.596896 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de890b57-03ab-40a5-b7ee-3a3bc2eabe95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:50.599934 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de890b57-03ab-40a5-b7ee-3a3bc2eabe95 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:50.611062 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:31:50.633957 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1130/2278] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:31:50 2022] POST /identity/v3/users => generated 296 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 05:31:50.637565 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c50054-84aa-4cc5-9a71-75d0161de750 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:50.648311 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c50054-84aa-4cc5-9a71-75d0161de750 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:50.653023 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f787f9a-5558-422d-8ca8-1f3e2f5e0810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:50.654199 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f787f9a-5558-422d-8ca8-1f3e2f5e0810 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:50.654544 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f787f9a-5558-422d-8ca8-1f3e2f5e0810 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:50.654881 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f787f9a-5558-422d-8ca8-1f3e2f5e0810 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:50.655602 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f787f9a-5558-422d-8ca8-1f3e2f5e0810 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:50.657305 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f787f9a-5558-422d-8ca8-1f3e2f5e0810 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:50.672061 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1149/2279] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:31:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 05:31:50.673541 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de890b57-03ab-40a5-b7ee-3a3bc2eabe95 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:50.685499 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de890b57-03ab-40a5-b7ee-3a3bc2eabe95 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:50.690672 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab85d227-7b68-49ef-9e62-78e99f077220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:50.691530 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab85d227-7b68-49ef-9e62-78e99f077220 admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:50.692040 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab85d227-7b68-49ef-9e62-78e99f077220 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:50.692395 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab85d227-7b68-49ef-9e62-78e99f077220 admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:50.693108 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab85d227-7b68-49ef-9e62-78e99f077220 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:50.694810 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab85d227-7b68-49ef-9e62-78e99f077220 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:50.712574 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1131/2280] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:31:50 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:31:50.714025 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f787f9a-5558-422d-8ca8-1f3e2f5e0810 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:50.720038 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:31:50.727810 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f787f9a-5558-422d-8ca8-1f3e2f5e0810 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:50.734018 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bf64dc-7fe0-4984-87f4-9bc4e693af6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:50.734687 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf64dc-7fe0-4984-87f4-9bc4e693af6a admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:50.734967 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf64dc-7fe0-4984-87f4-9bc4e693af6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:50.735240 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf64dc-7fe0-4984-87f4-9bc4e693af6a admin admin] PATH_INFO: `/v3/projects/aae72fa878d84ea9ae018a357ecaa984/users/cede98f780a041a1bd7e27a8d3a5ac49/roles/aa7ff8e0ec1e48e5811335b9eb38b448` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:50.750800 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bf64dc-7fe0-4984-87f4-9bc4e693af6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=aae72fa878d84ea9ae018a357ecaa984, user_id=cede98f780a041a1bd7e27a8d3a5ac49, role_id=aa7ff8e0ec1e48e5811335b9eb38b448)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:50.753520 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bf64dc-7fe0-4984-87f4-9bc4e693af6a admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:50.766992 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1150/2281] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:31:50 2022] PUT /identity/v3/projects/aae72fa878d84ea9ae018a357ecaa984/users/cede98f780a041a1bd7e27a8d3a5ac49/roles/aa7ff8e0ec1e48e5811335b9eb38b448 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:31:50.777431 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff9a368-19e2-4415-ac16-a2af88515b0e None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:50.777719 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff9a368-19e2-4415-ac16-a2af88515b0e None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:50.777993 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff9a368-19e2-4415-ac16-a2af88515b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:50.832725 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-fff9a368-19e2-4415-ac16-a2af88515b0e None None] MFA Rules not processed for user `cede98f780a041a1bd7e27a8d3a5ac49`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:31:50.834325 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-fff9a368-19e2-4415-ac16-a2af88515b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:31:50.897912 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f51ef-56d2-4f27-af08-f47e01395efc None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:50.898385 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f51ef-56d2-4f27-af08-f47e01395efc None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:50.898385 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f51ef-56d2-4f27-af08-f47e01395efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:50.925185 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-9c5f51ef-56d2-4f27-af08-f47e01395efc None None] MFA Rules not processed for user `62fffbcf330a4bc183d0885c175f5a90`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:31:50.926535 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-9c5f51ef-56d2-4f27-af08-f47e01395efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:31:50.927866 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1132/2282] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:31:50 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:31:50.940743 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff9a368-19e2-4415-ac16-a2af88515b0e None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:50.942303 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-fff9a368-19e2-4415-ac16-a2af88515b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:31:50.994366 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1151/2283] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 05:31:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 05:31:51.017352 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff9a368-19e2-4415-ac16-a2af88515b0e None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:51.021571 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6409ea26-79c7-49fd-a27a-094fc8f99d49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a147e14b61d481db1cac02c58ac3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:51.022471 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6409ea26-79c7-49fd-a27a-094fc8f99d49 service cinder] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:51.022849 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6409ea26-79c7-49fd-a27a-094fc8f99d49 service cinder] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:51.023218 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6409ea26-79c7-49fd-a27a-094fc8f99d49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:51.035128 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6409ea26-79c7-49fd-a27a-094fc8f99d49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:51.035128 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6409ea26-79c7-49fd-a27a-094fc8f99d49 service cinder] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:51.049477 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1133/2284] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:31:50 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:31:51.058252 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5f51ef-56d2-4f27-af08-f47e01395efc None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:51.060251 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-9c5f51ef-56d2-4f27-af08-f47e01395efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:31:51.141211 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5f51ef-56d2-4f27-af08-f47e01395efc None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:51.146796 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81661297-5b35-4383-bcb8-c1d481f21215 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bbe4555380345e485572d2da8b78be1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:51.147549 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81661297-5b35-4383-bcb8-c1d481f21215 service swift] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:51.147733 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81661297-5b35-4383-bcb8-c1d481f21215 service swift] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:51.148018 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81661297-5b35-4383-bcb8-c1d481f21215 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:51.157427 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81661297-5b35-4383-bcb8-c1d481f21215 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:51.159180 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81661297-5b35-4383-bcb8-c1d481f21215 service swift] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:51.168602 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1152/2285] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 05:31:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 05:31:51.419235 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e85dd9e-e8d8-449f-8af3-20584a7d9874 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:51.419774 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e85dd9e-e8d8-449f-8af3-20584a7d9874 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:51.419858 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e85dd9e-e8d8-449f-8af3-20584a7d9874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:51.470100 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-7e85dd9e-e8d8-449f-8af3-20584a7d9874 None None] MFA Rules not processed for user `62fffbcf330a4bc183d0885c175f5a90`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:31:51.471336 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-7e85dd9e-e8d8-449f-8af3-20584a7d9874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:31:51.497537 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1134/2286] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 05:31:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:31:51.517915 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81661297-5b35-4383-bcb8-c1d481f21215 service swift] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:31:51.535577 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81661297-5b35-4383-bcb8-c1d481f21215 service swift] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:31:51.550758 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8851db33-bbb0-46e1-b944-22138200df33 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bbe4555380345e485572d2da8b78be1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:31:51.552294 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8851db33-bbb0-46e1-b944-22138200df33 service swift] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:31:51.554606 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8851db33-bbb0-46e1-b944-22138200df33 service swift] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:31:51.555172 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8851db33-bbb0-46e1-b944-22138200df33 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:31:51.580060 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8851db33-bbb0-46e1-b944-22138200df33 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:31:51.582274 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8851db33-bbb0-46e1-b944-22138200df33 service swift] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:31:51.600855 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1153/2287] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 05:31:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 05:32:01.438301 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:INSERT=3,keystone:SELECT=68 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:32:01.591062 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=72,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:32:02.033364 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e85dd9e-e8d8-449f-8af3-20584a7d9874 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:32:02.035208 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-7e85dd9e-e8d8-449f-8af3-20584a7d9874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:32:02.234774 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e85dd9e-e8d8-449f-8af3-20584a7d9874 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:32:02.247751 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1d23e6-baeb-44be-ba87-dfd1794a3949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:32:02.250521 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1d23e6-baeb-44be-ba87-dfd1794a3949 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:02.250963 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1d23e6-baeb-44be-ba87-dfd1794a3949 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:02.251431 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1d23e6-baeb-44be-ba87-dfd1794a3949 admin admin] PATH_INFO: `/v3/users/e6b0ef60c2444f108066da1e296ff910` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:02.253842 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1d23e6-baeb-44be-ba87-dfd1794a3949 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6b0ef60c2444f108066da1e296ff910)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:32:02.260294 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1d23e6-baeb-44be-ba87-dfd1794a3949 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:32:02.363713 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-cd1d23e6-baeb-44be-ba87-dfd1794a3949 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6b0ef60c2444f108066da1e296ff910'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:02.384887 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-cd1d23e6-baeb-44be-ba87-dfd1794a3949 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6b0ef60c2444f108066da1e296ff910'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:02.392815 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-cd1d23e6-baeb-44be-ba87-dfd1794a3949 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6b0ef60c2444f108066da1e296ff910'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:02.407789 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-cd1d23e6-baeb-44be-ba87-dfd1794a3949 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6b0ef60c2444f108066da1e296ff910'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:02.409250 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-cd1d23e6-baeb-44be-ba87-dfd1794a3949 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6b0ef60c2444f108066da1e296ff910'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:02.421173 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1135/2288] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:32:02 2022] DELETE /identity/v3/users/e6b0ef60c2444f108066da1e296ff910 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:32:02.423191 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450fc46f-506f-4728-8a10-50563988f77c None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:02.423643 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450fc46f-506f-4728-8a10-50563988f77c None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:02.424063 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450fc46f-506f-4728-8a10-50563988f77c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:02.460150 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-450fc46f-506f-4728-8a10-50563988f77c None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:32:02.463712 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-450fc46f-506f-4728-8a10-50563988f77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:32:02.624350 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1154/2289] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:32:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:32:02.633884 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1d23e6-baeb-44be-ba87-dfd1794a3949 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:32:02.635446 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-cd1d23e6-baeb-44be-ba87-dfd1794a3949 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:32:02.862785 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1d23e6-baeb-44be-ba87-dfd1794a3949 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:32:02.897031 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5de52d0-2138-456e-a95d-0fac7cf982cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:32:02.897711 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de52d0-2138-456e-a95d-0fac7cf982cb service neutron] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:02.898019 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de52d0-2138-456e-a95d-0fac7cf982cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:02.898294 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de52d0-2138-456e-a95d-0fac7cf982cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:02.938127 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5de52d0-2138-456e-a95d-0fac7cf982cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:32:02.944375 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5de52d0-2138-456e-a95d-0fac7cf982cb service neutron] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:32:02.970493 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1136/2290] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:32:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:32:03.243390 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450fc46f-506f-4728-8a10-50563988f77c None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:32:03.244897 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-450fc46f-506f-4728-8a10-50563988f77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:32:03.266680 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450fc46f-506f-4728-8a10-50563988f77c None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:32:03.292463 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e59432c-1c33-4224-9a63-da3f5c2f82d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:32:03.293139 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e59432c-1c33-4224-9a63-da3f5c2f82d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:03.293450 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e59432c-1c33-4224-9a63-da3f5c2f82d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:03.293725 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e59432c-1c33-4224-9a63-da3f5c2f82d9 admin admin] PATH_INFO: `/v3/users/cede98f780a041a1bd7e27a8d3a5ac49` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:03.295040 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e59432c-1c33-4224-9a63-da3f5c2f82d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cede98f780a041a1bd7e27a8d3a5ac49)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:32:03.297915 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e59432c-1c33-4224-9a63-da3f5c2f82d9 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:32:03.398220 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-7e59432c-1c33-4224-9a63-da3f5c2f82d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cede98f780a041a1bd7e27a8d3a5ac49'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:03.427314 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-7e59432c-1c33-4224-9a63-da3f5c2f82d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cede98f780a041a1bd7e27a8d3a5ac49'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:03.440283 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-7e59432c-1c33-4224-9a63-da3f5c2f82d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cede98f780a041a1bd7e27a8d3a5ac49'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:03.453201 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-7e59432c-1c33-4224-9a63-da3f5c2f82d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cede98f780a041a1bd7e27a8d3a5ac49'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:03.454200 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-7e59432c-1c33-4224-9a63-da3f5c2f82d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cede98f780a041a1bd7e27a8d3a5ac49'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:03.462510 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1155/2291] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:32:03 2022] DELETE /identity/v3/users/cede98f780a041a1bd7e27a8d3a5ac49 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:32:03.468274 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b32d7e-0188-4223-a89f-440220e892b1 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:03.468274 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b32d7e-0188-4223-a89f-440220e892b1 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:03.468274 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b32d7e-0188-4223-a89f-440220e892b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:03.527950 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-61b32d7e-0188-4223-a89f-440220e892b1 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:32:03.529288 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-61b32d7e-0188-4223-a89f-440220e892b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:32:03.573631 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:32:03.622010 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e59432c-1c33-4224-9a63-da3f5c2f82d9 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:32:03.623728 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-7e59432c-1c33-4224-9a63-da3f5c2f82d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:32:03.709020 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1137/2292] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:32:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:32:03.723335 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b32d7e-0188-4223-a89f-440220e892b1 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:32:03.724780 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-61b32d7e-0188-4223-a89f-440220e892b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:32:03.785866 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e59432c-1c33-4224-9a63-da3f5c2f82d9 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:32:03.794808 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced69024-0dfa-4fc7-a8a9-215cd1e8760e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:32:03.795480 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced69024-0dfa-4fc7-a8a9-215cd1e8760e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:03.796059 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced69024-0dfa-4fc7-a8a9-215cd1e8760e admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:03.796059 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced69024-0dfa-4fc7-a8a9-215cd1e8760e admin admin] PATH_INFO: `/v3/projects/848f91dbd2a5426c915f29d52183e8de` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:03.797429 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced69024-0dfa-4fc7-a8a9-215cd1e8760e admin admin] RBAC: Authorizing `identity:delete_project(project_id=848f91dbd2a5426c915f29d52183e8de)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:32:03.799251 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced69024-0dfa-4fc7-a8a9-215cd1e8760e admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:32:03.829969 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:32:03.835951 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b32d7e-0188-4223-a89f-440220e892b1 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:32:03.845237 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bba105-0a6d-4401-bf97-ce3ac8d75cc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:32:03.846256 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bba105-0a6d-4401-bf97-ce3ac8d75cc3 service neutron] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:03.846798 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bba105-0a6d-4401-bf97-ce3ac8d75cc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:03.847234 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bba105-0a6d-4401-bf97-ce3ac8d75cc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:03.865099 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bba105-0a6d-4401-bf97-ce3ac8d75cc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:32:03.867115 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bba105-0a6d-4401-bf97-ce3ac8d75cc3 service neutron] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:32:03.877554 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1138/2293] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:32:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 05:32:03.930821 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-ced69024-0dfa-4fc7-a8a9-215cd1e8760e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '848f91dbd2a5426c915f29d52183e8de', 'request_id': 'req-ced69024-0dfa-4fc7-a8a9-215cd1e8760e'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:04.006050 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-ced69024-0dfa-4fc7-a8a9-215cd1e8760e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '848f91dbd2a5426c915f29d52183e8de', 'request_id': 'req-ced69024-0dfa-4fc7-a8a9-215cd1e8760e'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:04.045122 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-ced69024-0dfa-4fc7-a8a9-215cd1e8760e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '848f91dbd2a5426c915f29d52183e8de', 'request_id': 'req-ced69024-0dfa-4fc7-a8a9-215cd1e8760e'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:04.072884 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-ced69024-0dfa-4fc7-a8a9-215cd1e8760e admin admin] The token cache is being invalidate because project 848f91dbd2a5426c915f29d52183e8de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:32:04.073887 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-ced69024-0dfa-4fc7-a8a9-215cd1e8760e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:04.075591 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-ced69024-0dfa-4fc7-a8a9-215cd1e8760e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:04.080241 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1156/2294] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:32:03 2022] DELETE /identity/v3/projects/848f91dbd2a5426c915f29d52183e8de => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:32:04.093937 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bba105-0a6d-4401-bf97-ce3ac8d75cc3 service neutron] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:32:04.125891 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bba105-0a6d-4401-bf97-ce3ac8d75cc3 service neutron] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:32:04.247288 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a945b0-00f3-480a-8d80-70206f4951de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:32:04.248062 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a945b0-00f3-480a-8d80-70206f4951de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:04.248366 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a945b0-00f3-480a-8d80-70206f4951de admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:04.249405 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a945b0-00f3-480a-8d80-70206f4951de admin admin] PATH_INFO: `/v3/users/dc21b3da6c0c4bc58c63f0ee021b935c` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:04.250030 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a945b0-00f3-480a-8d80-70206f4951de admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc21b3da6c0c4bc58c63f0ee021b935c)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:32:04.252347 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a945b0-00f3-480a-8d80-70206f4951de admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:32:04.388139 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-43a945b0-00f3-480a-8d80-70206f4951de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc21b3da6c0c4bc58c63f0ee021b935c'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:04.435994 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-43a945b0-00f3-480a-8d80-70206f4951de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc21b3da6c0c4bc58c63f0ee021b935c'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:04.439001 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:32:04.450423 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-43a945b0-00f3-480a-8d80-70206f4951de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc21b3da6c0c4bc58c63f0ee021b935c'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:04.490330 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-43a945b0-00f3-480a-8d80-70206f4951de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc21b3da6c0c4bc58c63f0ee021b935c'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:04.491954 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-43a945b0-00f3-480a-8d80-70206f4951de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc21b3da6c0c4bc58c63f0ee021b935c'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:04.502965 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1139/2295] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:32:04 2022] DELETE /identity/v3/users/dc21b3da6c0c4bc58c63f0ee021b935c => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:32:04.852707 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced69024-0dfa-4fc7-a8a9-215cd1e8760e admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:32:04.857398 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-ced69024-0dfa-4fc7-a8a9-215cd1e8760e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:32:04.902392 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced69024-0dfa-4fc7-a8a9-215cd1e8760e admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:32:05.108163 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfad3ec-92b1-432b-aded-b2ecebb7b7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:32:05.109704 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfad3ec-92b1-432b-aded-b2ecebb7b7cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:05.110151 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfad3ec-92b1-432b-aded-b2ecebb7b7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:05.110593 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfad3ec-92b1-432b-aded-b2ecebb7b7cc admin admin] PATH_INFO: `/v3/projects/aae72fa878d84ea9ae018a357ecaa984` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:05.113947 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfad3ec-92b1-432b-aded-b2ecebb7b7cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=aae72fa878d84ea9ae018a357ecaa984)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:32:05.121360 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfad3ec-92b1-432b-aded-b2ecebb7b7cc admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:32:05.191785 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a945b0-00f3-480a-8d80-70206f4951de admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:32:05.195361 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-43a945b0-00f3-480a-8d80-70206f4951de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:32:05.233922 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a945b0-00f3-480a-8d80-70206f4951de admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:32:05.265097 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-ccfad3ec-92b1-432b-aded-b2ecebb7b7cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aae72fa878d84ea9ae018a357ecaa984', 'request_id': 'req-ccfad3ec-92b1-432b-aded-b2ecebb7b7cc'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:05.277731 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-ccfad3ec-92b1-432b-aded-b2ecebb7b7cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aae72fa878d84ea9ae018a357ecaa984', 'request_id': 'req-ccfad3ec-92b1-432b-aded-b2ecebb7b7cc'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:05.295790 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-ccfad3ec-92b1-432b-aded-b2ecebb7b7cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aae72fa878d84ea9ae018a357ecaa984', 'request_id': 'req-ccfad3ec-92b1-432b-aded-b2ecebb7b7cc'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:05.317225 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-ccfad3ec-92b1-432b-aded-b2ecebb7b7cc admin admin] The token cache is being invalidate because project aae72fa878d84ea9ae018a357ecaa984 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:32:05.317540 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-ccfad3ec-92b1-432b-aded-b2ecebb7b7cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:05.319946 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-ccfad3ec-92b1-432b-aded-b2ecebb7b7cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:05.321901 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1157/2296] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:32:04 2022] DELETE /identity/v3/projects/aae72fa878d84ea9ae018a357ecaa984 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:32:05.459555 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec859d-e1f0-406d-a94c-4f8e40d4ccf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:32:05.460525 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec859d-e1f0-406d-a94c-4f8e40d4ccf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:05.460992 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec859d-e1f0-406d-a94c-4f8e40d4ccf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:05.462238 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec859d-e1f0-406d-a94c-4f8e40d4ccf9 admin admin] PATH_INFO: `/v3/projects/bb1cc6ace1a146308c1ca4999222f5e2` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:05.463833 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ec859d-e1f0-406d-a94c-4f8e40d4ccf9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb1cc6ace1a146308c1ca4999222f5e2)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:32:05.466918 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ec859d-e1f0-406d-a94c-4f8e40d4ccf9 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:32:05.565294 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-c4ec859d-e1f0-406d-a94c-4f8e40d4ccf9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb1cc6ace1a146308c1ca4999222f5e2', 'request_id': 'req-c4ec859d-e1f0-406d-a94c-4f8e40d4ccf9'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:05.580117 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-c4ec859d-e1f0-406d-a94c-4f8e40d4ccf9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb1cc6ace1a146308c1ca4999222f5e2', 'request_id': 'req-c4ec859d-e1f0-406d-a94c-4f8e40d4ccf9'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:05.593249 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-c4ec859d-e1f0-406d-a94c-4f8e40d4ccf9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb1cc6ace1a146308c1ca4999222f5e2', 'request_id': 'req-c4ec859d-e1f0-406d-a94c-4f8e40d4ccf9'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:05.618004 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-c4ec859d-e1f0-406d-a94c-4f8e40d4ccf9 admin admin] The token cache is being invalidate because project bb1cc6ace1a146308c1ca4999222f5e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81383) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:32:05.618294 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-c4ec859d-e1f0-406d-a94c-4f8e40d4ccf9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:05.618970 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-c4ec859d-e1f0-406d-a94c-4f8e40d4ccf9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:05.621020 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1140/2297] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:32:05 2022] DELETE /identity/v3/projects/bb1cc6ace1a146308c1ca4999222f5e2 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:32:05.626303 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a3b3b-1ab9-415c-ac39-dec11cedc36d None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:05.627073 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a3b3b-1ab9-415c-ac39-dec11cedc36d None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:05.627539 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a3b3b-1ab9-415c-ac39-dec11cedc36d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:05.688561 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-1a2a3b3b-1ab9-415c-ac39-dec11cedc36d None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:32:05.689798 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-1a2a3b3b-1ab9-415c-ac39-dec11cedc36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:32:05.834237 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:32:05.887811 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1158/2298] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:32:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:32:05.895159 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad77ba8-0c64-49e3-8a58-cbc9d110eb33 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:05.895442 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad77ba8-0c64-49e3-8a58-cbc9d110eb33 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:05.895737 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad77ba8-0c64-49e3-8a58-cbc9d110eb33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:05.923657 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-bad77ba8-0c64-49e3-8a58-cbc9d110eb33 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:32:05.926167 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-bad77ba8-0c64-49e3-8a58-cbc9d110eb33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:32:05.935577 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1141/2299] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:32:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:32:05.940045 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2a3b3b-1ab9-415c-ac39-dec11cedc36d None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:32:05.951270 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2a3b3b-1ab9-415c-ac39-dec11cedc36d None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:32:05.956445 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c16ca5-67e7-4ab9-85d2-1c94abdb684f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:32:05.957435 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c16ca5-67e7-4ab9-85d2-1c94abdb684f admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:05.957948 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c16ca5-67e7-4ab9-85d2-1c94abdb684f admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:05.958330 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c16ca5-67e7-4ab9-85d2-1c94abdb684f admin admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:05.959231 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c16ca5-67e7-4ab9-85d2-1c94abdb684f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:32:05.959544 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c16ca5-67e7-4ab9-85d2-1c94abdb684f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:32:05.961396 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c16ca5-67e7-4ab9-85d2-1c94abdb684f admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:32:05.975828 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1159/2300] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 05:32:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:32:05.979702 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad77ba8-0c64-49e3-8a58-cbc9d110eb33 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:32:05.996312 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad77ba8-0c64-49e3-8a58-cbc9d110eb33 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:32:06.002100 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16528514-adcb-4373-85cf-fdb10ee436b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:32:06.002849 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16528514-adcb-4373-85cf-fdb10ee436b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:06.003232 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16528514-adcb-4373-85cf-fdb10ee436b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:06.003607 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16528514-adcb-4373-85cf-fdb10ee436b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:06.004394 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16528514-adcb-4373-85cf-fdb10ee436b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:32:06.006914 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16528514-adcb-4373-85cf-fdb10ee436b1 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:32:06.058064 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1142/2301] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:32:05 2022] POST /identity/v3/projects => generated 391 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:32:06.062767 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c16ca5-67e7-4ab9-85d2-1c94abdb684f admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:32:06.074525 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c16ca5-67e7-4ab9-85d2-1c94abdb684f admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:32:06.144039 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae811b36-6901-4b50-9543-6471cc625d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:32:06.144709 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae811b36-6901-4b50-9543-6471cc625d8d admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:06.144997 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae811b36-6901-4b50-9543-6471cc625d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:06.145309 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae811b36-6901-4b50-9543-6471cc625d8d admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:06.146013 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae811b36-6901-4b50-9543-6471cc625d8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:32:06.148023 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae811b36-6901-4b50-9543-6471cc625d8d admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:32:06.172783 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1160/2302] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:32:06 2022] POST /identity/v3/users => generated 296 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 05:32:06.177175 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16528514-adcb-4373-85cf-fdb10ee436b1 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:32:06.189532 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16528514-adcb-4373-85cf-fdb10ee436b1 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:32:06.194729 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3481e7ab-9b0c-4314-a6f1-2729bce65203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:32:06.195373 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3481e7ab-9b0c-4314-a6f1-2729bce65203 admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:06.195654 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3481e7ab-9b0c-4314-a6f1-2729bce65203 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:06.195952 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3481e7ab-9b0c-4314-a6f1-2729bce65203 admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:06.196620 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3481e7ab-9b0c-4314-a6f1-2729bce65203 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:32:06.198338 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3481e7ab-9b0c-4314-a6f1-2729bce65203 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:32:06.213802 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1143/2303] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:32:06 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:32:06.214567 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae811b36-6901-4b50-9543-6471cc625d8d admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:32:06.227571 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae811b36-6901-4b50-9543-6471cc625d8d admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:32:06.233432 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7423ce3c-51bd-4053-a6fd-1770815e5b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:32:06.234057 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7423ce3c-51bd-4053-a6fd-1770815e5b37 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:06.234360 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7423ce3c-51bd-4053-a6fd-1770815e5b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:06.234699 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7423ce3c-51bd-4053-a6fd-1770815e5b37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:06.235388 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7423ce3c-51bd-4053-a6fd-1770815e5b37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:32:06.237141 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7423ce3c-51bd-4053-a6fd-1770815e5b37 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:32:06.248926 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1161/2304] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:32:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 05:32:06.255019 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3481e7ab-9b0c-4314-a6f1-2729bce65203 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:32:06.270169 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3481e7ab-9b0c-4314-a6f1-2729bce65203 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:32:06.276446 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8764ca-bb37-49e5-9c9d-e0ee588af440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:32:06.277339 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8764ca-bb37-49e5-9c9d-e0ee588af440 admin admin] REQUEST_METHOD: `PUT` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:06.278273 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8764ca-bb37-49e5-9c9d-e0ee588af440 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:06.278577 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8764ca-bb37-49e5-9c9d-e0ee588af440 admin admin] PATH_INFO: `/v3/projects/d5e877a72ac5492092597cb618a26eb3/users/72aea89715b3471db0a470a3a7418836/roles/aa7ff8e0ec1e48e5811335b9eb38b448` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:06.297333 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8764ca-bb37-49e5-9c9d-e0ee588af440 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5e877a72ac5492092597cb618a26eb3, user_id=72aea89715b3471db0a470a3a7418836, role_id=aa7ff8e0ec1e48e5811335b9eb38b448)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:32:06.301168 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8764ca-bb37-49e5-9c9d-e0ee588af440 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:32:06.328398 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1144/2305] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:32:06 2022] PUT /identity/v3/projects/d5e877a72ac5492092597cb618a26eb3/users/72aea89715b3471db0a470a3a7418836/roles/aa7ff8e0ec1e48e5811335b9eb38b448 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 05:32:06.336465 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d8523-87cf-421d-bdee-4db4fa02c8ac None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:06.336835 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d8523-87cf-421d-bdee-4db4fa02c8ac None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:06.337048 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d8523-87cf-421d-bdee-4db4fa02c8ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:06.367719 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-089d8523-87cf-421d-bdee-4db4fa02c8ac None None] MFA Rules not processed for user `72aea89715b3471db0a470a3a7418836`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:32:06.369282 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-089d8523-87cf-421d-bdee-4db4fa02c8ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:32:06.469392 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1162/2306] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:32:06 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:32:06.471033 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8764ca-bb37-49e5-9c9d-e0ee588af440 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:32:06.487390 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:32:06.546833 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8764ca-bb37-49e5-9c9d-e0ee588af440 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:32:06.552689 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d3577-12a2-4f36-a869-12d7440edfd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:32:06.553691 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d3577-12a2-4f36-a869-12d7440edfd7 admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:06.554168 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d3577-12a2-4f36-a869-12d7440edfd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:06.554616 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d3577-12a2-4f36-a869-12d7440edfd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:06.555435 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84d3577-12a2-4f36-a869-12d7440edfd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:32:06.557384 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84d3577-12a2-4f36-a869-12d7440edfd7 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:32:06.593259 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1145/2307] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:32:06 2022] POST /identity/v3/projects => generated 393 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:32:06.597672 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089d8523-87cf-421d-bdee-4db4fa02c8ac None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:32:06.611651 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089d8523-87cf-421d-bdee-4db4fa02c8ac None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:32:06.647517 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:32:06.692614 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c6cf09-93f1-42a7-b933-8361ddd967bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:32:06.694310 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6cf09-93f1-42a7-b933-8361ddd967bb admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:06.694688 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6cf09-93f1-42a7-b933-8361ddd967bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:06.695099 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6cf09-93f1-42a7-b933-8361ddd967bb admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:06.695979 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c6cf09-93f1-42a7-b933-8361ddd967bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:32:06.698544 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c6cf09-93f1-42a7-b933-8361ddd967bb admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:32:06.725096 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1163/2308] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:32:06 2022] POST /identity/v3/users => generated 303 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:32:06.726362 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d3577-12a2-4f36-a869-12d7440edfd7 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:32:06.740649 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d3577-12a2-4f36-a869-12d7440edfd7 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:32:06.745782 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372ae13c-4bcd-4162-8cc8-f9360b1c3f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:32:06.747359 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ae13c-4bcd-4162-8cc8-f9360b1c3f10 admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:06.747990 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ae13c-4bcd-4162-8cc8-f9360b1c3f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:06.748515 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ae13c-4bcd-4162-8cc8-f9360b1c3f10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:06.749285 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372ae13c-4bcd-4162-8cc8-f9360b1c3f10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:32:06.751823 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372ae13c-4bcd-4162-8cc8-f9360b1c3f10 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:32:06.766798 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1146/2309] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:32:06 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:32:06.767621 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c6cf09-93f1-42a7-b933-8361ddd967bb admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:32:06.778790 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c6cf09-93f1-42a7-b933-8361ddd967bb admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:32:06.791655 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91889881-3a40-44fa-9b9e-e6b5ce43cf20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:32:06.792685 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91889881-3a40-44fa-9b9e-e6b5ce43cf20 admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:06.793634 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91889881-3a40-44fa-9b9e-e6b5ce43cf20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:06.793947 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91889881-3a40-44fa-9b9e-e6b5ce43cf20 admin admin] PATH_INFO: `/v3/projects/2178317bb0ad44e0964ca9ee0750ac78/users/578ef2ddcd5d48c79350f5268ceda95f/roles/5b702713e40145b49e0b42abd0a5fba9` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:06.811748 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91889881-3a40-44fa-9b9e-e6b5ce43cf20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2178317bb0ad44e0964ca9ee0750ac78, user_id=578ef2ddcd5d48c79350f5268ceda95f, role_id=5b702713e40145b49e0b42abd0a5fba9)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:32:06.814629 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91889881-3a40-44fa-9b9e-e6b5ce43cf20 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:32:06.834121 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372ae13c-4bcd-4162-8cc8-f9360b1c3f10 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:32:06.834822 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1164/2310] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:32:06 2022] PUT /identity/v3/projects/2178317bb0ad44e0964ca9ee0750ac78/users/578ef2ddcd5d48c79350f5268ceda95f/roles/5b702713e40145b49e0b42abd0a5fba9 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:32:06.849940 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372ae13c-4bcd-4162-8cc8-f9360b1c3f10 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:32:06.925380 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb6a2f6-de53-4eeb-8d28-e76ef33a2724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:32:06.926266 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb6a2f6-de53-4eeb-8d28-e76ef33a2724 admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:06.926829 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb6a2f6-de53-4eeb-8d28-e76ef33a2724 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:06.927051 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb6a2f6-de53-4eeb-8d28-e76ef33a2724 admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:06.928511 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb6a2f6-de53-4eeb-8d28-e76ef33a2724 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:32:06.929880 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb6a2f6-de53-4eeb-8d28-e76ef33a2724 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:32:06.946908 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91889881-3a40-44fa-9b9e-e6b5ce43cf20 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:32:06.955824 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1147/2311] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:32:06 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:32:06.976535 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91889881-3a40-44fa-9b9e-e6b5ce43cf20 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:32:06.988569 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9069a4-5329-4ee5-aa96-d7e07ad560cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:32:06.989622 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9069a4-5329-4ee5-aa96-d7e07ad560cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:06.990195 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9069a4-5329-4ee5-aa96-d7e07ad560cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:06.990761 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9069a4-5329-4ee5-aa96-d7e07ad560cb admin admin] PATH_INFO: `/v3/projects/2178317bb0ad44e0964ca9ee0750ac78/users/578ef2ddcd5d48c79350f5268ceda95f/roles/5b702713e40145b49e0b42abd0a5fba9` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:06.999770 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9069a4-5329-4ee5-aa96-d7e07ad560cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=2178317bb0ad44e0964ca9ee0750ac78, user_id=578ef2ddcd5d48c79350f5268ceda95f, role_id=5b702713e40145b49e0b42abd0a5fba9)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:32:07.005954 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9069a4-5329-4ee5-aa96-d7e07ad560cb admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:32:07.045375 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1165/2312] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:32:06 2022] PUT /identity/v3/projects/2178317bb0ad44e0964ca9ee0750ac78/users/578ef2ddcd5d48c79350f5268ceda95f/roles/5b702713e40145b49e0b42abd0a5fba9 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 05:32:07.047194 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3afcea9-7b42-4391-909e-f0b7060cdc53 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:07.047666 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3afcea9-7b42-4391-909e-f0b7060cdc53 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:07.048038 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3afcea9-7b42-4391-909e-f0b7060cdc53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:07.097687 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-b3afcea9-7b42-4391-909e-f0b7060cdc53 None None] MFA Rules not processed for user `578ef2ddcd5d48c79350f5268ceda95f`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:32:07.098996 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-b3afcea9-7b42-4391-909e-f0b7060cdc53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:32:07.186872 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1148/2313] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:32:07 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:32:07.199637 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9069a4-5329-4ee5-aa96-d7e07ad560cb admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:32:07.201598 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-6e9069a4-5329-4ee5-aa96-d7e07ad560cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:32:07.287024 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9069a4-5329-4ee5-aa96-d7e07ad560cb admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:32:07.291035 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81be3a1d-d7e8-4fab-8386-1784d1a9fd26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a147e14b61d481db1cac02c58ac3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:32:07.291759 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be3a1d-d7e8-4fab-8386-1784d1a9fd26 service cinder] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:07.292122 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be3a1d-d7e8-4fab-8386-1784d1a9fd26 service cinder] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:07.292458 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be3a1d-d7e8-4fab-8386-1784d1a9fd26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:07.302854 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81be3a1d-d7e8-4fab-8386-1784d1a9fd26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:32:07.304665 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81be3a1d-d7e8-4fab-8386-1784d1a9fd26 service cinder] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:32:07.315360 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1166/2314] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:32:07 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 05:32:07.371896 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3afcea9-7b42-4391-909e-f0b7060cdc53 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:32:07.374028 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-b3afcea9-7b42-4391-909e-f0b7060cdc53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:32:07.388344 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3afcea9-7b42-4391-909e-f0b7060cdc53 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:32:07.392034 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0fd537-a4e4-4e73-930c-53651ad0f3a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a147e14b61d481db1cac02c58ac3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:32:07.392648 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0fd537-a4e4-4e73-930c-53651ad0f3a8 service cinder] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:07.392929 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0fd537-a4e4-4e73-930c-53651ad0f3a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:07.393202 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0fd537-a4e4-4e73-930c-53651ad0f3a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:07.398425 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:32:07.461477 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0fd537-a4e4-4e73-930c-53651ad0f3a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:32:07.463108 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0fd537-a4e4-4e73-930c-53651ad0f3a8 service cinder] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:32:07.474246 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1149/2315] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:32:07 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:32:11.532223 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81be3a1d-d7e8-4fab-8386-1784d1a9fd26 service cinder] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:32:11.642754 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81be3a1d-d7e8-4fab-8386-1784d1a9fd26 service cinder] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:32:11.649944 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a33253-a2f5-437f-8e4a-b19051f57ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:32:11.650777 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a33253-a2f5-437f-8e4a-b19051f57ddd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:11.651113 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a33253-a2f5-437f-8e4a-b19051f57ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:11.651394 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a33253-a2f5-437f-8e4a-b19051f57ddd admin admin] PATH_INFO: `/v3/users/72aea89715b3471db0a470a3a7418836` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:11.653576 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a33253-a2f5-437f-8e4a-b19051f57ddd admin admin] RBAC: Authorizing `identity:delete_user(user_id=72aea89715b3471db0a470a3a7418836)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:32:11.656360 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a33253-a2f5-437f-8e4a-b19051f57ddd admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:32:11.661372 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2ba10-9208-4768-acb9-b99a669db905 None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:11.662344 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2ba10-9208-4768-acb9-b99a669db905 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:11.662829 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2ba10-9208-4768-acb9-b99a669db905 None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:11.664429 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1150/2316] 10.222.0.16 () {54 vars in 921 bytes} [Sun Sep 11 05:32:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:32:11.671610 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9fcf1c-bfbd-4f8b-832d-118663d9a58f None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:11.672196 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9fcf1c-bfbd-4f8b-832d-118663d9a58f None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:11.672695 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9fcf1c-bfbd-4f8b-832d-118663d9a58f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:11.697737 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-4f9fcf1c-bfbd-4f8b-832d-118663d9a58f None None] MFA Rules not processed for user `6cd6136036bd467c946cae90d5c29263`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:32:11.699905 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-4f9fcf1c-bfbd-4f8b-832d-118663d9a58f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:32:11.709376 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:32:11.742458 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-58a33253-a2f5-437f-8e4a-b19051f57ddd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72aea89715b3471db0a470a3a7418836'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:11.775494 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-58a33253-a2f5-437f-8e4a-b19051f57ddd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72aea89715b3471db0a470a3a7418836'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:11.799019 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-58a33253-a2f5-437f-8e4a-b19051f57ddd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72aea89715b3471db0a470a3a7418836'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:11.804539 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1151/2317] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 11 05:32:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 05:32:11.816399 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-58a33253-a2f5-437f-8e4a-b19051f57ddd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72aea89715b3471db0a470a3a7418836'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:11.817780 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9fcf1c-bfbd-4f8b-832d-118663d9a58f None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:32:11.818609 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-58a33253-a2f5-437f-8e4a-b19051f57ddd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72aea89715b3471db0a470a3a7418836'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:11.819890 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-4f9fcf1c-bfbd-4f8b-832d-118663d9a58f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:32:11.837250 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1167/2318] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:32:11 2022] DELETE /identity/v3/users/72aea89715b3471db0a470a3a7418836 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:32:11.838621 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087c189f-1ebb-4403-b604-971afd66c5d8 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:11.838916 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087c189f-1ebb-4403-b604-971afd66c5d8 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:11.839207 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087c189f-1ebb-4403-b604-971afd66c5d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:11.904961 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9fcf1c-bfbd-4f8b-832d-118663d9a58f None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:32:11.905985 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-087c189f-1ebb-4403-b604-971afd66c5d8 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:32:11.907246 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-087c189f-1ebb-4403-b604-971afd66c5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:32:12.017088 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ede867-2db1-40c5-a684-281b7f795dd7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdd09106382447e9bf8b3a6a9ada89b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:32:12.018616 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ede867-2db1-40c5-a684-281b7f795dd7 service glance] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:12.019474 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ede867-2db1-40c5-a684-281b7f795dd7 service glance] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:12.020424 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ede867-2db1-40c5-a684-281b7f795dd7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:12.022796 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-96ede867-2db1-40c5-a684-281b7f795dd7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:32:12.030396 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:32:12.064002 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1168/2319] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:32:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:32:12.075737 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087c189f-1ebb-4403-b604-971afd66c5d8 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:32:12.077683 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-087c189f-1ebb-4403-b604-971afd66c5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:32:12.185881 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ede867-2db1-40c5-a684-281b7f795dd7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:32:12.189430 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ede867-2db1-40c5-a684-281b7f795dd7 service glance] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:32:12.211287 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1152/2320] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:32:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:32:12.217408 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087c189f-1ebb-4403-b604-971afd66c5d8 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:32:12.221602 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6bd4d7-9eec-40ff-9a44-613802317cb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:32:12.222265 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6bd4d7-9eec-40ff-9a44-613802317cb3 service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:12.222265 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6bd4d7-9eec-40ff-9a44-613802317cb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:12.222552 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6bd4d7-9eec-40ff-9a44-613802317cb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:12.237462 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6bd4d7-9eec-40ff-9a44-613802317cb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:32:12.239337 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6bd4d7-9eec-40ff-9a44-613802317cb3 service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:32:12.251065 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1169/2321] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:32:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 05:32:12.406743 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b157d79b-2d2e-4f1c-9da1-ee96147b9f22 None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:12.406895 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b157d79b-2d2e-4f1c-9da1-ee96147b9f22 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:12.407128 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b157d79b-2d2e-4f1c-9da1-ee96147b9f22 None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:12.408531 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1153/2322] 10.222.0.16 () {54 vars in 921 bytes} [Sun Sep 11 05:32:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:32:12.413570 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c76a6-abfe-4a50-aa30-cdfc8e167b9d None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:12.413863 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c76a6-abfe-4a50-aa30-cdfc8e167b9d None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:12.414139 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c76a6-abfe-4a50-aa30-cdfc8e167b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:12.440639 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-f83c76a6-abfe-4a50-aa30-cdfc8e167b9d None None] MFA Rules not processed for user `72086abb4e0547dc96d76a44886805ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:32:12.441894 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-f83c76a6-abfe-4a50-aa30-cdfc8e167b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:32:12.458229 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1170/2323] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 11 05:32:12 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:32:12.476500 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b157d79b-2d2e-4f1c-9da1-ee96147b9f22 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:32:12.493928 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b157d79b-2d2e-4f1c-9da1-ee96147b9f22 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:32:12.504115 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b7eaf1-037f-418b-917c-96b90d0865e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:32:12.504746 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b7eaf1-037f-418b-917c-96b90d0865e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:12.505027 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b7eaf1-037f-418b-917c-96b90d0865e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:12.505300 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b7eaf1-037f-418b-917c-96b90d0865e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:12.528366 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b7eaf1-037f-418b-917c-96b90d0865e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:32:12.529843 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b7eaf1-037f-418b-917c-96b90d0865e3 service neutron] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:32:12.544686 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1154/2324] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:32:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:32:12.657745 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21f8c1-7ba4-488e-874b-e6b8722276a0 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:12.659126 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21f8c1-7ba4-488e-874b-e6b8722276a0 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:12.659409 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21f8c1-7ba4-488e-874b-e6b8722276a0 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:12.661903 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1171/2325] 10.222.0.16 () {54 vars in 921 bytes} [Sun Sep 11 05:32:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:32:12.668870 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea4d69e-628d-44d1-bea5-3b317db76c57 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:12.669442 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea4d69e-628d-44d1-bea5-3b317db76c57 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:12.669535 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea4d69e-628d-44d1-bea5-3b317db76c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:12.705214 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-4ea4d69e-628d-44d1-bea5-3b317db76c57 None None] MFA Rules not processed for user `6cd6136036bd467c946cae90d5c29263`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:32:12.706432 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-4ea4d69e-628d-44d1-bea5-3b317db76c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:32:12.717398 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1155/2326] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 11 05:32:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 05:32:12.729288 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb21f8c1-7ba4-488e-874b-e6b8722276a0 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:32:12.744981 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea4d69e-628d-44d1-bea5-3b317db76c57 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:32:12.746746 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-4ea4d69e-628d-44d1-bea5-3b317db76c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:32:12.748735 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb21f8c1-7ba4-488e-874b-e6b8722276a0 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:32:12.762182 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f212589-8ab1-49f4-b551-ce5b680cbcf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:32:12.762936 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f212589-8ab1-49f4-b551-ce5b680cbcf2 service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:12.763283 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f212589-8ab1-49f4-b551-ce5b680cbcf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:12.763652 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f212589-8ab1-49f4-b551-ce5b680cbcf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:12.780911 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea4d69e-628d-44d1-bea5-3b317db76c57 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:32:12.787796 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f212589-8ab1-49f4-b551-ce5b680cbcf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:32:12.787796 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f212589-8ab1-49f4-b551-ce5b680cbcf2 service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:32:12.793263 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c506ff1d-d5ec-4c75-bc9f-35cbc3422285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:32:12.794009 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c506ff1d-d5ec-4c75-bc9f-35cbc3422285 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:12.794906 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c506ff1d-d5ec-4c75-bc9f-35cbc3422285 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:12.795194 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c506ff1d-d5ec-4c75-bc9f-35cbc3422285 admin admin] PATH_INFO: `/v3/projects/d5e877a72ac5492092597cb618a26eb3` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:12.797187 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c506ff1d-d5ec-4c75-bc9f-35cbc3422285 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5e877a72ac5492092597cb618a26eb3)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:32:12.798678 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1172/2327] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:32:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:32:12.799995 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c506ff1d-d5ec-4c75-bc9f-35cbc3422285 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:32:12.856149 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-c506ff1d-d5ec-4c75-bc9f-35cbc3422285 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5e877a72ac5492092597cb618a26eb3', 'request_id': 'req-c506ff1d-d5ec-4c75-bc9f-35cbc3422285'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:12.865030 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-c506ff1d-d5ec-4c75-bc9f-35cbc3422285 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5e877a72ac5492092597cb618a26eb3', 'request_id': 'req-c506ff1d-d5ec-4c75-bc9f-35cbc3422285'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:12.870810 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-c506ff1d-d5ec-4c75-bc9f-35cbc3422285 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5e877a72ac5492092597cb618a26eb3', 'request_id': 'req-c506ff1d-d5ec-4c75-bc9f-35cbc3422285'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:12.883251 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-c506ff1d-d5ec-4c75-bc9f-35cbc3422285 admin admin] The token cache is being invalidate because project d5e877a72ac5492092597cb618a26eb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81383) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:32:12.883601 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-c506ff1d-d5ec-4c75-bc9f-35cbc3422285 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:12.884411 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-c506ff1d-d5ec-4c75-bc9f-35cbc3422285 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:12.886149 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1156/2328] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:32:12 2022] DELETE /identity/v3/projects/d5e877a72ac5492092597cb618a26eb3 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:32:12.889933 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f212589-8ab1-49f4-b551-ce5b680cbcf2 service neutron] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:32:12.900598 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f212589-8ab1-49f4-b551-ce5b680cbcf2 service neutron] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:32:12.928099 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:32:12.971966 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240069aa-3539-4bac-833f-2737295d9207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:32:12.972740 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240069aa-3539-4bac-833f-2737295d9207 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:12.973034 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240069aa-3539-4bac-833f-2737295d9207 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:12.973375 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240069aa-3539-4bac-833f-2737295d9207 admin admin] PATH_INFO: `/v3/users/578ef2ddcd5d48c79350f5268ceda95f` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:12.974663 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240069aa-3539-4bac-833f-2737295d9207 admin admin] RBAC: Authorizing `identity:delete_user(user_id=578ef2ddcd5d48c79350f5268ceda95f)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:32:12.977046 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240069aa-3539-4bac-833f-2737295d9207 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:32:13.044114 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-240069aa-3539-4bac-833f-2737295d9207 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '578ef2ddcd5d48c79350f5268ceda95f'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:13.061941 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-240069aa-3539-4bac-833f-2737295d9207 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '578ef2ddcd5d48c79350f5268ceda95f'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:13.075478 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-240069aa-3539-4bac-833f-2737295d9207 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '578ef2ddcd5d48c79350f5268ceda95f'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:13.085550 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-240069aa-3539-4bac-833f-2737295d9207 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '578ef2ddcd5d48c79350f5268ceda95f'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:13.086314 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-240069aa-3539-4bac-833f-2737295d9207 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '578ef2ddcd5d48c79350f5268ceda95f'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:13.095836 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1173/2329] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:32:12 2022] DELETE /identity/v3/users/578ef2ddcd5d48c79350f5268ceda95f => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:32:13.409446 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c506ff1d-d5ec-4c75-bc9f-35cbc3422285 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:32:13.411196 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-c506ff1d-d5ec-4c75-bc9f-35cbc3422285 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:32:13.430008 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c506ff1d-d5ec-4c75-bc9f-35cbc3422285 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:32:13.467411 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c18dba9-cb06-4132-b076-efc06921e274 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:13.467731 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c18dba9-cb06-4132-b076-efc06921e274 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:13.468013 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c18dba9-cb06-4132-b076-efc06921e274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:13.487068 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:32:13.488521 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-6c18dba9-cb06-4132-b076-efc06921e274 None None] MFA Rules not processed for user `62fffbcf330a4bc183d0885c175f5a90`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:32:13.489818 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-6c18dba9-cb06-4132-b076-efc06921e274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:32:13.494805 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462fbfd5-f14c-49ba-8843-666b2be53361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:32:13.496679 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462fbfd5-f14c-49ba-8843-666b2be53361 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:13.497191 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462fbfd5-f14c-49ba-8843-666b2be53361 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:13.497783 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462fbfd5-f14c-49ba-8843-666b2be53361 admin admin] PATH_INFO: `/v3/projects/2178317bb0ad44e0964ca9ee0750ac78` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:13.499260 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462fbfd5-f14c-49ba-8843-666b2be53361 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2178317bb0ad44e0964ca9ee0750ac78)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:32:13.501055 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462fbfd5-f14c-49ba-8843-666b2be53361 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:32:13.550186 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1174/2330] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 11 05:32:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:32:13.556008 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-462fbfd5-f14c-49ba-8843-666b2be53361 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2178317bb0ad44e0964ca9ee0750ac78', 'request_id': 'req-462fbfd5-f14c-49ba-8843-666b2be53361'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:13.564268 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c18dba9-cb06-4132-b076-efc06921e274 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:32:13.565148 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-462fbfd5-f14c-49ba-8843-666b2be53361 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2178317bb0ad44e0964ca9ee0750ac78', 'request_id': 'req-462fbfd5-f14c-49ba-8843-666b2be53361'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:13.566157 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-6c18dba9-cb06-4132-b076-efc06921e274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:32:13.571328 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-462fbfd5-f14c-49ba-8843-666b2be53361 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2178317bb0ad44e0964ca9ee0750ac78', 'request_id': 'req-462fbfd5-f14c-49ba-8843-666b2be53361'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:13.584704 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-462fbfd5-f14c-49ba-8843-666b2be53361 admin admin] The token cache is being invalidate because project 2178317bb0ad44e0964ca9ee0750ac78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81383) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:32:13.584999 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-462fbfd5-f14c-49ba-8843-666b2be53361 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:13.585782 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-462fbfd5-f14c-49ba-8843-666b2be53361 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:13.587454 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1157/2331] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:32:13 2022] DELETE /identity/v3/projects/2178317bb0ad44e0964ca9ee0750ac78 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:32:13.593522 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9add1a-f774-4195-af57-f7f9b2ce6022 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:13.593888 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9add1a-f774-4195-af57-f7f9b2ce6022 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:13.594233 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9add1a-f774-4195-af57-f7f9b2ce6022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:13.618810 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-3e9add1a-f774-4195-af57-f7f9b2ce6022 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:32:13.620081 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-3e9add1a-f774-4195-af57-f7f9b2ce6022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:32:13.624803 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:32:13.646401 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c18dba9-cb06-4132-b076-efc06921e274 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:32:13.686265 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1158/2332] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:32:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 05:32:13.694444 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba1d1df-5619-4f22-8059-e671300490c6 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:13.694900 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba1d1df-5619-4f22-8059-e671300490c6 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:13.695824 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba1d1df-5619-4f22-8059-e671300490c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:13.711853 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6da9acc-12a9-4971-83e5-59172cda216b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bbe4555380345e485572d2da8b78be1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:32:13.712442 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da9acc-12a9-4971-83e5-59172cda216b service swift] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:13.712718 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da9acc-12a9-4971-83e5-59172cda216b service swift] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:13.712984 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da9acc-12a9-4971-83e5-59172cda216b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:13.714914 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-d6da9acc-12a9-4971-83e5-59172cda216b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:32:13.717431 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-2ba1d1df-5619-4f22-8059-e671300490c6 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:32:13.718612 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-2ba1d1df-5619-4f22-8059-e671300490c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:32:13.726759 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1159/2333] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:32:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 05:32:13.731333 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba1d1df-5619-4f22-8059-e671300490c6 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:32:13.740883 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba1d1df-5619-4f22-8059-e671300490c6 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:32:13.745579 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55df2f55-e3ab-4f20-99da-da4e8b921a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:32:13.746232 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55df2f55-e3ab-4f20-99da-da4e8b921a94 admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:13.746514 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55df2f55-e3ab-4f20-99da-da4e8b921a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:13.746812 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55df2f55-e3ab-4f20-99da-da4e8b921a94 admin admin] PATH_INFO: `/v3/domains` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:13.747454 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55df2f55-e3ab-4f20-99da-da4e8b921a94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:32:13.747785 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55df2f55-e3ab-4f20-99da-da4e8b921a94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:32:13.749400 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55df2f55-e3ab-4f20-99da-da4e8b921a94 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:32:13.762726 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1160/2334] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 05:32:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:32:13.766586 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55df2f55-e3ab-4f20-99da-da4e8b921a94 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:32:13.778563 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55df2f55-e3ab-4f20-99da-da4e8b921a94 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:32:13.781487 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6da9acc-12a9-4971-83e5-59172cda216b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:32:13.783753 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957bd6dc-730e-4085-b460-c4ed5b3a18c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:32:13.784276 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6da9acc-12a9-4971-83e5-59172cda216b service swift] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:32:13.784417 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957bd6dc-730e-4085-b460-c4ed5b3a18c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:13.784629 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957bd6dc-730e-4085-b460-c4ed5b3a18c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:13.784902 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957bd6dc-730e-4085-b460-c4ed5b3a18c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:13.785538 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957bd6dc-730e-4085-b460-c4ed5b3a18c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:32:13.787420 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957bd6dc-730e-4085-b460-c4ed5b3a18c2 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:32:13.795212 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1175/2335] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 05:32:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 11 05:32:13.827426 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1161/2336] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:32:13 2022] POST /identity/v3/projects => generated 375 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 05:32:13.829207 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6da9acc-12a9-4971-83e5-59172cda216b service swift] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:32:13.840499 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6da9acc-12a9-4971-83e5-59172cda216b service swift] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:32:13.904033 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efe5b06-ec2b-4236-890e-a93ec122589e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:32:13.904667 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe5b06-ec2b-4236-890e-a93ec122589e admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:13.905031 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe5b06-ec2b-4236-890e-a93ec122589e admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:13.905235 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe5b06-ec2b-4236-890e-a93ec122589e admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:13.905864 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efe5b06-ec2b-4236-890e-a93ec122589e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:32:13.907896 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efe5b06-ec2b-4236-890e-a93ec122589e admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:32:13.930840 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1176/2337] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:32:13 2022] POST /identity/v3/users => generated 288 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:32:13.935853 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957bd6dc-730e-4085-b460-c4ed5b3a18c2 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:32:13.946245 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957bd6dc-730e-4085-b460-c4ed5b3a18c2 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:32:13.952628 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3731ecd8-974b-4c00-972c-aadac777e262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:32:13.953440 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3731ecd8-974b-4c00-972c-aadac777e262 admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:13.953785 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3731ecd8-974b-4c00-972c-aadac777e262 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:13.954173 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3731ecd8-974b-4c00-972c-aadac777e262 admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:13.955125 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3731ecd8-974b-4c00-972c-aadac777e262 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:32:13.957754 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3731ecd8-974b-4c00-972c-aadac777e262 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:32:13.972851 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1162/2338] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:32:13 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:32:13.977183 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efe5b06-ec2b-4236-890e-a93ec122589e admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:32:13.989032 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efe5b06-ec2b-4236-890e-a93ec122589e admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:32:13.994650 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c98e49f-1f55-4a04-8c7c-a25845435a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:32:13.995262 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c98e49f-1f55-4a04-8c7c-a25845435a76 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:13.995546 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c98e49f-1f55-4a04-8c7c-a25845435a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:13.995994 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c98e49f-1f55-4a04-8c7c-a25845435a76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:13.996658 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c98e49f-1f55-4a04-8c7c-a25845435a76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:32:13.998284 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c98e49f-1f55-4a04-8c7c-a25845435a76 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:32:14.009679 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1177/2339] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:32:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:32:14.014143 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3731ecd8-974b-4c00-972c-aadac777e262 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:32:14.024945 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3731ecd8-974b-4c00-972c-aadac777e262 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:32:14.030236 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d9d431-db5c-4aed-a17d-0c88dccffec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:32:14.030966 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d9d431-db5c-4aed-a17d-0c88dccffec3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:14.031352 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d9d431-db5c-4aed-a17d-0c88dccffec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:14.031716 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d9d431-db5c-4aed-a17d-0c88dccffec3 admin admin] PATH_INFO: `/v3/projects/c346c7e3ace743bdb4312083aed27440/users/2aaf5e19c0254fddb1df484cc6f18edf/roles/aa7ff8e0ec1e48e5811335b9eb38b448` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:14.059880 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d9d431-db5c-4aed-a17d-0c88dccffec3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c346c7e3ace743bdb4312083aed27440, user_id=2aaf5e19c0254fddb1df484cc6f18edf, role_id=aa7ff8e0ec1e48e5811335b9eb38b448)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:32:14.062789 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d9d431-db5c-4aed-a17d-0c88dccffec3 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:32:14.077059 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1163/2340] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:32:14 2022] PUT /identity/v3/projects/c346c7e3ace743bdb4312083aed27440/users/2aaf5e19c0254fddb1df484cc6f18edf/roles/aa7ff8e0ec1e48e5811335b9eb38b448 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:32:14.088569 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a788ab9-389a-4a19-be7c-95f78125aaf5 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:14.088861 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a788ab9-389a-4a19-be7c-95f78125aaf5 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:14.089141 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a788ab9-389a-4a19-be7c-95f78125aaf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:14.114365 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:32:14.117559 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-8a788ab9-389a-4a19-be7c-95f78125aaf5 None None] MFA Rules not processed for user `2aaf5e19c0254fddb1df484cc6f18edf`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:32:14.119926 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-8a788ab9-389a-4a19-be7c-95f78125aaf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:32:14.202879 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1178/2341] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:32:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:32:14.204289 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d9d431-db5c-4aed-a17d-0c88dccffec3 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:32:14.218841 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:32:14.290892 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d9d431-db5c-4aed-a17d-0c88dccffec3 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:32:14.296928 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fea5c38-0994-4935-9a4a-429c75f672cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:32:14.297657 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea5c38-0994-4935-9a4a-429c75f672cd admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:14.298063 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea5c38-0994-4935-9a4a-429c75f672cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:14.298447 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea5c38-0994-4935-9a4a-429c75f672cd admin admin] PATH_INFO: `/v3/projects` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:14.299522 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fea5c38-0994-4935-9a4a-429c75f672cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:32:14.301677 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fea5c38-0994-4935-9a4a-429c75f672cd admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:32:14.363714 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1164/2342] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:32:14 2022] POST /identity/v3/projects => generated 373 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:32:14.366422 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a788ab9-389a-4a19-be7c-95f78125aaf5 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:32:14.388861 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a788ab9-389a-4a19-be7c-95f78125aaf5 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:32:14.475774 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539de12f-32d7-4fa3-9017-157123186550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:32:14.476392 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539de12f-32d7-4fa3-9017-157123186550 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:14.476666 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539de12f-32d7-4fa3-9017-157123186550 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:14.476938 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539de12f-32d7-4fa3-9017-157123186550 admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:14.477570 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539de12f-32d7-4fa3-9017-157123186550 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:32:14.479528 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539de12f-32d7-4fa3-9017-157123186550 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:32:14.507718 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1179/2343] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:32:14 2022] POST /identity/v3/users => generated 293 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:32:14.510399 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fea5c38-0994-4935-9a4a-429c75f672cd admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:32:14.521002 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fea5c38-0994-4935-9a4a-429c75f672cd admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:32:14.525827 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efba233-18f9-4ebf-a52d-7d074109d30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:32:14.526436 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efba233-18f9-4ebf-a52d-7d074109d30f admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:14.526714 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efba233-18f9-4ebf-a52d-7d074109d30f admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:14.526991 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efba233-18f9-4ebf-a52d-7d074109d30f admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:14.528303 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efba233-18f9-4ebf-a52d-7d074109d30f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:32:14.529869 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efba233-18f9-4ebf-a52d-7d074109d30f admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:32:14.541307 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1165/2344] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:32:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:32:14.545491 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539de12f-32d7-4fa3-9017-157123186550 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:32:14.555456 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539de12f-32d7-4fa3-9017-157123186550 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:32:14.561234 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080c24e1-57be-4cf6-8dab-2dbca1363285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:32:14.561899 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080c24e1-57be-4cf6-8dab-2dbca1363285 admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:14.562172 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080c24e1-57be-4cf6-8dab-2dbca1363285 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:14.562441 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080c24e1-57be-4cf6-8dab-2dbca1363285 admin admin] PATH_INFO: `/v3/projects/1ecdd6140d7e4a02a711667e4158c905/users/e3d30a9096b945849707d9574d864660/roles/5b702713e40145b49e0b42abd0a5fba9` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:14.581314 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080c24e1-57be-4cf6-8dab-2dbca1363285 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ecdd6140d7e4a02a711667e4158c905, user_id=e3d30a9096b945849707d9574d864660, role_id=5b702713e40145b49e0b42abd0a5fba9)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:32:14.584469 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080c24e1-57be-4cf6-8dab-2dbca1363285 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:32:14.600751 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1180/2345] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:32:14 2022] PUT /identity/v3/projects/1ecdd6140d7e4a02a711667e4158c905/users/e3d30a9096b945849707d9574d864660/roles/5b702713e40145b49e0b42abd0a5fba9 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:32:14.604518 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efba233-18f9-4ebf-a52d-7d074109d30f admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:32:14.615179 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efba233-18f9-4ebf-a52d-7d074109d30f admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:32:14.694713 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61496dc8-fdc2-4912-a604-13aed9ce0da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:32:14.695335 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61496dc8-fdc2-4912-a604-13aed9ce0da6 admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:14.695609 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61496dc8-fdc2-4912-a604-13aed9ce0da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:14.695940 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61496dc8-fdc2-4912-a604-13aed9ce0da6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:14.696585 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61496dc8-fdc2-4912-a604-13aed9ce0da6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:32:14.698666 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61496dc8-fdc2-4912-a604-13aed9ce0da6 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:32:14.709866 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1166/2346] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:32:14 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:32:14.713936 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080c24e1-57be-4cf6-8dab-2dbca1363285 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:32:14.725644 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080c24e1-57be-4cf6-8dab-2dbca1363285 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:32:14.731170 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36be93a9-30b8-4b94-94e9-e2c63d222375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:32:14.732112 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be93a9-30b8-4b94-94e9-e2c63d222375 admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:14.732585 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be93a9-30b8-4b94-94e9-e2c63d222375 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:14.733067 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be93a9-30b8-4b94-94e9-e2c63d222375 admin admin] PATH_INFO: `/v3/projects/1ecdd6140d7e4a02a711667e4158c905/users/e3d30a9096b945849707d9574d864660/roles/5b702713e40145b49e0b42abd0a5fba9` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:14.735214 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36be93a9-30b8-4b94-94e9-e2c63d222375 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ecdd6140d7e4a02a711667e4158c905, user_id=e3d30a9096b945849707d9574d864660, role_id=5b702713e40145b49e0b42abd0a5fba9)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:32:14.739619 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36be93a9-30b8-4b94-94e9-e2c63d222375 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:32:14.752399 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1181/2347] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:32:14 2022] PUT /identity/v3/projects/1ecdd6140d7e4a02a711667e4158c905/users/e3d30a9096b945849707d9574d864660/roles/5b702713e40145b49e0b42abd0a5fba9 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 05:32:14.762937 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2a2f0b-a623-449a-a60c-c9a3a591ecf3 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:14.763331 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2a2f0b-a623-449a-a60c-c9a3a591ecf3 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:14.763703 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2a2f0b-a623-449a-a60c-c9a3a591ecf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:14.795460 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-2d2a2f0b-a623-449a-a60c-c9a3a591ecf3 None None] MFA Rules not processed for user `e3d30a9096b945849707d9574d864660`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:32:14.796737 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-2d2a2f0b-a623-449a-a60c-c9a3a591ecf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:32:14.873691 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1167/2348] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:32:14 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:32:14.884896 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36be93a9-30b8-4b94-94e9-e2c63d222375 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:32:14.887173 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-36be93a9-30b8-4b94-94e9-e2c63d222375 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:32:14.952090 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36be93a9-30b8-4b94-94e9-e2c63d222375 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:32:14.955935 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcd9ad3-9334-47c2-bdb0-0e8f75acf3c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a147e14b61d481db1cac02c58ac3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:32:14.956546 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd9ad3-9334-47c2-bdb0-0e8f75acf3c9 service cinder] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:14.956818 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd9ad3-9334-47c2-bdb0-0e8f75acf3c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:14.957091 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd9ad3-9334-47c2-bdb0-0e8f75acf3c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:14.966205 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:32:15.016132 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcd9ad3-9334-47c2-bdb0-0e8f75acf3c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:32:15.017597 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcd9ad3-9334-47c2-bdb0-0e8f75acf3c9 service cinder] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:32:15.026460 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1182/2349] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:32:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:32:16.184207 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2a2f0b-a623-449a-a60c-c9a3a591ecf3 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:32:16.185764 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-2d2a2f0b-a623-449a-a60c-c9a3a591ecf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:32:16.196867 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:32:16.251283 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e59c66-1970-414d-a3ab-a7c5ca719e0f None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:16.251909 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e59c66-1970-414d-a3ab-a7c5ca719e0f None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:16.251909 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e59c66-1970-414d-a3ab-a7c5ca719e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:16.284337 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-59e59c66-1970-414d-a3ab-a7c5ca719e0f None None] MFA Rules not processed for user `62fffbcf330a4bc183d0885c175f5a90`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:32:16.285948 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-59e59c66-1970-414d-a3ab-a7c5ca719e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:32:16.291763 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2a2f0b-a623-449a-a60c-c9a3a591ecf3 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:32:16.297761 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62583a4a-fc95-4631-b3cc-1beba86aa52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:32:16.298487 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62583a4a-fc95-4631-b3cc-1beba86aa52f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:16.298833 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62583a4a-fc95-4631-b3cc-1beba86aa52f admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:16.299173 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62583a4a-fc95-4631-b3cc-1beba86aa52f admin admin] PATH_INFO: `/v3/users/da72fe720a584bba9dc2dafacdeac67d` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:16.301279 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62583a4a-fc95-4631-b3cc-1beba86aa52f admin admin] RBAC: Authorizing `identity:delete_user(user_id=da72fe720a584bba9dc2dafacdeac67d)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:32:16.303500 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62583a4a-fc95-4631-b3cc-1beba86aa52f admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:32:16.367342 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1183/2350] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 05:32:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:32:16.387751 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e59c66-1970-414d-a3ab-a7c5ca719e0f None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:32:16.390492 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-62583a4a-fc95-4631-b3cc-1beba86aa52f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da72fe720a584bba9dc2dafacdeac67d'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:16.391832 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-59e59c66-1970-414d-a3ab-a7c5ca719e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:32:16.425744 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-62583a4a-fc95-4631-b3cc-1beba86aa52f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da72fe720a584bba9dc2dafacdeac67d'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:16.438672 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-62583a4a-fc95-4631-b3cc-1beba86aa52f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da72fe720a584bba9dc2dafacdeac67d'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:16.451000 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-62583a4a-fc95-4631-b3cc-1beba86aa52f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da72fe720a584bba9dc2dafacdeac67d'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:16.451922 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-62583a4a-fc95-4631-b3cc-1beba86aa52f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da72fe720a584bba9dc2dafacdeac67d'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:16.467096 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1168/2351] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:32:16 2022] DELETE /identity/v3/users/da72fe720a584bba9dc2dafacdeac67d => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:32:16.509716 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e59c66-1970-414d-a3ab-a7c5ca719e0f None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:32:16.597392 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:32:16.613799 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de63b41-15ca-4198-b98e-11ee82f3e45a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bbe4555380345e485572d2da8b78be1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:32:16.614452 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de63b41-15ca-4198-b98e-11ee82f3e45a service swift] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:16.614731 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de63b41-15ca-4198-b98e-11ee82f3e45a service swift] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:16.615136 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de63b41-15ca-4198-b98e-11ee82f3e45a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:16.619163 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-2de63b41-15ca-4198-b98e-11ee82f3e45a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:32:16.706200 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de63b41-15ca-4198-b98e-11ee82f3e45a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:32:16.708683 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de63b41-15ca-4198-b98e-11ee82f3e45a service swift] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:32:16.734454 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1184/2352] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 05:32:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 05:32:16.865266 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62583a4a-fc95-4631-b3cc-1beba86aa52f admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:32:16.866924 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-62583a4a-fc95-4631-b3cc-1beba86aa52f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:32:17.085597 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62583a4a-fc95-4631-b3cc-1beba86aa52f admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:32:17.093016 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20943ec7-b626-4cf7-b3ec-f17d99e3aba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:32:17.093754 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20943ec7-b626-4cf7-b3ec-f17d99e3aba7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:17.094056 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20943ec7-b626-4cf7-b3ec-f17d99e3aba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:17.094345 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20943ec7-b626-4cf7-b3ec-f17d99e3aba7 admin admin] PATH_INFO: `/v3/projects/e0e61f834d344323a977845b34e33c5c` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:17.095757 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20943ec7-b626-4cf7-b3ec-f17d99e3aba7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0e61f834d344323a977845b34e33c5c)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:32:17.097816 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20943ec7-b626-4cf7-b3ec-f17d99e3aba7 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:32:17.160994 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:32:17.199849 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-20943ec7-b626-4cf7-b3ec-f17d99e3aba7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0e61f834d344323a977845b34e33c5c', 'request_id': 'req-20943ec7-b626-4cf7-b3ec-f17d99e3aba7'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:17.213643 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-20943ec7-b626-4cf7-b3ec-f17d99e3aba7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0e61f834d344323a977845b34e33c5c', 'request_id': 'req-20943ec7-b626-4cf7-b3ec-f17d99e3aba7'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:17.228392 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-20943ec7-b626-4cf7-b3ec-f17d99e3aba7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0e61f834d344323a977845b34e33c5c', 'request_id': 'req-20943ec7-b626-4cf7-b3ec-f17d99e3aba7'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:17.267177 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-20943ec7-b626-4cf7-b3ec-f17d99e3aba7 admin admin] The token cache is being invalidate because project e0e61f834d344323a977845b34e33c5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81383) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:32:17.268452 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-20943ec7-b626-4cf7-b3ec-f17d99e3aba7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:17.270429 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-20943ec7-b626-4cf7-b3ec-f17d99e3aba7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:17.278875 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1169/2353] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:32:16 2022] DELETE /identity/v3/projects/e0e61f834d344323a977845b34e33c5c => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:32:17.280993 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaecfa2-324f-4505-a35c-e3eda792d5af None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:17.281447 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaecfa2-324f-4505-a35c-e3eda792d5af None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:17.281771 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaecfa2-324f-4505-a35c-e3eda792d5af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:17.319823 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-dfaecfa2-324f-4505-a35c-e3eda792d5af None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:32:17.321097 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-dfaecfa2-324f-4505-a35c-e3eda792d5af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:32:17.446466 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1185/2354] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:32:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:32:17.454802 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f861f-26dc-4099-84d2-237f8d24f9c1 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:17.455095 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f861f-26dc-4099-84d2-237f8d24f9c1 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:17.455346 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f861f-26dc-4099-84d2-237f8d24f9c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:17.488325 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-895f861f-26dc-4099-84d2-237f8d24f9c1 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:32:17.490141 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-895f861f-26dc-4099-84d2-237f8d24f9c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:32:17.498655 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1170/2355] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:32:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 05:32:17.502746 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaecfa2-324f-4505-a35c-e3eda792d5af None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:32:17.514341 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaecfa2-324f-4505-a35c-e3eda792d5af None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:32:17.519595 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db305ec-2ddf-4ba1-974b-5b4b90652857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:32:17.523754 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db305ec-2ddf-4ba1-974b-5b4b90652857 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:17.523754 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db305ec-2ddf-4ba1-974b-5b4b90652857 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:17.523754 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db305ec-2ddf-4ba1-974b-5b4b90652857 admin admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:17.523754 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db305ec-2ddf-4ba1-974b-5b4b90652857 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:32:17.523754 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db305ec-2ddf-4ba1-974b-5b4b90652857 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:32:17.524257 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db305ec-2ddf-4ba1-974b-5b4b90652857 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:32:17.544035 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f861f-26dc-4099-84d2-237f8d24f9c1 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:32:17.550287 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1186/2356] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 05:32:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:32:17.554608 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f861f-26dc-4099-84d2-237f8d24f9c1 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:32:17.560155 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad164b0f-ab40-4c24-b87f-1ab01f88c153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:32:17.560778 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad164b0f-ab40-4c24-b87f-1ab01f88c153 admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:17.561057 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad164b0f-ab40-4c24-b87f-1ab01f88c153 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:17.561533 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad164b0f-ab40-4c24-b87f-1ab01f88c153 admin admin] PATH_INFO: `/v3/projects` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:17.562395 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad164b0f-ab40-4c24-b87f-1ab01f88c153 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:32:17.565462 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad164b0f-ab40-4c24-b87f-1ab01f88c153 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:32:17.606518 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db305ec-2ddf-4ba1-974b-5b4b90652857 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:32:17.613273 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1171/2357] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:32:17 2022] POST /identity/v3/projects => generated 373 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 05:32:17.618980 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db305ec-2ddf-4ba1-974b-5b4b90652857 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:32:17.752576 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda4ef6c-7130-4880-99e5-b103a7871182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:32:17.753232 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4ef6c-7130-4880-99e5-b103a7871182 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:17.754464 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4ef6c-7130-4880-99e5-b103a7871182 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:17.754809 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4ef6c-7130-4880-99e5-b103a7871182 admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:17.755718 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda4ef6c-7130-4880-99e5-b103a7871182 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:32:17.758009 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda4ef6c-7130-4880-99e5-b103a7871182 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:32:17.784124 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1187/2358] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:32:17 2022] POST /identity/v3/users => generated 287 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:32:17.788037 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad164b0f-ab40-4c24-b87f-1ab01f88c153 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:32:17.801873 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad164b0f-ab40-4c24-b87f-1ab01f88c153 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:32:17.808896 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58bb2d2-7ffd-40ef-a21e-6120d3c89ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:32:17.809769 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58bb2d2-7ffd-40ef-a21e-6120d3c89ffd admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:17.810185 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58bb2d2-7ffd-40ef-a21e-6120d3c89ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:17.810527 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58bb2d2-7ffd-40ef-a21e-6120d3c89ffd admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:17.811372 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58bb2d2-7ffd-40ef-a21e-6120d3c89ffd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:32:17.813311 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58bb2d2-7ffd-40ef-a21e-6120d3c89ffd admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:32:17.832268 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1172/2359] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:32:17 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:32:17.836439 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda4ef6c-7130-4880-99e5-b103a7871182 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:32:17.850693 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda4ef6c-7130-4880-99e5-b103a7871182 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:32:17.856460 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fc07e5-e8b6-4864-a42c-848932bdcb99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:32:17.858759 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58bb2d2-7ffd-40ef-a21e-6120d3c89ffd admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:32:17.860872 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-e58bb2d2-7ffd-40ef-a21e-6120d3c89ffd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:32:17.863748 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fc07e5-e8b6-4864-a42c-848932bdcb99 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:17.864317 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fc07e5-e8b6-4864-a42c-848932bdcb99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:17.864702 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fc07e5-e8b6-4864-a42c-848932bdcb99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:17.865543 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fc07e5-e8b6-4864-a42c-848932bdcb99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:32:17.867591 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fc07e5-e8b6-4864-a42c-848932bdcb99 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:32:17.877692 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58bb2d2-7ffd-40ef-a21e-6120d3c89ffd admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:32:17.883021 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758b038b-08d9-45f3-b14f-7b8cb743b027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:32:17.883940 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b038b-08d9-45f3-b14f-7b8cb743b027 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:17.884376 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b038b-08d9-45f3-b14f-7b8cb743b027 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:17.884803 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b038b-08d9-45f3-b14f-7b8cb743b027 admin admin] PATH_INFO: `/v3/users/2aaf5e19c0254fddb1df484cc6f18edf` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:17.885452 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1188/2360] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:32:17 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:32:17.889879 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758b038b-08d9-45f3-b14f-7b8cb743b027 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2aaf5e19c0254fddb1df484cc6f18edf)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:32:17.890566 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fc07e5-e8b6-4864-a42c-848932bdcb99 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:32:17.892455 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758b038b-08d9-45f3-b14f-7b8cb743b027 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:32:17.898617 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:32:17.907982 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fc07e5-e8b6-4864-a42c-848932bdcb99 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:32:17.913262 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db13870a-19a4-4dd9-8cec-9d404a32bc56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:32:17.914131 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db13870a-19a4-4dd9-8cec-9d404a32bc56 admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:17.914559 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db13870a-19a4-4dd9-8cec-9d404a32bc56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:17.914979 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db13870a-19a4-4dd9-8cec-9d404a32bc56 admin admin] PATH_INFO: `/v3/projects/4f7a74ba936846be82e204bff2081d70/users/1c5d30c81a0e40a3969a57257dbca563/roles/aa7ff8e0ec1e48e5811335b9eb38b448` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:17.968109 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db13870a-19a4-4dd9-8cec-9d404a32bc56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f7a74ba936846be82e204bff2081d70, user_id=1c5d30c81a0e40a3969a57257dbca563, role_id=aa7ff8e0ec1e48e5811335b9eb38b448)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:32:17.971841 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db13870a-19a4-4dd9-8cec-9d404a32bc56 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:32:17.991869 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1189/2361] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:32:17 2022] PUT /identity/v3/projects/4f7a74ba936846be82e204bff2081d70/users/1c5d30c81a0e40a3969a57257dbca563/roles/aa7ff8e0ec1e48e5811335b9eb38b448 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 05:32:18.003111 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa67a08f-7fa1-44da-93bd-26b796603e89 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:18.003669 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa67a08f-7fa1-44da-93bd-26b796603e89 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:18.004151 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa67a08f-7fa1-44da-93bd-26b796603e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:18.014583 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-758b038b-08d9-45f3-b14f-7b8cb743b027 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2aaf5e19c0254fddb1df484cc6f18edf'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:18.036340 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-758b038b-08d9-45f3-b14f-7b8cb743b027 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2aaf5e19c0254fddb1df484cc6f18edf'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:18.044847 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-758b038b-08d9-45f3-b14f-7b8cb743b027 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2aaf5e19c0254fddb1df484cc6f18edf'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:18.058839 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-758b038b-08d9-45f3-b14f-7b8cb743b027 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2aaf5e19c0254fddb1df484cc6f18edf'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:18.059823 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-758b038b-08d9-45f3-b14f-7b8cb743b027 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2aaf5e19c0254fddb1df484cc6f18edf'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:18.062336 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-aa67a08f-7fa1-44da-93bd-26b796603e89 None None] MFA Rules not processed for user `1c5d30c81a0e40a3969a57257dbca563`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:32:18.064073 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-aa67a08f-7fa1-44da-93bd-26b796603e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:32:18.070408 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1173/2362] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:32:17 2022] DELETE /identity/v3/users/2aaf5e19c0254fddb1df484cc6f18edf => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:32:18.072625 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98349ed-b260-4fba-871e-bcb0f6ef3f9f None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:18.073502 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98349ed-b260-4fba-871e-bcb0f6ef3f9f None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:18.076208 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98349ed-b260-4fba-871e-bcb0f6ef3f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:18.112316 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-b98349ed-b260-4fba-871e-bcb0f6ef3f9f None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:32:18.113817 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-b98349ed-b260-4fba-871e-bcb0f6ef3f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:32:18.196534 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=82,keystone:DELETE=15,keystone:INSERT=3 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:32:18.201025 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1190/2363] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:32:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:32:18.213178 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa67a08f-7fa1-44da-93bd-26b796603e89 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:32:18.216059 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-aa67a08f-7fa1-44da-93bd-26b796603e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:32:18.238546 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1174/2364] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:32:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:32:18.245795 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98349ed-b260-4fba-871e-bcb0f6ef3f9f None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:32:18.248013 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-b98349ed-b260-4fba-871e-bcb0f6ef3f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:32:18.332027 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98349ed-b260-4fba-871e-bcb0f6ef3f9f None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:32:18.336025 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340aca12-c48a-4063-a374-a38a0aae69b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:32:18.336709 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340aca12-c48a-4063-a374-a38a0aae69b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:18.336991 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340aca12-c48a-4063-a374-a38a0aae69b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:18.337261 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340aca12-c48a-4063-a374-a38a0aae69b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:18.348642 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340aca12-c48a-4063-a374-a38a0aae69b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:32:18.350119 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340aca12-c48a-4063-a374-a38a0aae69b6 service neutron] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:32:18.361251 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa67a08f-7fa1-44da-93bd-26b796603e89 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:32:18.361967 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1175/2365] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:32:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:32:18.367298 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ff49a1-eba2-46e5-98c8-d09e474b920d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a147e14b61d481db1cac02c58ac3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:32:18.368176 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff49a1-eba2-46e5-98c8-d09e474b920d service cinder] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:18.368819 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff49a1-eba2-46e5-98c8-d09e474b920d service cinder] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:18.369347 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff49a1-eba2-46e5-98c8-d09e474b920d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:18.379888 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ff49a1-eba2-46e5-98c8-d09e474b920d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:32:18.381704 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ff49a1-eba2-46e5-98c8-d09e474b920d service cinder] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:32:18.397144 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1191/2366] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:32:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 05:32:18.734646 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340aca12-c48a-4063-a374-a38a0aae69b6 service neutron] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:32:18.734646 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-340aca12-c48a-4063-a374-a38a0aae69b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:32:18.750627 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340aca12-c48a-4063-a374-a38a0aae69b6 service neutron] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:32:18.755867 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5c8cbf-7213-42fa-b168-1812636379cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:32:18.757209 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c8cbf-7213-42fa-b168-1812636379cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:18.757209 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c8cbf-7213-42fa-b168-1812636379cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:18.757209 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c8cbf-7213-42fa-b168-1812636379cc admin admin] PATH_INFO: `/v3/projects/c346c7e3ace743bdb4312083aed27440` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:18.758563 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5c8cbf-7213-42fa-b168-1812636379cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=c346c7e3ace743bdb4312083aed27440)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:32:18.760627 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5c8cbf-7213-42fa-b168-1812636379cc admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:32:18.830849 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-5d5c8cbf-7213-42fa-b168-1812636379cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c346c7e3ace743bdb4312083aed27440', 'request_id': 'req-5d5c8cbf-7213-42fa-b168-1812636379cc'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:18.841392 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-5d5c8cbf-7213-42fa-b168-1812636379cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c346c7e3ace743bdb4312083aed27440', 'request_id': 'req-5d5c8cbf-7213-42fa-b168-1812636379cc'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:18.867801 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-5d5c8cbf-7213-42fa-b168-1812636379cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c346c7e3ace743bdb4312083aed27440', 'request_id': 'req-5d5c8cbf-7213-42fa-b168-1812636379cc'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:18.880940 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-5d5c8cbf-7213-42fa-b168-1812636379cc admin admin] The token cache is being invalidate because project c346c7e3ace743bdb4312083aed27440 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81383) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:32:18.881367 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-5d5c8cbf-7213-42fa-b168-1812636379cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:18.882046 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-5d5c8cbf-7213-42fa-b168-1812636379cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:18.883777 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1176/2367] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:32:18 2022] DELETE /identity/v3/projects/c346c7e3ace743bdb4312083aed27440 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:32:18.889247 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ff49a1-eba2-46e5-98c8-d09e474b920d service cinder] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:32:18.912312 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ff49a1-eba2-46e5-98c8-d09e474b920d service cinder] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:32:19.008717 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d1c54e-94f9-4952-93b1-1f3f407100b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:32:19.009714 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d1c54e-94f9-4952-93b1-1f3f407100b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:19.010031 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d1c54e-94f9-4952-93b1-1f3f407100b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:19.010444 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d1c54e-94f9-4952-93b1-1f3f407100b1 admin admin] PATH_INFO: `/v3/users/e3d30a9096b945849707d9574d864660` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:19.012213 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d1c54e-94f9-4952-93b1-1f3f407100b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3d30a9096b945849707d9574d864660)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:32:19.014245 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d1c54e-94f9-4952-93b1-1f3f407100b1 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:32:19.030530 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:32:19.069270 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-16d1c54e-94f9-4952-93b1-1f3f407100b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3d30a9096b945849707d9574d864660'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:19.082757 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-16d1c54e-94f9-4952-93b1-1f3f407100b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3d30a9096b945849707d9574d864660'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:19.090272 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-16d1c54e-94f9-4952-93b1-1f3f407100b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3d30a9096b945849707d9574d864660'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:19.097824 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-16d1c54e-94f9-4952-93b1-1f3f407100b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3d30a9096b945849707d9574d864660'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:19.098445 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-16d1c54e-94f9-4952-93b1-1f3f407100b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3d30a9096b945849707d9574d864660'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:19.104378 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1192/2368] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:32:18 2022] DELETE /identity/v3/users/e3d30a9096b945849707d9574d864660 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 05:32:19.452770 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5c8cbf-7213-42fa-b168-1812636379cc admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:32:19.454602 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-5d5c8cbf-7213-42fa-b168-1812636379cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:32:19.470526 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5c8cbf-7213-42fa-b168-1812636379cc admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:32:19.549957 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c74dcfa-8731-4689-b576-6f8c75e66364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:32:19.550665 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c74dcfa-8731-4689-b576-6f8c75e66364 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:19.551534 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c74dcfa-8731-4689-b576-6f8c75e66364 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:19.551854 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c74dcfa-8731-4689-b576-6f8c75e66364 admin admin] PATH_INFO: `/v3/projects/1ecdd6140d7e4a02a711667e4158c905` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:19.553058 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c74dcfa-8731-4689-b576-6f8c75e66364 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ecdd6140d7e4a02a711667e4158c905)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:32:19.555083 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c74dcfa-8731-4689-b576-6f8c75e66364 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:32:19.584486 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:32:19.619995 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-9c74dcfa-8731-4689-b576-6f8c75e66364 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ecdd6140d7e4a02a711667e4158c905', 'request_id': 'req-9c74dcfa-8731-4689-b576-6f8c75e66364'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:19.634240 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-9c74dcfa-8731-4689-b576-6f8c75e66364 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ecdd6140d7e4a02a711667e4158c905', 'request_id': 'req-9c74dcfa-8731-4689-b576-6f8c75e66364'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:19.641477 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-9c74dcfa-8731-4689-b576-6f8c75e66364 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ecdd6140d7e4a02a711667e4158c905', 'request_id': 'req-9c74dcfa-8731-4689-b576-6f8c75e66364'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:19.654651 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-9c74dcfa-8731-4689-b576-6f8c75e66364 admin admin] The token cache is being invalidate because project 1ecdd6140d7e4a02a711667e4158c905 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81383) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:32:19.655715 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-9c74dcfa-8731-4689-b576-6f8c75e66364 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:19.656486 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-9c74dcfa-8731-4689-b576-6f8c75e66364 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:19.661950 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1177/2369] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:32:19 2022] DELETE /identity/v3/projects/1ecdd6140d7e4a02a711667e4158c905 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:32:19.664956 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c700c4b-5a6a-4ed8-8c9d-721eb47344b4 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:19.665451 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c700c4b-5a6a-4ed8-8c9d-721eb47344b4 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:19.665838 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c700c4b-5a6a-4ed8-8c9d-721eb47344b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:19.686722 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-0c700c4b-5a6a-4ed8-8c9d-721eb47344b4 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:32:19.688277 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-0c700c4b-5a6a-4ed8-8c9d-721eb47344b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:32:19.761837 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1193/2370] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:32:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 05:32:19.770753 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ebb822-1480-46f1-985a-76cb17246ddb None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:19.771076 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ebb822-1480-46f1-985a-76cb17246ddb None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:19.771358 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ebb822-1480-46f1-985a-76cb17246ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:19.794611 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-72ebb822-1480-46f1-985a-76cb17246ddb None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:32:19.795921 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-72ebb822-1480-46f1-985a-76cb17246ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:32:19.803993 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1178/2371] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:32:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:32:19.809042 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c700c4b-5a6a-4ed8-8c9d-721eb47344b4 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:32:19.819083 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c700c4b-5a6a-4ed8-8c9d-721eb47344b4 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:32:19.824538 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ef6e2-c2eb-413a-b6a5-ba18e16bdef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:32:19.825225 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ef6e2-c2eb-413a-b6a5-ba18e16bdef3 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:19.825604 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ef6e2-c2eb-413a-b6a5-ba18e16bdef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:19.826047 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ef6e2-c2eb-413a-b6a5-ba18e16bdef3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:19.826760 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971ef6e2-c2eb-413a-b6a5-ba18e16bdef3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:32:19.827155 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971ef6e2-c2eb-413a-b6a5-ba18e16bdef3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:32:19.829224 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971ef6e2-c2eb-413a-b6a5-ba18e16bdef3 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:32:19.842666 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1194/2372] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 05:32:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:32:19.847138 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ebb822-1480-46f1-985a-76cb17246ddb None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:32:19.857369 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ebb822-1480-46f1-985a-76cb17246ddb None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:32:19.862596 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1127693f-8c14-4a5d-831f-24180fd0dfe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:32:19.863499 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1127693f-8c14-4a5d-831f-24180fd0dfe2 admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:19.863785 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1127693f-8c14-4a5d-831f-24180fd0dfe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:19.864176 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1127693f-8c14-4a5d-831f-24180fd0dfe2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:19.864719 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1127693f-8c14-4a5d-831f-24180fd0dfe2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:32:19.866628 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1127693f-8c14-4a5d-831f-24180fd0dfe2 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:32:19.903172 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1179/2373] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:32:19 2022] POST /identity/v3/projects => generated 371 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:32:19.907489 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ef6e2-c2eb-413a-b6a5-ba18e16bdef3 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:32:19.930305 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ef6e2-c2eb-413a-b6a5-ba18e16bdef3 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:32:20.005821 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a667ff0-ed7d-4ea0-8e7c-1a9fdc1f15ce None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:20.006096 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a667ff0-ed7d-4ea0-8e7c-1a9fdc1f15ce None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:20.006398 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a667ff0-ed7d-4ea0-8e7c-1a9fdc1f15ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:20.018790 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efef37ee-5aa9-4905-ba34-a1e8fb1c9274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:32:20.019937 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef37ee-5aa9-4905-ba34-a1e8fb1c9274 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:20.020508 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef37ee-5aa9-4905-ba34-a1e8fb1c9274 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:20.021085 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef37ee-5aa9-4905-ba34-a1e8fb1c9274 admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:20.021906 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efef37ee-5aa9-4905-ba34-a1e8fb1c9274 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:32:20.024709 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efef37ee-5aa9-4905-ba34-a1e8fb1c9274 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:32:20.030796 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-7a667ff0-ed7d-4ea0-8e7c-1a9fdc1f15ce None None] MFA Rules not processed for user `1c5d30c81a0e40a3969a57257dbca563`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:32:20.032124 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-7a667ff0-ed7d-4ea0-8e7c-1a9fdc1f15ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:32:20.054607 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1195/2374] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:32:19 2022] POST /identity/v3/users => generated 286 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:32:20.060664 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efef37ee-5aa9-4905-ba34-a1e8fb1c9274 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:32:20.075273 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efef37ee-5aa9-4905-ba34-a1e8fb1c9274 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:32:20.081567 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3271f13d-cec5-4450-b484-6939195903ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:32:20.082358 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3271f13d-cec5-4450-b484-6939195903ed admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:20.082649 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3271f13d-cec5-4450-b484-6939195903ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:20.082928 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3271f13d-cec5-4450-b484-6939195903ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:20.083587 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3271f13d-cec5-4450-b484-6939195903ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:32:20.085266 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3271f13d-cec5-4450-b484-6939195903ed admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:32:20.088625 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:32:20.106785 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1196/2375] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:32:20 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:32:20.117311 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1180/2376] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:32:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 05:32:20.139393 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3271f13d-cec5-4450-b484-6939195903ed admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:32:20.151673 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3271f13d-cec5-4450-b484-6939195903ed admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:32:20.159420 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b9d398-1554-4af9-99d1-207a83fafd50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:32:20.160296 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b9d398-1554-4af9-99d1-207a83fafd50 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:20.160578 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b9d398-1554-4af9-99d1-207a83fafd50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:20.160846 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b9d398-1554-4af9-99d1-207a83fafd50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:20.161489 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b9d398-1554-4af9-99d1-207a83fafd50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:32:20.163094 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b9d398-1554-4af9-99d1-207a83fafd50 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:32:20.175729 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1197/2377] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:32:20 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:32:20.178751 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a667ff0-ed7d-4ea0-8e7c-1a9fdc1f15ce None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:32:20.191261 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a667ff0-ed7d-4ea0-8e7c-1a9fdc1f15ce None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:32:20.197271 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a280f3-e2f9-4787-99c4-77ee1a3f3ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:32:20.198023 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a280f3-e2f9-4787-99c4-77ee1a3f3ec4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:20.198372 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a280f3-e2f9-4787-99c4-77ee1a3f3ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:20.200025 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a280f3-e2f9-4787-99c4-77ee1a3f3ec4 admin admin] PATH_INFO: `/v3/projects/b728568d02434e138b4b7018d7e0a311/users/cfc69d22910049fbb0d3a1eeeefb319b/roles/aa7ff8e0ec1e48e5811335b9eb38b448` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:20.216918 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a280f3-e2f9-4787-99c4-77ee1a3f3ec4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b728568d02434e138b4b7018d7e0a311, user_id=cfc69d22910049fbb0d3a1eeeefb319b, role_id=aa7ff8e0ec1e48e5811335b9eb38b448)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:32:20.219805 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a280f3-e2f9-4787-99c4-77ee1a3f3ec4 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:32:20.256401 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1181/2378] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:32:20 2022] PUT /identity/v3/projects/b728568d02434e138b4b7018d7e0a311/users/cfc69d22910049fbb0d3a1eeeefb319b/roles/aa7ff8e0ec1e48e5811335b9eb38b448 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:32:20.267628 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d53cb-0cb8-4a3f-bbb5-8f9de139dea8 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:20.268005 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d53cb-0cb8-4a3f-bbb5-8f9de139dea8 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:20.268411 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d53cb-0cb8-4a3f-bbb5-8f9de139dea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:20.316646 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-cd3d53cb-0cb8-4a3f-bbb5-8f9de139dea8 None None] MFA Rules not processed for user `cfc69d22910049fbb0d3a1eeeefb319b`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:32:20.318207 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-cd3d53cb-0cb8-4a3f-bbb5-8f9de139dea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:32:20.401838 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1198/2379] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:32:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:32:20.415968 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a280f3-e2f9-4787-99c4-77ee1a3f3ec4 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:32:20.417743 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-b1a280f3-e2f9-4787-99c4-77ee1a3f3ec4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:32:20.513881 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a280f3-e2f9-4787-99c4-77ee1a3f3ec4 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:32:20.517894 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f109a1a-fe1d-4529-9781-1b95ece8d613 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdd09106382447e9bf8b3a6a9ada89b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:32:20.518683 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f109a1a-fe1d-4529-9781-1b95ece8d613 service glance] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:20.519145 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f109a1a-fe1d-4529-9781-1b95ece8d613 service glance] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:20.519515 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f109a1a-fe1d-4529-9781-1b95ece8d613 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:20.529577 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f109a1a-fe1d-4529-9781-1b95ece8d613 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:32:20.531149 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f109a1a-fe1d-4529-9781-1b95ece8d613 service glance] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:32:20.536302 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:32:20.541749 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1182/2380] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:32:20 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:32:30.392547 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=38 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:32:33.477384 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084eeaa8-2541-4b5a-8010-1caa92eb06c7 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:33.477945 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084eeaa8-2541-4b5a-8010-1caa92eb06c7 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:33.477945 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084eeaa8-2541-4b5a-8010-1caa92eb06c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:33.497964 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-084eeaa8-2541-4b5a-8010-1caa92eb06c7 None None] MFA Rules not processed for user `62fffbcf330a4bc183d0885c175f5a90`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:32:33.499169 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-084eeaa8-2541-4b5a-8010-1caa92eb06c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:32:33.552755 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1199/2381] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 11 05:32:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:32:33.564838 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f109a1a-fe1d-4529-9781-1b95ece8d613 service glance] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:32:33.566305 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-9f109a1a-fe1d-4529-9781-1b95ece8d613 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:32:33.634256 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f109a1a-fe1d-4529-9781-1b95ece8d613 service glance] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:32:33.639668 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a315c404-1f5d-4a32-a0eb-16f2595f0ade service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bbe4555380345e485572d2da8b78be1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:32:33.640313 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a315c404-1f5d-4a32-a0eb-16f2595f0ade service swift] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:33.640552 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a315c404-1f5d-4a32-a0eb-16f2595f0ade service swift] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:33.640820 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a315c404-1f5d-4a32-a0eb-16f2595f0ade service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:33.648864 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a315c404-1f5d-4a32-a0eb-16f2595f0ade service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:32:33.650518 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a315c404-1f5d-4a32-a0eb-16f2595f0ade service swift] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:32:33.660671 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1183/2382] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 05:32:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 05:32:40.222557 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bded7f8-417b-45f8-b61d-afe129d872e4 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:40.223027 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bded7f8-417b-45f8-b61d-afe129d872e4 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:40.223226 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bded7f8-417b-45f8-b61d-afe129d872e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:40.243103 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-2bded7f8-417b-45f8-b61d-afe129d872e4 None None] MFA Rules not processed for user `62fffbcf330a4bc183d0885c175f5a90`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:32:40.245054 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-2bded7f8-417b-45f8-b61d-afe129d872e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:32:40.252466 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1200/2383] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 05:32:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:32:40.266748 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a315c404-1f5d-4a32-a0eb-16f2595f0ade service swift] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:32:40.277864 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a315c404-1f5d-4a32-a0eb-16f2595f0ade service swift] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:32:40.282929 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62271b31-f7c7-417d-be07-ca21f3ff1b30 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bbe4555380345e485572d2da8b78be1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:32:40.283527 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62271b31-f7c7-417d-be07-ca21f3ff1b30 service swift] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:40.283842 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62271b31-f7c7-417d-be07-ca21f3ff1b30 service swift] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:40.284120 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62271b31-f7c7-417d-be07-ca21f3ff1b30 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:40.292765 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62271b31-f7c7-417d-be07-ca21f3ff1b30 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:32:40.294367 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62271b31-f7c7-417d-be07-ca21f3ff1b30 service swift] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:32:40.303060 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1184/2384] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 05:32:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 05:32:40.818807 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2efde31-d1eb-4bcb-b62f-902c36931c9b None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:40.819088 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2efde31-d1eb-4bcb-b62f-902c36931c9b None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:40.819360 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2efde31-d1eb-4bcb-b62f-902c36931c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:40.838798 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-a2efde31-d1eb-4bcb-b62f-902c36931c9b None None] MFA Rules not processed for user `62fffbcf330a4bc183d0885c175f5a90`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:32:40.840026 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-a2efde31-d1eb-4bcb-b62f-902c36931c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:32:40.847059 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1201/2385] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 11 05:32:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:32:40.859776 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62271b31-f7c7-417d-be07-ca21f3ff1b30 service swift] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:32:40.871241 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62271b31-f7c7-417d-be07-ca21f3ff1b30 service swift] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:32:40.876197 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce46fd4d-71c3-443a-8335-728d95b5315f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bbe4555380345e485572d2da8b78be1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:32:40.876804 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce46fd4d-71c3-443a-8335-728d95b5315f service swift] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:40.877081 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce46fd4d-71c3-443a-8335-728d95b5315f service swift] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:40.877348 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce46fd4d-71c3-443a-8335-728d95b5315f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:40.885754 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce46fd4d-71c3-443a-8335-728d95b5315f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:32:40.887312 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce46fd4d-71c3-443a-8335-728d95b5315f service swift] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:32:40.895616 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1185/2386] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 05:32:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 05:32:41.128310 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b24a8c-3d6d-4838-b719-5fbec83fa1a2 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:41.128770 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b24a8c-3d6d-4838-b719-5fbec83fa1a2 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:41.129283 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b24a8c-3d6d-4838-b719-5fbec83fa1a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:41.161966 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-35b24a8c-3d6d-4838-b719-5fbec83fa1a2 None None] MFA Rules not processed for user `62fffbcf330a4bc183d0885c175f5a90`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:32:41.164019 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-35b24a8c-3d6d-4838-b719-5fbec83fa1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:32:41.176203 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1202/2387] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 05:32:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:32:41.190047 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce46fd4d-71c3-443a-8335-728d95b5315f service swift] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:32:41.203424 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce46fd4d-71c3-443a-8335-728d95b5315f service swift] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:32:41.208815 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5390d2e4-840c-4b13-a304-c23626ed9542 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bbe4555380345e485572d2da8b78be1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:32:41.209485 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390d2e4-840c-4b13-a304-c23626ed9542 service swift] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:41.209725 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390d2e4-840c-4b13-a304-c23626ed9542 service swift] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:41.210001 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390d2e4-840c-4b13-a304-c23626ed9542 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:41.219899 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5390d2e4-840c-4b13-a304-c23626ed9542 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:32:41.221621 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5390d2e4-840c-4b13-a304-c23626ed9542 service swift] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:32:41.231447 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1186/2388] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 05:32:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 11 05:32:41.568811 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04bf592-b430-4e68-9c69-6f5f23b0ebb5 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:41.569306 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04bf592-b430-4e68-9c69-6f5f23b0ebb5 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:41.569405 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04bf592-b430-4e68-9c69-6f5f23b0ebb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:41.592971 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-c04bf592-b430-4e68-9c69-6f5f23b0ebb5 None None] MFA Rules not processed for user `62fffbcf330a4bc183d0885c175f5a90`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:32:41.594098 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-c04bf592-b430-4e68-9c69-6f5f23b0ebb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:32:41.601205 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1203/2389] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 11 05:32:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:32:41.614652 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5390d2e4-840c-4b13-a304-c23626ed9542 service swift] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:32:41.625807 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5390d2e4-840c-4b13-a304-c23626ed9542 service swift] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:32:41.631019 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668f89e7-6886-4fe3-9394-58cf382628b2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bbe4555380345e485572d2da8b78be1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:32:41.631609 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f89e7-6886-4fe3-9394-58cf382628b2 service swift] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:41.631975 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f89e7-6886-4fe3-9394-58cf382628b2 service swift] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:41.632246 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f89e7-6886-4fe3-9394-58cf382628b2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:41.641379 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668f89e7-6886-4fe3-9394-58cf382628b2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:32:41.643031 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668f89e7-6886-4fe3-9394-58cf382628b2 service swift] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:32:41.653157 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1187/2390] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 05:32:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 05:32:43.725016 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04bf592-b430-4e68-9c69-6f5f23b0ebb5 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:32:43.795213 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04bf592-b430-4e68-9c69-6f5f23b0ebb5 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:32:43.800029 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e20cf4-5d1d-4e38-8191-8134bff6523c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:32:43.800673 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e20cf4-5d1d-4e38-8191-8134bff6523c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:43.802076 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e20cf4-5d1d-4e38-8191-8134bff6523c admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:43.802076 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e20cf4-5d1d-4e38-8191-8134bff6523c admin admin] PATH_INFO: `/v3/users/cfc69d22910049fbb0d3a1eeeefb319b` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:43.802384 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e20cf4-5d1d-4e38-8191-8134bff6523c admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfc69d22910049fbb0d3a1eeeefb319b)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:32:43.804373 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e20cf4-5d1d-4e38-8191-8134bff6523c admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:32:43.814426 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668f89e7-6886-4fe3-9394-58cf382628b2 service swift] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:32:43.815834 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-668f89e7-6886-4fe3-9394-58cf382628b2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:32:43.833819 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668f89e7-6886-4fe3-9394-58cf382628b2 service swift] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:32:43.838970 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14908f4e-c879-4c2f-9bfb-ac836f9a61ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:32:43.839704 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14908f4e-c879-4c2f-9bfb-ac836f9a61ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:43.840068 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14908f4e-c879-4c2f-9bfb-ac836f9a61ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:43.840408 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14908f4e-c879-4c2f-9bfb-ac836f9a61ba admin admin] PATH_INFO: `/v3/users/1c5d30c81a0e40a3969a57257dbca563` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:43.841617 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14908f4e-c879-4c2f-9bfb-ac836f9a61ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c5d30c81a0e40a3969a57257dbca563)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:32:43.843762 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14908f4e-c879-4c2f-9bfb-ac836f9a61ba admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:32:43.855513 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-09e20cf4-5d1d-4e38-8191-8134bff6523c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfc69d22910049fbb0d3a1eeeefb319b'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:43.876130 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-09e20cf4-5d1d-4e38-8191-8134bff6523c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfc69d22910049fbb0d3a1eeeefb319b'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:43.882354 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-09e20cf4-5d1d-4e38-8191-8134bff6523c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfc69d22910049fbb0d3a1eeeefb319b'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:43.890927 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-09e20cf4-5d1d-4e38-8191-8134bff6523c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfc69d22910049fbb0d3a1eeeefb319b'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:43.891602 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-09e20cf4-5d1d-4e38-8191-8134bff6523c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfc69d22910049fbb0d3a1eeeefb319b'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:43.893029 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:32:43.895577 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-14908f4e-c879-4c2f-9bfb-ac836f9a61ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c5d30c81a0e40a3969a57257dbca563'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:43.899301 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1204/2391] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:32:43 2022] DELETE /identity/v3/users/cfc69d22910049fbb0d3a1eeeefb319b => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:32:43.903770 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330f243-af5c-41cc-8737-089602247701 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:43.904026 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330f243-af5c-41cc-8737-089602247701 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:43.904493 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330f243-af5c-41cc-8737-089602247701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:43.909803 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-14908f4e-c879-4c2f-9bfb-ac836f9a61ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c5d30c81a0e40a3969a57257dbca563'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:43.916766 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-14908f4e-c879-4c2f-9bfb-ac836f9a61ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c5d30c81a0e40a3969a57257dbca563'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:43.924035 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-14908f4e-c879-4c2f-9bfb-ac836f9a61ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c5d30c81a0e40a3969a57257dbca563'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:43.924503 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-2330f243-af5c-41cc-8737-089602247701 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:32:43.924650 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-14908f4e-c879-4c2f-9bfb-ac836f9a61ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c5d30c81a0e40a3969a57257dbca563'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:43.925709 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-2330f243-af5c-41cc-8737-089602247701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:32:43.934086 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1188/2392] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:32:43 2022] DELETE /identity/v3/users/1c5d30c81a0e40a3969a57257dbca563 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:32:43.935516 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652809d-510b-4590-961c-97a7a0c56ba9 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:43.935832 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652809d-510b-4590-961c-97a7a0c56ba9 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:43.936113 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652809d-510b-4590-961c-97a7a0c56ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:43.955347 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-5652809d-510b-4590-961c-97a7a0c56ba9 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:32:43.956575 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-5652809d-510b-4590-961c-97a7a0c56ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:32:43.960605 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:32:43.991294 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1205/2393] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:32:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 05:32:44.001756 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2330f243-af5c-41cc-8737-089602247701 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:32:44.003147 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-2330f243-af5c-41cc-8737-089602247701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:32:44.025836 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1189/2394] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:32:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:32:44.035371 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5652809d-510b-4590-961c-97a7a0c56ba9 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:32:44.036785 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-5652809d-510b-4590-961c-97a7a0c56ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:32:44.060968 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2330f243-af5c-41cc-8737-089602247701 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:32:44.093959 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5652809d-510b-4590-961c-97a7a0c56ba9 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:32:44.097780 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe47730-031d-479a-a6bf-b0fe7f22a8de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:32:44.098397 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe47730-031d-479a-a6bf-b0fe7f22a8de service neutron] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:44.098676 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe47730-031d-479a-a6bf-b0fe7f22a8de service neutron] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:44.098946 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe47730-031d-479a-a6bf-b0fe7f22a8de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:44.108161 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe47730-031d-479a-a6bf-b0fe7f22a8de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:32:44.109640 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe47730-031d-479a-a6bf-b0fe7f22a8de service neutron] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:32:44.113075 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ea1dd4-1b90-4016-a418-ffb412609587 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:32:44.113695 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea1dd4-1b90-4016-a418-ffb412609587 service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:44.113983 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea1dd4-1b90-4016-a418-ffb412609587 service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:44.114256 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea1dd4-1b90-4016-a418-ffb412609587 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:44.119989 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1190/2395] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:32:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 05:32:44.124305 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ea1dd4-1b90-4016-a418-ffb412609587 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:32:44.125762 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ea1dd4-1b90-4016-a418-ffb412609587 service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:32:44.136044 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1206/2396] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:32:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:32:44.294779 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe47730-031d-479a-a6bf-b0fe7f22a8de service neutron] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:32:44.296620 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-dfe47730-031d-479a-a6bf-b0fe7f22a8de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:32:44.312637 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe47730-031d-479a-a6bf-b0fe7f22a8de service neutron] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:32:44.333802 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50d1982-d13e-4a5c-b2fe-beeff6e37dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:32:44.334514 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d1982-d13e-4a5c-b2fe-beeff6e37dee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:44.334789 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d1982-d13e-4a5c-b2fe-beeff6e37dee admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:44.335055 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d1982-d13e-4a5c-b2fe-beeff6e37dee admin admin] PATH_INFO: `/v3/projects/4f7a74ba936846be82e204bff2081d70` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:44.339336 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50d1982-d13e-4a5c-b2fe-beeff6e37dee admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f7a74ba936846be82e204bff2081d70)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:32:44.341377 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50d1982-d13e-4a5c-b2fe-beeff6e37dee admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:32:44.399752 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-e50d1982-d13e-4a5c-b2fe-beeff6e37dee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f7a74ba936846be82e204bff2081d70', 'request_id': 'req-e50d1982-d13e-4a5c-b2fe-beeff6e37dee'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:44.407757 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-e50d1982-d13e-4a5c-b2fe-beeff6e37dee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f7a74ba936846be82e204bff2081d70', 'request_id': 'req-e50d1982-d13e-4a5c-b2fe-beeff6e37dee'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:44.413827 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-e50d1982-d13e-4a5c-b2fe-beeff6e37dee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f7a74ba936846be82e204bff2081d70', 'request_id': 'req-e50d1982-d13e-4a5c-b2fe-beeff6e37dee'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:44.425433 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-e50d1982-d13e-4a5c-b2fe-beeff6e37dee admin admin] The token cache is being invalidate because project 4f7a74ba936846be82e204bff2081d70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81383) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:32:44.425724 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-e50d1982-d13e-4a5c-b2fe-beeff6e37dee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:44.426503 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-e50d1982-d13e-4a5c-b2fe-beeff6e37dee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:44.428229 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1191/2397] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:32:44 2022] DELETE /identity/v3/projects/4f7a74ba936846be82e204bff2081d70 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:32:44.448092 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ea1dd4-1b90-4016-a418-ffb412609587 service neutron] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:32:44.449636 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-58ea1dd4-1b90-4016-a418-ffb412609587 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:32:44.463809 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ea1dd4-1b90-4016-a418-ffb412609587 service neutron] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:32:44.522560 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:32:44.530049 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0222e95-c61e-4db3-b14b-d3135f458d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:32:44.530705 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0222e95-c61e-4db3-b14b-d3135f458d67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:44.531030 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0222e95-c61e-4db3-b14b-d3135f458d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:44.531294 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0222e95-c61e-4db3-b14b-d3135f458d67 admin admin] PATH_INFO: `/v3/projects/b728568d02434e138b4b7018d7e0a311` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:44.532527 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0222e95-c61e-4db3-b14b-d3135f458d67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b728568d02434e138b4b7018d7e0a311)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:32:44.534508 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0222e95-c61e-4db3-b14b-d3135f458d67 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:32:44.586638 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-b0222e95-c61e-4db3-b14b-d3135f458d67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b728568d02434e138b4b7018d7e0a311', 'request_id': 'req-b0222e95-c61e-4db3-b14b-d3135f458d67'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:44.593130 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-b0222e95-c61e-4db3-b14b-d3135f458d67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b728568d02434e138b4b7018d7e0a311', 'request_id': 'req-b0222e95-c61e-4db3-b14b-d3135f458d67'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:44.598934 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-b0222e95-c61e-4db3-b14b-d3135f458d67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b728568d02434e138b4b7018d7e0a311', 'request_id': 'req-b0222e95-c61e-4db3-b14b-d3135f458d67'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:44.616307 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-b0222e95-c61e-4db3-b14b-d3135f458d67 admin admin] The token cache is being invalidate because project b728568d02434e138b4b7018d7e0a311 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:32:44.616599 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-b0222e95-c61e-4db3-b14b-d3135f458d67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:44.617283 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-b0222e95-c61e-4db3-b14b-d3135f458d67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:32:44.618874 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1207/2398] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:32:44 2022] DELETE /identity/v3/projects/b728568d02434e138b4b7018d7e0a311 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 05:32:44.624381 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d550bc85-9be8-4f58-aaa1-12573e25cde6 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:44.624682 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d550bc85-9be8-4f58-aaa1-12573e25cde6 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:44.624951 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d550bc85-9be8-4f58-aaa1-12573e25cde6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:44.646630 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-d550bc85-9be8-4f58-aaa1-12573e25cde6 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:32:44.647926 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-d550bc85-9be8-4f58-aaa1-12573e25cde6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:32:44.679581 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:32:44.711064 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1192/2399] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:32:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:32:44.724259 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8393fa9e-28df-4787-8c87-99f5b7da7f5f None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:44.724542 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8393fa9e-28df-4787-8c87-99f5b7da7f5f None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:44.724817 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8393fa9e-28df-4787-8c87-99f5b7da7f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:44.746963 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-8393fa9e-28df-4787-8c87-99f5b7da7f5f None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:32:44.748237 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-8393fa9e-28df-4787-8c87-99f5b7da7f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:32:44.756316 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1208/2400] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:32:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:32:44.762079 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d550bc85-9be8-4f58-aaa1-12573e25cde6 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:32:44.772085 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d550bc85-9be8-4f58-aaa1-12573e25cde6 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:32:44.776674 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72667bc0-8af3-4d6d-a6d9-7a18cba79820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:32:44.777287 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72667bc0-8af3-4d6d-a6d9-7a18cba79820 admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:44.777565 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72667bc0-8af3-4d6d-a6d9-7a18cba79820 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:44.777837 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72667bc0-8af3-4d6d-a6d9-7a18cba79820 admin admin] PATH_INFO: `/v3/domains` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:44.778481 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72667bc0-8af3-4d6d-a6d9-7a18cba79820 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:32:44.778782 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72667bc0-8af3-4d6d-a6d9-7a18cba79820 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:32:44.780418 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72667bc0-8af3-4d6d-a6d9-7a18cba79820 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:32:44.792335 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1193/2401] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 05:32:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:32:44.800982 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8393fa9e-28df-4787-8c87-99f5b7da7f5f None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:32:44.810608 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8393fa9e-28df-4787-8c87-99f5b7da7f5f None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:32:44.815359 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a382a08b-46d4-4fc4-a38d-c48e3dcab111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:32:44.816004 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a382a08b-46d4-4fc4-a38d-c48e3dcab111 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:44.816287 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a382a08b-46d4-4fc4-a38d-c48e3dcab111 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:44.816559 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a382a08b-46d4-4fc4-a38d-c48e3dcab111 admin admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:44.817188 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a382a08b-46d4-4fc4-a38d-c48e3dcab111 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:32:44.819111 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a382a08b-46d4-4fc4-a38d-c48e3dcab111 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:32:44.848871 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1209/2402] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:32:44 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:32:44.852907 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72667bc0-8af3-4d6d-a6d9-7a18cba79820 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:32:44.863424 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72667bc0-8af3-4d6d-a6d9-7a18cba79820 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:32:44.921355 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bd36c6-5c0d-46d9-83fa-74e9afb68489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:32:44.921874 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd36c6-5c0d-46d9-83fa-74e9afb68489 admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:44.922151 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd36c6-5c0d-46d9-83fa-74e9afb68489 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:44.922417 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd36c6-5c0d-46d9-83fa-74e9afb68489 admin admin] PATH_INFO: `/v3/users` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:44.923052 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bd36c6-5c0d-46d9-83fa-74e9afb68489 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:32:44.924999 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bd36c6-5c0d-46d9-83fa-74e9afb68489 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:32:44.949849 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1194/2403] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:32:44 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 05:32:44.951066 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a382a08b-46d4-4fc4-a38d-c48e3dcab111 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:32:44.962880 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a382a08b-46d4-4fc4-a38d-c48e3dcab111 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:32:44.966634 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7df60de-2ab0-4842-868f-9eed7ac0db49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:32:44.967333 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df60de-2ab0-4842-868f-9eed7ac0db49 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:44.967763 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df60de-2ab0-4842-868f-9eed7ac0db49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:44.968043 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df60de-2ab0-4842-868f-9eed7ac0db49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:44.968720 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7df60de-2ab0-4842-868f-9eed7ac0db49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:32:44.970376 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7df60de-2ab0-4842-868f-9eed7ac0db49 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:32:44.980938 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1210/2404] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 05:32:44.984634 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bd36c6-5c0d-46d9-83fa-74e9afb68489 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:32:44.995384 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bd36c6-5c0d-46d9-83fa-74e9afb68489 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:32:45.000041 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b616a-d55d-43a9-bbc8-71f7e834a1b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:32:45.000645 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b616a-d55d-43a9-bbc8-71f7e834a1b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:45.000922 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b616a-d55d-43a9-bbc8-71f7e834a1b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:45.001193 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b616a-d55d-43a9-bbc8-71f7e834a1b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:45.001831 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6b616a-d55d-43a9-bbc8-71f7e834a1b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:32:45.003415 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6b616a-d55d-43a9-bbc8-71f7e834a1b1 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:32:45.014028 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1195/2405] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:32:45.018253 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7df60de-2ab0-4842-868f-9eed7ac0db49 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:32:45.028235 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7df60de-2ab0-4842-868f-9eed7ac0db49 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:32:45.032785 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a0e630-6d92-4f1a-913a-fed6ec6db956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:32:45.033424 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a0e630-6d92-4f1a-913a-fed6ec6db956 admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:45.033699 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a0e630-6d92-4f1a-913a-fed6ec6db956 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:45.033970 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a0e630-6d92-4f1a-913a-fed6ec6db956 admin admin] PATH_INFO: `/v3/projects/a8146b7067a04a3f9c5a4d0bcde240ff/users/5f449d21dca9413698012f0258f79b08/roles/aa7ff8e0ec1e48e5811335b9eb38b448` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:45.049204 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a0e630-6d92-4f1a-913a-fed6ec6db956 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8146b7067a04a3f9c5a4d0bcde240ff, user_id=5f449d21dca9413698012f0258f79b08, role_id=aa7ff8e0ec1e48e5811335b9eb38b448)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:32:45.051869 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a0e630-6d92-4f1a-913a-fed6ec6db956 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:32:45.065673 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1211/2406] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:32:45 2022] PUT /identity/v3/projects/a8146b7067a04a3f9c5a4d0bcde240ff/users/5f449d21dca9413698012f0258f79b08/roles/aa7ff8e0ec1e48e5811335b9eb38b448 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 05:32:45.070748 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4626375-c2bb-4f56-830a-324bc7958a3a None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:45.071054 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4626375-c2bb-4f56-830a-324bc7958a3a None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:45.071345 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4626375-c2bb-4f56-830a-324bc7958a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:45.089708 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-d4626375-c2bb-4f56-830a-324bc7958a3a None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:32:45.090894 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-d4626375-c2bb-4f56-830a-324bc7958a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:32:45.147732 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1196/2407] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:32:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:32:45.157307 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a0e630-6d92-4f1a-913a-fed6ec6db956 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:32:45.159202 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-93a0e630-6d92-4f1a-913a-fed6ec6db956 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:32:45.216210 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a0e630-6d92-4f1a-913a-fed6ec6db956 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:32:45.219751 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78936a79-a7fd-4d19-a272-f70e850fd1bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:32:45.220352 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78936a79-a7fd-4d19-a272-f70e850fd1bc service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:45.220688 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78936a79-a7fd-4d19-a272-f70e850fd1bc service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:45.221025 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78936a79-a7fd-4d19-a272-f70e850fd1bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:45.231037 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78936a79-a7fd-4d19-a272-f70e850fd1bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:32:45.232672 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78936a79-a7fd-4d19-a272-f70e850fd1bc service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:32:45.242266 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1212/2408] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:32:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:32:49.698247 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f114794c-16fd-4264-b971-826720589d67 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:49.698762 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f114794c-16fd-4264-b971-826720589d67 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:49.698908 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f114794c-16fd-4264-b971-826720589d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:49.736648 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-f114794c-16fd-4264-b971-826720589d67 None None] MFA Rules not processed for user `5f449d21dca9413698012f0258f79b08`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:32:49.738250 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-f114794c-16fd-4264-b971-826720589d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:32:49.783433 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:32:49.824107 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1197/2409] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:32:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:32:49.828733 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78936a79-a7fd-4d19-a272-f70e850fd1bc service neutron] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:32:49.839546 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78936a79-a7fd-4d19-a272-f70e850fd1bc service neutron] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:32:49.844751 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975fc06f-a4fc-4060-94c4-da6c281812e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:32:49.845468 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975fc06f-a4fc-4060-94c4-da6c281812e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:49.845874 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975fc06f-a4fc-4060-94c4-da6c281812e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:49.846219 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975fc06f-a4fc-4060-94c4-da6c281812e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:49.846967 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975fc06f-a4fc-4060-94c4-da6c281812e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:32:49.849263 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975fc06f-a4fc-4060-94c4-da6c281812e4 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:32:49.878803 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1213/2410] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:32:49 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:32:49.883076 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f114794c-16fd-4264-b971-826720589d67 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:32:49.895014 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f114794c-16fd-4264-b971-826720589d67 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:32:49.957731 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf13946-200c-45f8-b332-c4dd1d5d79e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:32:49.958360 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf13946-200c-45f8-b332-c4dd1d5d79e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:49.958642 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf13946-200c-45f8-b332-c4dd1d5d79e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:49.958915 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf13946-200c-45f8-b332-c4dd1d5d79e3 admin admin] PATH_INFO: `/v3/users` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:49.959565 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf13946-200c-45f8-b332-c4dd1d5d79e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:32:49.961548 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf13946-200c-45f8-b332-c4dd1d5d79e3 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:32:49.987171 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1198/2411] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:32:49 2022] POST /identity/v3/users => generated 298 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:32:49.988878 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975fc06f-a4fc-4060-94c4-da6c281812e4 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:32:49.996913 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:32:50.000768 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975fc06f-a4fc-4060-94c4-da6c281812e4 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:32:50.007247 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458679fc-f624-4100-90ba-073ae1fc16a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:32:50.008191 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458679fc-f624-4100-90ba-073ae1fc16a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:50.008938 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458679fc-f624-4100-90ba-073ae1fc16a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:50.009280 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458679fc-f624-4100-90ba-073ae1fc16a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:50.010608 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458679fc-f624-4100-90ba-073ae1fc16a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:32:50.012421 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458679fc-f624-4100-90ba-073ae1fc16a6 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:32:50.025542 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1214/2412] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:32:49 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:32:50.029908 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf13946-200c-45f8-b332-c4dd1d5d79e3 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:32:50.040688 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf13946-200c-45f8-b332-c4dd1d5d79e3 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:32:50.045497 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd244a1e-ffbe-46cc-a0a9-6afada7445f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:32:50.046200 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd244a1e-ffbe-46cc-a0a9-6afada7445f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:50.046477 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd244a1e-ffbe-46cc-a0a9-6afada7445f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:50.046751 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd244a1e-ffbe-46cc-a0a9-6afada7445f9 admin admin] PATH_INFO: `/v3/projects/afd7733b5dc04f7b9107ddaee16d27fe/users/f153fd710ba24a96a024b184a91a6557/roles/5b702713e40145b49e0b42abd0a5fba9` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:50.063351 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd244a1e-ffbe-46cc-a0a9-6afada7445f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afd7733b5dc04f7b9107ddaee16d27fe, user_id=f153fd710ba24a96a024b184a91a6557, role_id=5b702713e40145b49e0b42abd0a5fba9)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:32:50.066170 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd244a1e-ffbe-46cc-a0a9-6afada7445f9 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:32:50.081407 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1199/2413] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:32:50 2022] PUT /identity/v3/projects/afd7733b5dc04f7b9107ddaee16d27fe/users/f153fd710ba24a96a024b184a91a6557/roles/5b702713e40145b49e0b42abd0a5fba9 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:32:50.085110 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458679fc-f624-4100-90ba-073ae1fc16a6 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:32:50.096794 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458679fc-f624-4100-90ba-073ae1fc16a6 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:32:50.156865 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39436923-e9c6-4bfa-8859-76c7027f36ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:32:50.157485 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39436923-e9c6-4bfa-8859-76c7027f36ac admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:50.157764 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39436923-e9c6-4bfa-8859-76c7027f36ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:50.158037 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39436923-e9c6-4bfa-8859-76c7027f36ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:50.158682 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39436923-e9c6-4bfa-8859-76c7027f36ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:32:50.160350 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39436923-e9c6-4bfa-8859-76c7027f36ac admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:32:50.171324 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1215/2414] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:32:50 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:32:50.175411 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd244a1e-ffbe-46cc-a0a9-6afada7445f9 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:32:50.186670 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd244a1e-ffbe-46cc-a0a9-6afada7445f9 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:32:50.191700 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b338e6-fe57-467e-bb50-df5fb3992699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:32:50.192380 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b338e6-fe57-467e-bb50-df5fb3992699 admin admin] REQUEST_METHOD: `PUT` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:50.192660 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b338e6-fe57-467e-bb50-df5fb3992699 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:50.192935 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b338e6-fe57-467e-bb50-df5fb3992699 admin admin] PATH_INFO: `/v3/projects/afd7733b5dc04f7b9107ddaee16d27fe/users/f153fd710ba24a96a024b184a91a6557/roles/5b702713e40145b49e0b42abd0a5fba9` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:50.194859 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b338e6-fe57-467e-bb50-df5fb3992699 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afd7733b5dc04f7b9107ddaee16d27fe, user_id=f153fd710ba24a96a024b184a91a6557, role_id=5b702713e40145b49e0b42abd0a5fba9)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:32:50.197541 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b338e6-fe57-467e-bb50-df5fb3992699 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:32:50.208874 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1200/2415] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:32:50 2022] PUT /identity/v3/projects/afd7733b5dc04f7b9107ddaee16d27fe/users/f153fd710ba24a96a024b184a91a6557/roles/5b702713e40145b49e0b42abd0a5fba9 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 05:32:54.899396 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf69dacc-ab56-47da-8b48-d9e94c63624c None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:54.901794 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf69dacc-ab56-47da-8b48-d9e94c63624c None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:54.902359 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf69dacc-ab56-47da-8b48-d9e94c63624c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:54.934971 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-bf69dacc-ab56-47da-8b48-d9e94c63624c None None] MFA Rules not processed for user `f153fd710ba24a96a024b184a91a6557`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:32:54.936366 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-bf69dacc-ab56-47da-8b48-d9e94c63624c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:32:55.012409 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1216/2416] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:32:54 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:32:55.025508 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b338e6-fe57-467e-bb50-df5fb3992699 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:32:55.027271 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-31b338e6-fe57-467e-bb50-df5fb3992699 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:32:55.086458 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b338e6-fe57-467e-bb50-df5fb3992699 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:32:55.096257 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e67608-98a5-46b5-a502-2a4099e3f390 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdd09106382447e9bf8b3a6a9ada89b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:32:55.096886 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e67608-98a5-46b5-a502-2a4099e3f390 service glance] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:55.097160 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e67608-98a5-46b5-a502-2a4099e3f390 service glance] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:55.097428 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e67608-98a5-46b5-a502-2a4099e3f390 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:55.137026 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:32:55.158074 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e67608-98a5-46b5-a502-2a4099e3f390 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:32:55.159529 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e67608-98a5-46b5-a502-2a4099e3f390 service glance] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:32:55.170746 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1201/2417] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:32:55 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:32:55.353099 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e1512-0b0e-43bd-9d8b-e09a574e4e6b None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:55.353944 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e1512-0b0e-43bd-9d8b-e09a574e4e6b None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:55.354234 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e1512-0b0e-43bd-9d8b-e09a574e4e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:55.377738 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-f67e1512-0b0e-43bd-9d8b-e09a574e4e6b None None] MFA Rules not processed for user `62fffbcf330a4bc183d0885c175f5a90`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:32:55.379072 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-f67e1512-0b0e-43bd-9d8b-e09a574e4e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:32:55.445200 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1217/2418] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 05:32:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:32:55.471796 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e67608-98a5-46b5-a502-2a4099e3f390 service glance] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:32:55.473355 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-e0e67608-98a5-46b5-a502-2a4099e3f390 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:32:55.591172 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e67608-98a5-46b5-a502-2a4099e3f390 service glance] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:32:55.596730 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f15677-e1fc-4c70-bd6a-f99433355aea service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bbe4555380345e485572d2da8b78be1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:32:55.597483 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f15677-e1fc-4c70-bd6a-f99433355aea service swift] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:32:55.597844 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f15677-e1fc-4c70-bd6a-f99433355aea service swift] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:32:55.598215 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f15677-e1fc-4c70-bd6a-f99433355aea service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:32:55.609776 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f15677-e1fc-4c70-bd6a-f99433355aea service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:32:55.611630 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f15677-e1fc-4c70-bd6a-f99433355aea service swift] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:32:55.621479 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1202/2419] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 05:32:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 05:33:05.437056 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=91 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:33:05.617368 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=42 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:33:05.718856 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0806fba-9eb9-4b76-a87d-fdc653171299 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:33:05.719136 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0806fba-9eb9-4b76-a87d-fdc653171299 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:33:05.719410 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0806fba-9eb9-4b76-a87d-fdc653171299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:33:05.859949 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-c0806fba-9eb9-4b76-a87d-fdc653171299 None None] MFA Rules not processed for user `5f449d21dca9413698012f0258f79b08`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:33:05.861066 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-c0806fba-9eb9-4b76-a87d-fdc653171299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:33:05.868158 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1218/2420] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:33:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:33:06.933995 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f15677-e1fc-4c70-bd6a-f99433355aea service swift] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:33:06.935526 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-b9f15677-e1fc-4c70-bd6a-f99433355aea service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:33:07.012540 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f15677-e1fc-4c70-bd6a-f99433355aea service swift] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:33:07.017773 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1d4eab-0464-4cdd-bfda-d281c1c2b737 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72e1d7dd79ff43e7b585b5090762465f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:33:07.018381 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d4eab-0464-4cdd-bfda-d281c1c2b737 service placement] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:33:07.018658 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d4eab-0464-4cdd-bfda-d281c1c2b737 service placement] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:33:07.018957 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d4eab-0464-4cdd-bfda-d281c1c2b737 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:33:07.020709 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-dd1d4eab-0464-4cdd-bfda-d281c1c2b737 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:33:07.032938 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1d4eab-0464-4cdd-bfda-d281c1c2b737 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:33:07.034498 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1d4eab-0464-4cdd-bfda-d281c1c2b737 service placement] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:33:07.044242 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1203/2421] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:33:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:33:08.217027 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a833bf-ff3f-49a8-a271-3e2b72bbe8e1 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:33:08.217507 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a833bf-ff3f-49a8-a271-3e2b72bbe8e1 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:33:08.217602 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a833bf-ff3f-49a8-a271-3e2b72bbe8e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:33:08.236480 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-87a833bf-ff3f-49a8-a271-3e2b72bbe8e1 None None] MFA Rules not processed for user `62fffbcf330a4bc183d0885c175f5a90`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:33:08.237933 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-87a833bf-ff3f-49a8-a271-3e2b72bbe8e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:33:08.245146 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1219/2422] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 05:33:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:33:08.257707 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1d4eab-0464-4cdd-bfda-d281c1c2b737 service placement] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:33:08.271025 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1d4eab-0464-4cdd-bfda-d281c1c2b737 service placement] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:33:08.277688 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e534909d-3f02-41da-a937-949b0471119b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bbe4555380345e485572d2da8b78be1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:33:08.278299 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e534909d-3f02-41da-a937-949b0471119b service swift] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:33:08.278933 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e534909d-3f02-41da-a937-949b0471119b service swift] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:33:08.278933 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e534909d-3f02-41da-a937-949b0471119b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:33:08.287558 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e534909d-3f02-41da-a937-949b0471119b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:33:08.289280 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e534909d-3f02-41da-a937-949b0471119b service swift] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:33:08.298128 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1204/2423] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 05:33:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 05:33:18.231631 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=6 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:33:18.294840 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=38 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:33:22.325894 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297faac6-69a0-4984-82ae-8872ad7a6502 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:33:22.326781 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297faac6-69a0-4984-82ae-8872ad7a6502 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:33:22.327060 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297faac6-69a0-4984-82ae-8872ad7a6502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:33:22.352853 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-297faac6-69a0-4984-82ae-8872ad7a6502 None None] MFA Rules not processed for user `dae006738da54b26a64097de95bef254`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:33:22.354108 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-297faac6-69a0-4984-82ae-8872ad7a6502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:33:22.433353 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1220/2424] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:33:22 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 05:33:30.045213 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc91bc9-d74a-435c-b208-a61f72e06d74 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:33:30.045834 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc91bc9-d74a-435c-b208-a61f72e06d74 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:33:30.045834 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc91bc9-d74a-435c-b208-a61f72e06d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:33:30.064943 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-2fc91bc9-d74a-435c-b208-a61f72e06d74 None None] MFA Rules not processed for user `2733ccb746fd454b8e53bf6ae162f38e`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:33:30.066171 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-2fc91bc9-d74a-435c-b208-a61f72e06d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:33:30.122831 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1205/2425] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:33:30 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:33:32.421063 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=25 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:33:33.328656 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297faac6-69a0-4984-82ae-8872ad7a6502 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:33:33.329956 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-297faac6-69a0-4984-82ae-8872ad7a6502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:33:33.401151 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297faac6-69a0-4984-82ae-8872ad7a6502 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:33:33.404924 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1baaf2-8acf-4215-8279-4e7140a39db3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:33:33.405681 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1baaf2-8acf-4215-8279-4e7140a39db3 service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:33:33.406135 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1baaf2-8acf-4215-8279-4e7140a39db3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:33:33.406411 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1baaf2-8acf-4215-8279-4e7140a39db3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:33:33.418939 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1baaf2-8acf-4215-8279-4e7140a39db3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:33:33.420450 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1baaf2-8acf-4215-8279-4e7140a39db3 service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:33:33.431622 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1221/2426] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:33:33 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:33:40.115483 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=25 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:33:43.428189 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=26 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:33:44.395559 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b35465-fd7b-438e-b405-8aaf704aed78 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:33:44.396059 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b35465-fd7b-438e-b405-8aaf704aed78 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:33:44.396177 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b35465-fd7b-438e-b405-8aaf704aed78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:33:44.415213 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-d1b35465-fd7b-438e-b405-8aaf704aed78 None None] MFA Rules not processed for user `72ae9b828c41476ca9414cd26163d384`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:33:44.416565 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-d1b35465-fd7b-438e-b405-8aaf704aed78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:33:44.469640 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1206/2427] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:33:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:33:54.463060 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=25 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:34:28.122349 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1baaf2-8acf-4215-8279-4e7140a39db3 service neutron] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:28.125752 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-6e1baaf2-8acf-4215-8279-4e7140a39db3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:34:28.203989 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1baaf2-8acf-4215-8279-4e7140a39db3 service neutron] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:28.209200 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e33ca4b-8320-495c-bfdb-b6f4b3d6e892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:28.210182 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e33ca4b-8320-495c-bfdb-b6f4b3d6e892 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:28.210462 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e33ca4b-8320-495c-bfdb-b6f4b3d6e892 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:28.210731 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e33ca4b-8320-495c-bfdb-b6f4b3d6e892 admin admin] PATH_INFO: `/v3/users/dae006738da54b26a64097de95bef254` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:28.211901 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e33ca4b-8320-495c-bfdb-b6f4b3d6e892 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dae006738da54b26a64097de95bef254)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:28.213835 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e33ca4b-8320-495c-bfdb-b6f4b3d6e892 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:34:28.258656 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-4e33ca4b-8320-495c-bfdb-b6f4b3d6e892 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dae006738da54b26a64097de95bef254'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:34:28.270178 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-4e33ca4b-8320-495c-bfdb-b6f4b3d6e892 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dae006738da54b26a64097de95bef254'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:34:28.278151 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-4e33ca4b-8320-495c-bfdb-b6f4b3d6e892 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dae006738da54b26a64097de95bef254'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:34:28.285237 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-4e33ca4b-8320-495c-bfdb-b6f4b3d6e892 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dae006738da54b26a64097de95bef254'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:34:28.286003 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-4e33ca4b-8320-495c-bfdb-b6f4b3d6e892 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dae006738da54b26a64097de95bef254'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:34:28.292597 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1222/2428] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:34:28 2022] DELETE /identity/v3/users/dae006738da54b26a64097de95bef254 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:34:28.524436 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b35465-fd7b-438e-b405-8aaf704aed78 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:28.535298 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b35465-fd7b-438e-b405-8aaf704aed78 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:28.605167 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ea7bf-8e62-41d3-a427-51601751342a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:28.605736 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ea7bf-8e62-41d3-a427-51601751342a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:28.606013 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ea7bf-8e62-41d3-a427-51601751342a admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:28.606287 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ea7bf-8e62-41d3-a427-51601751342a admin admin] PATH_INFO: `/v3/projects/e2544255d57a43c981bb681bfe939c06` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:28.607395 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789ea7bf-8e62-41d3-a427-51601751342a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2544255d57a43c981bb681bfe939c06)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:28.609541 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789ea7bf-8e62-41d3-a427-51601751342a admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:34:28.655435 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-789ea7bf-8e62-41d3-a427-51601751342a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2544255d57a43c981bb681bfe939c06', 'request_id': 'req-789ea7bf-8e62-41d3-a427-51601751342a'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:34:28.662816 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-789ea7bf-8e62-41d3-a427-51601751342a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2544255d57a43c981bb681bfe939c06', 'request_id': 'req-789ea7bf-8e62-41d3-a427-51601751342a'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:34:28.668337 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-789ea7bf-8e62-41d3-a427-51601751342a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2544255d57a43c981bb681bfe939c06', 'request_id': 'req-789ea7bf-8e62-41d3-a427-51601751342a'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:34:28.679042 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-789ea7bf-8e62-41d3-a427-51601751342a admin admin] The token cache is being invalidate because project e2544255d57a43c981bb681bfe939c06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81383) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:34:28.679330 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-789ea7bf-8e62-41d3-a427-51601751342a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:34:28.679969 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-789ea7bf-8e62-41d3-a427-51601751342a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:34:28.681452 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1207/2429] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:34:28 2022] DELETE /identity/v3/projects/e2544255d57a43c981bb681bfe939c06 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:34:28.686340 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b1a91a-3e86-44e7-adb6-dcdd531f48ee None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:28.686682 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b1a91a-3e86-44e7-adb6-dcdd531f48ee None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:28.686954 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b1a91a-3e86-44e7-adb6-dcdd531f48ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:28.706888 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-60b1a91a-3e86-44e7-adb6-dcdd531f48ee None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:34:28.708138 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-60b1a91a-3e86-44e7-adb6-dcdd531f48ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:34:28.773265 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1223/2430] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:34:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 05:34:28.781651 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7671b361-e191-4682-8059-a84ab0734762 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:28.781942 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7671b361-e191-4682-8059-a84ab0734762 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:28.782224 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7671b361-e191-4682-8059-a84ab0734762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:28.804601 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-7671b361-e191-4682-8059-a84ab0734762 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:34:28.805887 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-7671b361-e191-4682-8059-a84ab0734762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:34:28.814600 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1208/2431] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:34:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:34:28.820070 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b1a91a-3e86-44e7-adb6-dcdd531f48ee None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:28.829588 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b1a91a-3e86-44e7-adb6-dcdd531f48ee None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:28.834374 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5237496-4f71-4bea-b19d-99c41b3b6068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:28.836427 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5237496-4f71-4bea-b19d-99c41b3b6068 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:28.836752 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5237496-4f71-4bea-b19d-99c41b3b6068 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:28.837091 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5237496-4f71-4bea-b19d-99c41b3b6068 admin admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:28.837802 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5237496-4f71-4bea-b19d-99c41b3b6068 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:34:28.838191 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5237496-4f71-4bea-b19d-99c41b3b6068 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:28.839890 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5237496-4f71-4bea-b19d-99c41b3b6068 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:34:28.852267 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1224/2432] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 05:34:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:34:28.856577 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7671b361-e191-4682-8059-a84ab0734762 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:28.867110 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7671b361-e191-4682-8059-a84ab0734762 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:28.871754 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53311f9a-8a93-44d0-9744-48eb2d0b9502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:28.872355 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53311f9a-8a93-44d0-9744-48eb2d0b9502 admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:28.872626 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53311f9a-8a93-44d0-9744-48eb2d0b9502 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:28.872921 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53311f9a-8a93-44d0-9744-48eb2d0b9502 admin admin] PATH_INFO: `/v3/projects` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:28.873555 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53311f9a-8a93-44d0-9744-48eb2d0b9502 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:28.875438 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53311f9a-8a93-44d0-9744-48eb2d0b9502 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:34:28.903435 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1209/2433] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:34:28 2022] POST /identity/v3/projects => generated 405 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 05:34:28.908444 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5237496-4f71-4bea-b19d-99c41b3b6068 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:28.921546 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5237496-4f71-4bea-b19d-99c41b3b6068 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:28.925424 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:34:28.981205 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618fd7a9-1ac8-4b30-9f4c-91e6738e1347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:28.981828 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618fd7a9-1ac8-4b30-9f4c-91e6738e1347 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:28.982107 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618fd7a9-1ac8-4b30-9f4c-91e6738e1347 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:28.982382 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618fd7a9-1ac8-4b30-9f4c-91e6738e1347 admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:28.983021 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618fd7a9-1ac8-4b30-9f4c-91e6738e1347 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:28.984980 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618fd7a9-1ac8-4b30-9f4c-91e6738e1347 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:34:29.006767 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1225/2434] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:34:28 2022] POST /identity/v3/users => generated 303 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 05:34:29.010638 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53311f9a-8a93-44d0-9744-48eb2d0b9502 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:29.020942 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53311f9a-8a93-44d0-9744-48eb2d0b9502 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:29.026155 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada3f4db-a000-4430-8994-823aabeff535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:29.026763 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada3f4db-a000-4430-8994-823aabeff535 admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:29.027046 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada3f4db-a000-4430-8994-823aabeff535 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:29.027322 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada3f4db-a000-4430-8994-823aabeff535 admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:29.028005 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada3f4db-a000-4430-8994-823aabeff535 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:29.029626 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada3f4db-a000-4430-8994-823aabeff535 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:34:29.040310 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1210/2435] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:34:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:34:29.044374 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618fd7a9-1ac8-4b30-9f4c-91e6738e1347 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:29.055096 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618fd7a9-1ac8-4b30-9f4c-91e6738e1347 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:29.060193 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c6d513-3a5d-46ab-b538-19ba7321e84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:29.060796 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c6d513-3a5d-46ab-b538-19ba7321e84c admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:29.061067 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c6d513-3a5d-46ab-b538-19ba7321e84c admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:29.061330 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c6d513-3a5d-46ab-b538-19ba7321e84c admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:29.061972 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c6d513-3a5d-46ab-b538-19ba7321e84c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:29.063577 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c6d513-3a5d-46ab-b538-19ba7321e84c admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:34:29.073921 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1226/2436] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:34:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 05:34:29.078237 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada3f4db-a000-4430-8994-823aabeff535 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:29.088899 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada3f4db-a000-4430-8994-823aabeff535 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:29.093705 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f89f77-0ff3-4e02-a182-b092958cba54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:29.094365 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f89f77-0ff3-4e02-a182-b092958cba54 admin admin] REQUEST_METHOD: `PUT` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:29.094698 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f89f77-0ff3-4e02-a182-b092958cba54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:29.095005 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f89f77-0ff3-4e02-a182-b092958cba54 admin admin] PATH_INFO: `/v3/projects/f53bc3eb0df745ac8ce0c6ea4daac1c3/users/bdaae87374a44ff7a11a6e83a0e7a87f/roles/aa7ff8e0ec1e48e5811335b9eb38b448` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:29.110705 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f89f77-0ff3-4e02-a182-b092958cba54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f53bc3eb0df745ac8ce0c6ea4daac1c3, user_id=bdaae87374a44ff7a11a6e83a0e7a87f, role_id=aa7ff8e0ec1e48e5811335b9eb38b448)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:29.113661 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f89f77-0ff3-4e02-a182-b092958cba54 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:34:29.128886 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1211/2437] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:34:29 2022] PUT /identity/v3/projects/f53bc3eb0df745ac8ce0c6ea4daac1c3/users/bdaae87374a44ff7a11a6e83a0e7a87f/roles/aa7ff8e0ec1e48e5811335b9eb38b448 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:34:29.139648 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd4b89-3f44-441a-8065-729558407dbb None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:29.140171 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd4b89-3f44-441a-8065-729558407dbb None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:29.140336 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd4b89-3f44-441a-8065-729558407dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:29.168644 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-0dbd4b89-3f44-441a-8065-729558407dbb None None] MFA Rules not processed for user `bdaae87374a44ff7a11a6e83a0e7a87f`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:34:29.169853 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-0dbd4b89-3f44-441a-8065-729558407dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:34:29.233098 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1227/2438] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:34:29 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:34:29.238048 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f89f77-0ff3-4e02-a182-b092958cba54 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:29.267538 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:34:29.306149 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f89f77-0ff3-4e02-a182-b092958cba54 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:29.311235 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78d8e21-fc5d-4503-b7ef-8fb5729713f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:29.311917 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d8e21-fc5d-4503-b7ef-8fb5729713f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:29.312862 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d8e21-fc5d-4503-b7ef-8fb5729713f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:29.312862 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d8e21-fc5d-4503-b7ef-8fb5729713f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:29.313177 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78d8e21-fc5d-4503-b7ef-8fb5729713f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:29.315208 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78d8e21-fc5d-4503-b7ef-8fb5729713f0 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:34:29.343217 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1212/2439] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:34:29 2022] POST /identity/v3/projects => generated 405 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:34:29.347239 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd4b89-3f44-441a-8065-729558407dbb None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:29.357824 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd4b89-3f44-441a-8065-729558407dbb None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:29.422892 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0be9f5c-6011-4124-908f-1aa100d07b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:29.423510 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be9f5c-6011-4124-908f-1aa100d07b2e admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:29.423819 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be9f5c-6011-4124-908f-1aa100d07b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:29.424096 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be9f5c-6011-4124-908f-1aa100d07b2e admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:29.424739 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0be9f5c-6011-4124-908f-1aa100d07b2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:29.426704 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0be9f5c-6011-4124-908f-1aa100d07b2e admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:34:29.451251 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1228/2440] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:34:29 2022] POST /identity/v3/users => generated 309 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 05:34:29.455257 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78d8e21-fc5d-4503-b7ef-8fb5729713f0 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:29.466326 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78d8e21-fc5d-4503-b7ef-8fb5729713f0 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:29.470974 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33e8e39-f863-4a55-9ba9-f1680a264fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:29.471575 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33e8e39-f863-4a55-9ba9-f1680a264fbd admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:29.471884 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33e8e39-f863-4a55-9ba9-f1680a264fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:29.472159 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33e8e39-f863-4a55-9ba9-f1680a264fbd admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:29.472799 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33e8e39-f863-4a55-9ba9-f1680a264fbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:29.474563 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33e8e39-f863-4a55-9ba9-f1680a264fbd admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:34:29.486371 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1213/2441] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:34:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 05:34:29.491078 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0be9f5c-6011-4124-908f-1aa100d07b2e admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:29.497361 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:34:29.501165 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0be9f5c-6011-4124-908f-1aa100d07b2e admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:29.508064 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e1bde3-a1c9-461c-8734-eab0f5634b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:29.508718 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e1bde3-a1c9-461c-8734-eab0f5634b9d admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:29.509000 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e1bde3-a1c9-461c-8734-eab0f5634b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:29.509273 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e1bde3-a1c9-461c-8734-eab0f5634b9d admin admin] PATH_INFO: `/v3/projects/ecfd114867c6450ca511b96c1624ade0/users/59fcbc9f4c9248aaaa44a0067a880fe1/roles/5b702713e40145b49e0b42abd0a5fba9` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:29.523805 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e1bde3-a1c9-461c-8734-eab0f5634b9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecfd114867c6450ca511b96c1624ade0, user_id=59fcbc9f4c9248aaaa44a0067a880fe1, role_id=5b702713e40145b49e0b42abd0a5fba9)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:29.526474 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e1bde3-a1c9-461c-8734-eab0f5634b9d admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:34:29.539944 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1229/2442] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:34:29 2022] PUT /identity/v3/projects/ecfd114867c6450ca511b96c1624ade0/users/59fcbc9f4c9248aaaa44a0067a880fe1/roles/5b702713e40145b49e0b42abd0a5fba9 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:34:29.543840 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33e8e39-f863-4a55-9ba9-f1680a264fbd admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:29.554266 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33e8e39-f863-4a55-9ba9-f1680a264fbd admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:29.611226 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de9426-1140-4789-aa28-80c5887047e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:29.611896 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de9426-1140-4789-aa28-80c5887047e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:29.612178 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de9426-1140-4789-aa28-80c5887047e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:29.612465 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de9426-1140-4789-aa28-80c5887047e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:29.613111 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0de9426-1140-4789-aa28-80c5887047e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:29.615213 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0de9426-1140-4789-aa28-80c5887047e1 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:34:29.625355 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1214/2443] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:34:29 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:34:29.629567 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e1bde3-a1c9-461c-8734-eab0f5634b9d admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:29.640543 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e1bde3-a1c9-461c-8734-eab0f5634b9d admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:29.645441 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51575bf8-9bb4-43f6-ac56-6095bc54954a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:29.646196 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51575bf8-9bb4-43f6-ac56-6095bc54954a admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:29.646534 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51575bf8-9bb4-43f6-ac56-6095bc54954a admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:29.646830 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51575bf8-9bb4-43f6-ac56-6095bc54954a admin admin] PATH_INFO: `/v3/projects/ecfd114867c6450ca511b96c1624ade0/users/59fcbc9f4c9248aaaa44a0067a880fe1/roles/5b702713e40145b49e0b42abd0a5fba9` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:29.648782 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51575bf8-9bb4-43f6-ac56-6095bc54954a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecfd114867c6450ca511b96c1624ade0, user_id=59fcbc9f4c9248aaaa44a0067a880fe1, role_id=5b702713e40145b49e0b42abd0a5fba9)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:29.651428 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51575bf8-9bb4-43f6-ac56-6095bc54954a admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:34:29.661766 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1230/2444] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:34:29 2022] PUT /identity/v3/projects/ecfd114867c6450ca511b96c1624ade0/users/59fcbc9f4c9248aaaa44a0067a880fe1/roles/5b702713e40145b49e0b42abd0a5fba9 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:34:29.673587 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f1ace5-1677-4c44-8d12-2a5693f59ac5 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:29.673880 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f1ace5-1677-4c44-8d12-2a5693f59ac5 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:29.674156 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f1ace5-1677-4c44-8d12-2a5693f59ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:29.702344 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-59f1ace5-1677-4c44-8d12-2a5693f59ac5 None None] MFA Rules not processed for user `59fcbc9f4c9248aaaa44a0067a880fe1`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:34:29.703718 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-59f1ace5-1677-4c44-8d12-2a5693f59ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:34:29.773080 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1215/2445] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:34:29 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:34:29.783940 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51575bf8-9bb4-43f6-ac56-6095bc54954a admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:29.785670 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-51575bf8-9bb4-43f6-ac56-6095bc54954a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:34:29.841676 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51575bf8-9bb4-43f6-ac56-6095bc54954a admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:29.845295 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff52708c-e0df-46a9-b39f-b2c0d7cb4a68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a147e14b61d481db1cac02c58ac3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:29.845888 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff52708c-e0df-46a9-b39f-b2c0d7cb4a68 service cinder] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:29.846165 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff52708c-e0df-46a9-b39f-b2c0d7cb4a68 service cinder] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:29.846431 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff52708c-e0df-46a9-b39f-b2c0d7cb4a68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:29.855976 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff52708c-e0df-46a9-b39f-b2c0d7cb4a68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:29.857401 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff52708c-e0df-46a9-b39f-b2c0d7cb4a68 service cinder] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:34:29.866917 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1231/2446] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:34:29 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:34:30.003654 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f1ace5-1677-4c44-8d12-2a5693f59ac5 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:30.029163 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:34:30.067617 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f1ace5-1677-4c44-8d12-2a5693f59ac5 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:30.072114 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae3a8df-24cb-4761-aa22-c0a8e9fde7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:30.072747 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae3a8df-24cb-4761-aa22-c0a8e9fde7b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:30.073027 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae3a8df-24cb-4761-aa22-c0a8e9fde7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:30.073333 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae3a8df-24cb-4761-aa22-c0a8e9fde7b3 admin admin] PATH_INFO: `/v3/users/bdaae87374a44ff7a11a6e83a0e7a87f` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:30.074449 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae3a8df-24cb-4761-aa22-c0a8e9fde7b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdaae87374a44ff7a11a6e83a0e7a87f)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:30.076414 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae3a8df-24cb-4761-aa22-c0a8e9fde7b3 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:34:30.122161 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-bae3a8df-24cb-4761-aa22-c0a8e9fde7b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdaae87374a44ff7a11a6e83a0e7a87f'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:34:30.134012 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-bae3a8df-24cb-4761-aa22-c0a8e9fde7b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdaae87374a44ff7a11a6e83a0e7a87f'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:34:30.141461 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-bae3a8df-24cb-4761-aa22-c0a8e9fde7b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdaae87374a44ff7a11a6e83a0e7a87f'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:34:30.149444 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-bae3a8df-24cb-4761-aa22-c0a8e9fde7b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdaae87374a44ff7a11a6e83a0e7a87f'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:34:30.150132 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-bae3a8df-24cb-4761-aa22-c0a8e9fde7b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdaae87374a44ff7a11a6e83a0e7a87f'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:34:30.156280 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1216/2447] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:34:30 2022] DELETE /identity/v3/users/bdaae87374a44ff7a11a6e83a0e7a87f => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:34:30.160811 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd6cb5e-392e-4476-a597-baba507ab817 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:30.161274 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd6cb5e-392e-4476-a597-baba507ab817 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:30.162112 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd6cb5e-392e-4476-a597-baba507ab817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:30.181618 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-4bd6cb5e-392e-4476-a597-baba507ab817 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:34:30.182881 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-4bd6cb5e-392e-4476-a597-baba507ab817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:34:30.242188 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1232/2448] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:34:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:34:30.252661 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae3a8df-24cb-4761-aa22-c0a8e9fde7b3 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:30.254209 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-bae3a8df-24cb-4761-aa22-c0a8e9fde7b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:34:30.320129 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae3a8df-24cb-4761-aa22-c0a8e9fde7b3 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:30.323764 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc78f887-db45-46aa-a3fb-febabda532c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:30.324365 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc78f887-db45-46aa-a3fb-febabda532c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:30.324640 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc78f887-db45-46aa-a3fb-febabda532c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:30.324908 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc78f887-db45-46aa-a3fb-febabda532c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:30.334101 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc78f887-db45-46aa-a3fb-febabda532c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:30.335498 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc78f887-db45-46aa-a3fb-febabda532c6 service neutron] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:34:30.344722 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1217/2449] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:34:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:34:30.600601 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd6cb5e-392e-4476-a597-baba507ab817 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:30.602104 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-4bd6cb5e-392e-4476-a597-baba507ab817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:34:30.615776 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd6cb5e-392e-4476-a597-baba507ab817 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:30.621527 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4150e10c-a15a-40aa-afea-6a49e1052eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:30.622172 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4150e10c-a15a-40aa-afea-6a49e1052eb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:30.622450 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4150e10c-a15a-40aa-afea-6a49e1052eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:30.622862 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4150e10c-a15a-40aa-afea-6a49e1052eb9 admin admin] PATH_INFO: `/v3/projects/f53bc3eb0df745ac8ce0c6ea4daac1c3` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:30.624223 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4150e10c-a15a-40aa-afea-6a49e1052eb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f53bc3eb0df745ac8ce0c6ea4daac1c3)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:30.626524 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4150e10c-a15a-40aa-afea-6a49e1052eb9 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:34:30.672854 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-4150e10c-a15a-40aa-afea-6a49e1052eb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f53bc3eb0df745ac8ce0c6ea4daac1c3', 'request_id': 'req-4150e10c-a15a-40aa-afea-6a49e1052eb9'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:34:30.679024 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-4150e10c-a15a-40aa-afea-6a49e1052eb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f53bc3eb0df745ac8ce0c6ea4daac1c3', 'request_id': 'req-4150e10c-a15a-40aa-afea-6a49e1052eb9'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:34:30.684699 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-4150e10c-a15a-40aa-afea-6a49e1052eb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f53bc3eb0df745ac8ce0c6ea4daac1c3', 'request_id': 'req-4150e10c-a15a-40aa-afea-6a49e1052eb9'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:34:30.687165 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:34:30.698665 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-4150e10c-a15a-40aa-afea-6a49e1052eb9 admin admin] The token cache is being invalidate because project f53bc3eb0df745ac8ce0c6ea4daac1c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:34:30.699143 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-4150e10c-a15a-40aa-afea-6a49e1052eb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:34:30.699938 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-4150e10c-a15a-40aa-afea-6a49e1052eb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:34:30.701441 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1233/2450] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:34:30 2022] DELETE /identity/v3/projects/f53bc3eb0df745ac8ce0c6ea4daac1c3 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:34:30.705585 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc78f887-db45-46aa-a3fb-febabda532c6 service neutron] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:30.715741 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc78f887-db45-46aa-a3fb-febabda532c6 service neutron] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:30.756038 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:34:30.772669 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2bd39d-6f5a-43fb-95d0-fd5f6fd62b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:30.773294 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2bd39d-6f5a-43fb-95d0-fd5f6fd62b2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:30.773568 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2bd39d-6f5a-43fb-95d0-fd5f6fd62b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:30.773837 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2bd39d-6f5a-43fb-95d0-fd5f6fd62b2c admin admin] PATH_INFO: `/v3/users/59fcbc9f4c9248aaaa44a0067a880fe1` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:30.774942 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2bd39d-6f5a-43fb-95d0-fd5f6fd62b2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=59fcbc9f4c9248aaaa44a0067a880fe1)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:30.776896 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2bd39d-6f5a-43fb-95d0-fd5f6fd62b2c admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:34:30.822274 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-8e2bd39d-6f5a-43fb-95d0-fd5f6fd62b2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59fcbc9f4c9248aaaa44a0067a880fe1'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:34:30.834056 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-8e2bd39d-6f5a-43fb-95d0-fd5f6fd62b2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59fcbc9f4c9248aaaa44a0067a880fe1'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:34:30.840867 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-8e2bd39d-6f5a-43fb-95d0-fd5f6fd62b2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59fcbc9f4c9248aaaa44a0067a880fe1'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:34:30.847564 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-8e2bd39d-6f5a-43fb-95d0-fd5f6fd62b2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59fcbc9f4c9248aaaa44a0067a880fe1'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:34:30.848200 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-8e2bd39d-6f5a-43fb-95d0-fd5f6fd62b2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59fcbc9f4c9248aaaa44a0067a880fe1'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:34:30.854443 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1218/2451] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:34:30 2022] DELETE /identity/v3/users/59fcbc9f4c9248aaaa44a0067a880fe1 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:34:31.121598 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4150e10c-a15a-40aa-afea-6a49e1052eb9 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:31.123076 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-4150e10c-a15a-40aa-afea-6a49e1052eb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:34:31.137451 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4150e10c-a15a-40aa-afea-6a49e1052eb9 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:31.194766 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee6234e-bf0f-4938-8765-fd7cca6c39d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:31.195397 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee6234e-bf0f-4938-8765-fd7cca6c39d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:31.195649 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee6234e-bf0f-4938-8765-fd7cca6c39d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:31.195943 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee6234e-bf0f-4938-8765-fd7cca6c39d3 admin admin] PATH_INFO: `/v3/projects/ecfd114867c6450ca511b96c1624ade0` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:31.197033 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee6234e-bf0f-4938-8765-fd7cca6c39d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecfd114867c6450ca511b96c1624ade0)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:31.198929 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee6234e-bf0f-4938-8765-fd7cca6c39d3 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:34:31.243415 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-eee6234e-bf0f-4938-8765-fd7cca6c39d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecfd114867c6450ca511b96c1624ade0', 'request_id': 'req-eee6234e-bf0f-4938-8765-fd7cca6c39d3'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:34:31.249251 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-eee6234e-bf0f-4938-8765-fd7cca6c39d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecfd114867c6450ca511b96c1624ade0', 'request_id': 'req-eee6234e-bf0f-4938-8765-fd7cca6c39d3'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:34:31.254698 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-eee6234e-bf0f-4938-8765-fd7cca6c39d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecfd114867c6450ca511b96c1624ade0', 'request_id': 'req-eee6234e-bf0f-4938-8765-fd7cca6c39d3'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:34:31.266731 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-eee6234e-bf0f-4938-8765-fd7cca6c39d3 admin admin] The token cache is being invalidate because project ecfd114867c6450ca511b96c1624ade0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:34:31.267019 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-eee6234e-bf0f-4938-8765-fd7cca6c39d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:34:31.267647 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-eee6234e-bf0f-4938-8765-fd7cca6c39d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:34:31.269131 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1234/2452] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:34:31 2022] DELETE /identity/v3/projects/ecfd114867c6450ca511b96c1624ade0 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:34:31.275085 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8168f6f5-f775-40ed-a1dd-692bd52c4c2d None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:31.275440 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8168f6f5-f775-40ed-a1dd-692bd52c4c2d None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:31.275783 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8168f6f5-f775-40ed-a1dd-692bd52c4c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:31.296670 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-8168f6f5-f775-40ed-a1dd-692bd52c4c2d None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:34:31.297899 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-8168f6f5-f775-40ed-a1dd-692bd52c4c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:34:31.357050 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1219/2453] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:34:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:34:31.365124 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987eeb2a-5b47-4735-b522-8f19a5142d05 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:31.365409 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987eeb2a-5b47-4735-b522-8f19a5142d05 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:31.365679 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987eeb2a-5b47-4735-b522-8f19a5142d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:31.385576 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-987eeb2a-5b47-4735-b522-8f19a5142d05 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:34:31.386792 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-987eeb2a-5b47-4735-b522-8f19a5142d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:34:31.395132 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1235/2454] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:34:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:34:31.400292 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8168f6f5-f775-40ed-a1dd-692bd52c4c2d None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:31.409832 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8168f6f5-f775-40ed-a1dd-692bd52c4c2d None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:31.414555 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b79965-ffb6-4202-8f79-15dc6f19bb30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:31.415190 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b79965-ffb6-4202-8f79-15dc6f19bb30 admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:31.415465 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b79965-ffb6-4202-8f79-15dc6f19bb30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:31.415771 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b79965-ffb6-4202-8f79-15dc6f19bb30 admin admin] PATH_INFO: `/v3/domains` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:31.416413 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b79965-ffb6-4202-8f79-15dc6f19bb30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:34:31.416715 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b79965-ffb6-4202-8f79-15dc6f19bb30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:31.418307 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b79965-ffb6-4202-8f79-15dc6f19bb30 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:34:31.430114 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1220/2455] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 05:34:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:34:31.434573 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987eeb2a-5b47-4735-b522-8f19a5142d05 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:31.444301 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987eeb2a-5b47-4735-b522-8f19a5142d05 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:31.449003 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e09515-0c4e-473f-a65f-5008f7469228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:31.449602 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e09515-0c4e-473f-a65f-5008f7469228 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:31.449878 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e09515-0c4e-473f-a65f-5008f7469228 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:31.450148 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e09515-0c4e-473f-a65f-5008f7469228 admin admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:31.450780 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e09515-0c4e-473f-a65f-5008f7469228 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:31.452731 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e09515-0c4e-473f-a65f-5008f7469228 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:34:31.481668 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1236/2456] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:34:31 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 05:34:31.486093 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b79965-ffb6-4202-8f79-15dc6f19bb30 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:31.496090 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b79965-ffb6-4202-8f79-15dc6f19bb30 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:31.541694 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:34:31.552239 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ad9bf7-8a1a-45b2-91f4-3775dee0d09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:31.552837 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad9bf7-8a1a-45b2-91f4-3775dee0d09e admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:31.553113 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad9bf7-8a1a-45b2-91f4-3775dee0d09e admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:31.553381 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad9bf7-8a1a-45b2-91f4-3775dee0d09e admin admin] PATH_INFO: `/v3/users` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:31.554008 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ad9bf7-8a1a-45b2-91f4-3775dee0d09e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:31.555945 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ad9bf7-8a1a-45b2-91f4-3775dee0d09e admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:34:31.577339 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1221/2457] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:34:31 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:34:31.581481 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e09515-0c4e-473f-a65f-5008f7469228 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:31.591836 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e09515-0c4e-473f-a65f-5008f7469228 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:31.596404 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4d2d49-d013-4c6d-87d5-38c79144e947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:31.597009 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d2d49-d013-4c6d-87d5-38c79144e947 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:31.597271 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d2d49-d013-4c6d-87d5-38c79144e947 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:31.597540 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d2d49-d013-4c6d-87d5-38c79144e947 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:31.598183 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4d2d49-d013-4c6d-87d5-38c79144e947 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:31.600348 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4d2d49-d013-4c6d-87d5-38c79144e947 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:34:31.610141 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1237/2458] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:34:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:34:31.614252 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ad9bf7-8a1a-45b2-91f4-3775dee0d09e admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:31.624599 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ad9bf7-8a1a-45b2-91f4-3775dee0d09e admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:31.629118 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68acfffc-fdc0-40a4-a670-e21763244bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:31.629703 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68acfffc-fdc0-40a4-a670-e21763244bb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:31.629978 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68acfffc-fdc0-40a4-a670-e21763244bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:31.630291 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68acfffc-fdc0-40a4-a670-e21763244bb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:31.630924 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68acfffc-fdc0-40a4-a670-e21763244bb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:31.632589 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68acfffc-fdc0-40a4-a670-e21763244bb0 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:34:31.644207 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1222/2459] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:34:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 05:34:31.648974 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4d2d49-d013-4c6d-87d5-38c79144e947 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:31.660591 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4d2d49-d013-4c6d-87d5-38c79144e947 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:31.665693 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646a2fb2-287d-45ac-9cbb-1ae83235966c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:31.666331 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a2fb2-287d-45ac-9cbb-1ae83235966c admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:31.666609 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a2fb2-287d-45ac-9cbb-1ae83235966c admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:31.666885 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a2fb2-287d-45ac-9cbb-1ae83235966c admin admin] PATH_INFO: `/v3/projects/4d51c23421904640a83d3853b13ee471/users/8dcdb26b250d4e759c3954ef40b00ab5/roles/aa7ff8e0ec1e48e5811335b9eb38b448` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:31.681580 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646a2fb2-287d-45ac-9cbb-1ae83235966c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d51c23421904640a83d3853b13ee471, user_id=8dcdb26b250d4e759c3954ef40b00ab5, role_id=aa7ff8e0ec1e48e5811335b9eb38b448)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:31.684270 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646a2fb2-287d-45ac-9cbb-1ae83235966c admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:34:31.696618 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1238/2460] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:34:31 2022] PUT /identity/v3/projects/4d51c23421904640a83d3853b13ee471/users/8dcdb26b250d4e759c3954ef40b00ab5/roles/aa7ff8e0ec1e48e5811335b9eb38b448 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:34:31.707996 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbf933a-2c4b-41f2-95d5-b09758f55f95 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:31.708488 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbf933a-2c4b-41f2-95d5-b09758f55f95 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:31.708585 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbf933a-2c4b-41f2-95d5-b09758f55f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:31.735579 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-adbf933a-2c4b-41f2-95d5-b09758f55f95 None None] MFA Rules not processed for user `8dcdb26b250d4e759c3954ef40b00ab5`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:34:31.737050 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-adbf933a-2c4b-41f2-95d5-b09758f55f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:34:31.800723 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1223/2461] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:34:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:34:31.805163 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646a2fb2-287d-45ac-9cbb-1ae83235966c admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:31.826449 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:34:31.869176 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646a2fb2-287d-45ac-9cbb-1ae83235966c admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:31.873848 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eaa76e-c4df-44b6-bee3-bffbbabd5925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:31.874446 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eaa76e-c4df-44b6-bee3-bffbbabd5925 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:31.874722 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eaa76e-c4df-44b6-bee3-bffbbabd5925 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:31.874992 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eaa76e-c4df-44b6-bee3-bffbbabd5925 admin admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:31.875610 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eaa76e-c4df-44b6-bee3-bffbbabd5925 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:31.877545 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eaa76e-c4df-44b6-bee3-bffbbabd5925 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:34:31.907712 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1239/2462] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:34:31 2022] POST /identity/v3/projects => generated 371 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:34:31.908881 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbf933a-2c4b-41f2-95d5-b09758f55f95 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:31.920626 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbf933a-2c4b-41f2-95d5-b09758f55f95 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:31.976325 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2208b4d4-64d5-4ea7-8f8a-0e82d3eaa5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:31.976937 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2208b4d4-64d5-4ea7-8f8a-0e82d3eaa5d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:31.977217 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2208b4d4-64d5-4ea7-8f8a-0e82d3eaa5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:31.977488 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2208b4d4-64d5-4ea7-8f8a-0e82d3eaa5d1 admin admin] PATH_INFO: `/v3/users` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:31.978120 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2208b4d4-64d5-4ea7-8f8a-0e82d3eaa5d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:31.980071 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2208b4d4-64d5-4ea7-8f8a-0e82d3eaa5d1 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:34:32.000912 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1224/2463] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:34:31 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:34:32.005280 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eaa76e-c4df-44b6-bee3-bffbbabd5925 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:32.015437 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eaa76e-c4df-44b6-bee3-bffbbabd5925 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:32.020033 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f8dc22-8eb5-4f60-b867-2c5f78129d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:32.020628 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f8dc22-8eb5-4f60-b867-2c5f78129d32 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:32.021419 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f8dc22-8eb5-4f60-b867-2c5f78129d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:32.021687 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f8dc22-8eb5-4f60-b867-2c5f78129d32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:32.022502 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f8dc22-8eb5-4f60-b867-2c5f78129d32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:32.024177 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f8dc22-8eb5-4f60-b867-2c5f78129d32 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:34:32.034742 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1240/2464] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:34:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:34:32.039570 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2208b4d4-64d5-4ea7-8f8a-0e82d3eaa5d1 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:32.049439 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2208b4d4-64d5-4ea7-8f8a-0e82d3eaa5d1 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:32.054125 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b226f23-2e02-4fb8-a307-1e64c11f63ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:32.054821 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b226f23-2e02-4fb8-a307-1e64c11f63ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:32.055098 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b226f23-2e02-4fb8-a307-1e64c11f63ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:32.055366 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b226f23-2e02-4fb8-a307-1e64c11f63ae admin admin] PATH_INFO: `/v3/projects/c8cedb0c88a04d3fb5270f0884c17e6a/users/e280a94e5ed940289717bcd1c3540c55/roles/5b702713e40145b49e0b42abd0a5fba9` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:32.069819 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b226f23-2e02-4fb8-a307-1e64c11f63ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8cedb0c88a04d3fb5270f0884c17e6a, user_id=e280a94e5ed940289717bcd1c3540c55, role_id=5b702713e40145b49e0b42abd0a5fba9)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:32.072508 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b226f23-2e02-4fb8-a307-1e64c11f63ae admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:34:32.085492 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1225/2465] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:34:32 2022] PUT /identity/v3/projects/c8cedb0c88a04d3fb5270f0884c17e6a/users/e280a94e5ed940289717bcd1c3540c55/roles/5b702713e40145b49e0b42abd0a5fba9 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:34:32.089465 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f8dc22-8eb5-4f60-b867-2c5f78129d32 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:32.099758 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f8dc22-8eb5-4f60-b867-2c5f78129d32 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:32.155323 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31717b65-f3de-4c91-9eba-2a74cd9cc7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:32.155960 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31717b65-f3de-4c91-9eba-2a74cd9cc7da admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:32.156243 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31717b65-f3de-4c91-9eba-2a74cd9cc7da admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:32.156520 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31717b65-f3de-4c91-9eba-2a74cd9cc7da admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:32.157152 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31717b65-f3de-4c91-9eba-2a74cd9cc7da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:32.158751 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31717b65-f3de-4c91-9eba-2a74cd9cc7da admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:34:32.168453 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1241/2466] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:34:32 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:34:32.172694 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b226f23-2e02-4fb8-a307-1e64c11f63ae admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:32.182793 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b226f23-2e02-4fb8-a307-1e64c11f63ae admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:32.187600 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac6009a-cef9-40ef-ab67-6e7603e22063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:32.188275 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac6009a-cef9-40ef-ab67-6e7603e22063 admin admin] REQUEST_METHOD: `PUT` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:32.188552 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac6009a-cef9-40ef-ab67-6e7603e22063 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:32.188822 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac6009a-cef9-40ef-ab67-6e7603e22063 admin admin] PATH_INFO: `/v3/projects/c8cedb0c88a04d3fb5270f0884c17e6a/users/e280a94e5ed940289717bcd1c3540c55/roles/5b702713e40145b49e0b42abd0a5fba9` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:32.190720 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac6009a-cef9-40ef-ab67-6e7603e22063 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8cedb0c88a04d3fb5270f0884c17e6a, user_id=e280a94e5ed940289717bcd1c3540c55, role_id=5b702713e40145b49e0b42abd0a5fba9)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:32.193932 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac6009a-cef9-40ef-ab67-6e7603e22063 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:34:32.203914 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1226/2467] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:34:32 2022] PUT /identity/v3/projects/c8cedb0c88a04d3fb5270f0884c17e6a/users/e280a94e5ed940289717bcd1c3540c55/roles/5b702713e40145b49e0b42abd0a5fba9 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 05:34:32.215816 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e07e7-6c24-4081-9071-a027490b5be3 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:32.216304 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e07e7-6c24-4081-9071-a027490b5be3 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:32.216916 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e07e7-6c24-4081-9071-a027490b5be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:32.245011 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-842e07e7-6c24-4081-9071-a027490b5be3 None None] MFA Rules not processed for user `e280a94e5ed940289717bcd1c3540c55`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:34:32.246244 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-842e07e7-6c24-4081-9071-a027490b5be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:34:32.312689 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1242/2468] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:34:32 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:34:32.324356 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac6009a-cef9-40ef-ab67-6e7603e22063 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:32.326089 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-2ac6009a-cef9-40ef-ab67-6e7603e22063 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:34:32.340933 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:34:32.385155 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac6009a-cef9-40ef-ab67-6e7603e22063 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:32.388804 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8be7fe-a5cb-4c02-889c-f22bd1a842d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a147e14b61d481db1cac02c58ac3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:32.389396 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8be7fe-a5cb-4c02-889c-f22bd1a842d3 service cinder] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:32.389671 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8be7fe-a5cb-4c02-889c-f22bd1a842d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:32.389936 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8be7fe-a5cb-4c02-889c-f22bd1a842d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:32.399352 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8be7fe-a5cb-4c02-889c-f22bd1a842d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:32.400802 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8be7fe-a5cb-4c02-889c-f22bd1a842d3 service cinder] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:34:32.410040 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1227/2469] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:34:32 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:34:32.794680 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842e07e7-6c24-4081-9071-a027490b5be3 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:32.812190 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:34:32.858118 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842e07e7-6c24-4081-9071-a027490b5be3 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:32.863069 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e876dd00-8b93-4b01-a02c-c978574f572a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:32.863795 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e876dd00-8b93-4b01-a02c-c978574f572a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:32.864073 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e876dd00-8b93-4b01-a02c-c978574f572a admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:32.864344 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e876dd00-8b93-4b01-a02c-c978574f572a admin admin] PATH_INFO: `/v3/users/8dcdb26b250d4e759c3954ef40b00ab5` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:32.866084 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e876dd00-8b93-4b01-a02c-c978574f572a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8dcdb26b250d4e759c3954ef40b00ab5)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:32.868054 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e876dd00-8b93-4b01-a02c-c978574f572a admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:34:32.910985 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-e876dd00-8b93-4b01-a02c-c978574f572a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8dcdb26b250d4e759c3954ef40b00ab5'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:34:32.923760 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-e876dd00-8b93-4b01-a02c-c978574f572a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8dcdb26b250d4e759c3954ef40b00ab5'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:34:32.930944 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-e876dd00-8b93-4b01-a02c-c978574f572a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8dcdb26b250d4e759c3954ef40b00ab5'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:34:32.938024 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-e876dd00-8b93-4b01-a02c-c978574f572a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8dcdb26b250d4e759c3954ef40b00ab5'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:34:32.938606 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-e876dd00-8b93-4b01-a02c-c978574f572a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8dcdb26b250d4e759c3954ef40b00ab5'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:34:32.944424 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1243/2470] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:34:32 2022] DELETE /identity/v3/users/8dcdb26b250d4e759c3954ef40b00ab5 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:34:32.949075 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae86381-468d-422f-8f4f-dd398dfe68da None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:32.949554 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae86381-468d-422f-8f4f-dd398dfe68da None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:32.949669 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae86381-468d-422f-8f4f-dd398dfe68da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:32.967976 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-cae86381-468d-422f-8f4f-dd398dfe68da None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:34:32.969166 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-cae86381-468d-422f-8f4f-dd398dfe68da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:34:33.027380 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1228/2471] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:34:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:34:33.038416 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e876dd00-8b93-4b01-a02c-c978574f572a admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:33.039858 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-e876dd00-8b93-4b01-a02c-c978574f572a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:34:33.097031 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e876dd00-8b93-4b01-a02c-c978574f572a admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:33.101211 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab832bb1-75f9-4f13-9c44-9faa6102cda1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:33.101807 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab832bb1-75f9-4f13-9c44-9faa6102cda1 service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:33.102084 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab832bb1-75f9-4f13-9c44-9faa6102cda1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:33.102357 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab832bb1-75f9-4f13-9c44-9faa6102cda1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:33.111911 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab832bb1-75f9-4f13-9c44-9faa6102cda1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:33.113285 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab832bb1-75f9-4f13-9c44-9faa6102cda1 service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:34:33.123162 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1244/2472] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:34:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:34:33.383801 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae86381-468d-422f-8f4f-dd398dfe68da None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:33.385240 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-cae86381-468d-422f-8f4f-dd398dfe68da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:34:33.408698 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae86381-468d-422f-8f4f-dd398dfe68da None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:33.415285 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9870a5e6-8553-4870-97b0-ae1934f0c567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:33.415966 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9870a5e6-8553-4870-97b0-ae1934f0c567 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:33.416243 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9870a5e6-8553-4870-97b0-ae1934f0c567 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:33.416511 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9870a5e6-8553-4870-97b0-ae1934f0c567 admin admin] PATH_INFO: `/v3/projects/4d51c23421904640a83d3853b13ee471` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:33.417783 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9870a5e6-8553-4870-97b0-ae1934f0c567 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d51c23421904640a83d3853b13ee471)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:33.419803 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9870a5e6-8553-4870-97b0-ae1934f0c567 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:34:33.465501 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-9870a5e6-8553-4870-97b0-ae1934f0c567 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d51c23421904640a83d3853b13ee471', 'request_id': 'req-9870a5e6-8553-4870-97b0-ae1934f0c567'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:34:33.472909 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-9870a5e6-8553-4870-97b0-ae1934f0c567 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d51c23421904640a83d3853b13ee471', 'request_id': 'req-9870a5e6-8553-4870-97b0-ae1934f0c567'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:34:33.479097 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-9870a5e6-8553-4870-97b0-ae1934f0c567 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d51c23421904640a83d3853b13ee471', 'request_id': 'req-9870a5e6-8553-4870-97b0-ae1934f0c567'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:34:33.490238 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-9870a5e6-8553-4870-97b0-ae1934f0c567 admin admin] The token cache is being invalidate because project 4d51c23421904640a83d3853b13ee471 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81383) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:34:33.490524 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-9870a5e6-8553-4870-97b0-ae1934f0c567 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:34:33.491141 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-9870a5e6-8553-4870-97b0-ae1934f0c567 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:34:33.492633 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1229/2473] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:34:33 2022] DELETE /identity/v3/projects/4d51c23421904640a83d3853b13ee471 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:34:33.496748 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab832bb1-75f9-4f13-9c44-9faa6102cda1 service neutron] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:33.506304 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab832bb1-75f9-4f13-9c44-9faa6102cda1 service neutron] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:33.539406 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:34:33.564662 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfbdc7b-4bbd-45d6-a9c1-eed278f45f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:33.565290 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfbdc7b-4bbd-45d6-a9c1-eed278f45f54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:33.565572 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfbdc7b-4bbd-45d6-a9c1-eed278f45f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:33.565845 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfbdc7b-4bbd-45d6-a9c1-eed278f45f54 admin admin] PATH_INFO: `/v3/users/e280a94e5ed940289717bcd1c3540c55` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:33.566962 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfbdc7b-4bbd-45d6-a9c1-eed278f45f54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e280a94e5ed940289717bcd1c3540c55)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:33.569202 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfbdc7b-4bbd-45d6-a9c1-eed278f45f54 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:34:33.628849 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-abfbdc7b-4bbd-45d6-a9c1-eed278f45f54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e280a94e5ed940289717bcd1c3540c55'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:34:33.641004 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-abfbdc7b-4bbd-45d6-a9c1-eed278f45f54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e280a94e5ed940289717bcd1c3540c55'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:34:33.648661 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-abfbdc7b-4bbd-45d6-a9c1-eed278f45f54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e280a94e5ed940289717bcd1c3540c55'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:34:33.656184 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-abfbdc7b-4bbd-45d6-a9c1-eed278f45f54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e280a94e5ed940289717bcd1c3540c55'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:34:33.656816 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-abfbdc7b-4bbd-45d6-a9c1-eed278f45f54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e280a94e5ed940289717bcd1c3540c55'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:34:33.663373 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1245/2474] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:34:33 2022] DELETE /identity/v3/users/e280a94e5ed940289717bcd1c3540c55 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:34:33.942433 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9870a5e6-8553-4870-97b0-ae1934f0c567 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:33.944428 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-9870a5e6-8553-4870-97b0-ae1934f0c567 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:34:33.957986 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9870a5e6-8553-4870-97b0-ae1934f0c567 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:33.999454 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:34:34.026123 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff32277-aac8-41ff-a2df-55acabaa418c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:34.026761 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff32277-aac8-41ff-a2df-55acabaa418c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:34.027020 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff32277-aac8-41ff-a2df-55acabaa418c admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:34.027295 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff32277-aac8-41ff-a2df-55acabaa418c admin admin] PATH_INFO: `/v3/projects/c8cedb0c88a04d3fb5270f0884c17e6a` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:34.028553 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff32277-aac8-41ff-a2df-55acabaa418c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8cedb0c88a04d3fb5270f0884c17e6a)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:34.030469 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff32277-aac8-41ff-a2df-55acabaa418c admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:34:34.077923 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-aff32277-aac8-41ff-a2df-55acabaa418c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8cedb0c88a04d3fb5270f0884c17e6a', 'request_id': 'req-aff32277-aac8-41ff-a2df-55acabaa418c'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:34:34.085651 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-aff32277-aac8-41ff-a2df-55acabaa418c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8cedb0c88a04d3fb5270f0884c17e6a', 'request_id': 'req-aff32277-aac8-41ff-a2df-55acabaa418c'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:34:34.091252 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-aff32277-aac8-41ff-a2df-55acabaa418c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8cedb0c88a04d3fb5270f0884c17e6a', 'request_id': 'req-aff32277-aac8-41ff-a2df-55acabaa418c'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:34:34.102409 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-aff32277-aac8-41ff-a2df-55acabaa418c admin admin] The token cache is being invalidate because project c8cedb0c88a04d3fb5270f0884c17e6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81383) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:34:34.102707 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-aff32277-aac8-41ff-a2df-55acabaa418c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:34:34.103458 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-aff32277-aac8-41ff-a2df-55acabaa418c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:34:34.105284 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1230/2475] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:34:33 2022] DELETE /identity/v3/projects/c8cedb0c88a04d3fb5270f0884c17e6a => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 05:34:34.110331 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd417d-0dde-464c-a635-cf738272c9e6 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:34.110698 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd417d-0dde-464c-a635-cf738272c9e6 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:34.111334 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd417d-0dde-464c-a635-cf738272c9e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:34.133005 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-65fd417d-0dde-464c-a635-cf738272c9e6 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:34:34.134230 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-65fd417d-0dde-464c-a635-cf738272c9e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:34:34.198305 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1246/2476] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:34:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 05:34:34.206529 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10372ba-3df9-4a1e-98c2-cdb603098ad2 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:34.206762 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10372ba-3df9-4a1e-98c2-cdb603098ad2 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:34.207045 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10372ba-3df9-4a1e-98c2-cdb603098ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:34.235129 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-a10372ba-3df9-4a1e-98c2-cdb603098ad2 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:34:34.237807 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-a10372ba-3df9-4a1e-98c2-cdb603098ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:34:34.247215 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1231/2477] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:34:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:34:34.251655 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fd417d-0dde-464c-a635-cf738272c9e6 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:34.262277 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fd417d-0dde-464c-a635-cf738272c9e6 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:34.269062 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549ef5b9-def5-47ad-872a-cccf61063684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:34.269862 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549ef5b9-def5-47ad-872a-cccf61063684 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:34.270160 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549ef5b9-def5-47ad-872a-cccf61063684 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:34.270821 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549ef5b9-def5-47ad-872a-cccf61063684 admin admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:34.271481 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549ef5b9-def5-47ad-872a-cccf61063684 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:34:34.271830 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549ef5b9-def5-47ad-872a-cccf61063684 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:34.274197 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549ef5b9-def5-47ad-872a-cccf61063684 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:34:34.287735 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1247/2478] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 05:34:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:34:34.291922 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10372ba-3df9-4a1e-98c2-cdb603098ad2 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:34.301678 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10372ba-3df9-4a1e-98c2-cdb603098ad2 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:34.306780 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a43eac-868b-4d02-baae-c225cb63509f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:34.307374 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a43eac-868b-4d02-baae-c225cb63509f admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:34.307711 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a43eac-868b-4d02-baae-c225cb63509f admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:34.308009 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a43eac-868b-4d02-baae-c225cb63509f admin admin] PATH_INFO: `/v3/projects` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:34.308641 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a43eac-868b-4d02-baae-c225cb63509f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:34.310522 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a43eac-868b-4d02-baae-c225cb63509f admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:34:34.345775 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1232/2479] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:34:34 2022] POST /identity/v3/projects => generated 377 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 05:34:34.350719 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549ef5b9-def5-47ad-872a-cccf61063684 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:34.362730 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549ef5b9-def5-47ad-872a-cccf61063684 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:34.403765 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:34:34.420446 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a421a8e5-c8df-46cd-b523-a69e6ecd03e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:34.421047 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a421a8e5-c8df-46cd-b523-a69e6ecd03e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:34.421321 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a421a8e5-c8df-46cd-b523-a69e6ecd03e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:34.421586 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a421a8e5-c8df-46cd-b523-a69e6ecd03e1 admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:34.422209 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a421a8e5-c8df-46cd-b523-a69e6ecd03e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:34.424166 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a421a8e5-c8df-46cd-b523-a69e6ecd03e1 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:34:34.445252 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1248/2480] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:34:34 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:34:34.449536 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a43eac-868b-4d02-baae-c225cb63509f admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:34.460453 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a43eac-868b-4d02-baae-c225cb63509f admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:34.465077 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a232c69-a1ce-472f-9cc4-0ac100d3cf9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:34.465673 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a232c69-a1ce-472f-9cc4-0ac100d3cf9a admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:34.465951 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a232c69-a1ce-472f-9cc4-0ac100d3cf9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:34.466224 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a232c69-a1ce-472f-9cc4-0ac100d3cf9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:34.466860 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a232c69-a1ce-472f-9cc4-0ac100d3cf9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:34.468491 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a232c69-a1ce-472f-9cc4-0ac100d3cf9a admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:34:34.478893 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1233/2481] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:34:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:34:34.482858 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a421a8e5-c8df-46cd-b523-a69e6ecd03e1 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:34.492981 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a421a8e5-c8df-46cd-b523-a69e6ecd03e1 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:34.497896 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6adcdf-c1cb-4db1-9d58-82fe0dc8be64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:34.498531 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6adcdf-c1cb-4db1-9d58-82fe0dc8be64 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:34.498810 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6adcdf-c1cb-4db1-9d58-82fe0dc8be64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:34.499139 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6adcdf-c1cb-4db1-9d58-82fe0dc8be64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:34.499826 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6adcdf-c1cb-4db1-9d58-82fe0dc8be64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:34.501846 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6adcdf-c1cb-4db1-9d58-82fe0dc8be64 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:34:34.513616 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1249/2482] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:34:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:34:34.518190 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a232c69-a1ce-472f-9cc4-0ac100d3cf9a admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:34.528765 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a232c69-a1ce-472f-9cc4-0ac100d3cf9a admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:34.533699 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23646f7-7fd4-4f55-b511-cc2b939a5de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:34.534341 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23646f7-7fd4-4f55-b511-cc2b939a5de4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:34.534614 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23646f7-7fd4-4f55-b511-cc2b939a5de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:34.534883 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23646f7-7fd4-4f55-b511-cc2b939a5de4 admin admin] PATH_INFO: `/v3/projects/fddec0a78c2e480eac6130ef71dbcd28/users/a1849c44d8f44d3da60ec6ff45e31c10/roles/aa7ff8e0ec1e48e5811335b9eb38b448` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:34.555044 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23646f7-7fd4-4f55-b511-cc2b939a5de4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fddec0a78c2e480eac6130ef71dbcd28, user_id=a1849c44d8f44d3da60ec6ff45e31c10, role_id=aa7ff8e0ec1e48e5811335b9eb38b448)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:34.557735 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23646f7-7fd4-4f55-b511-cc2b939a5de4 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:34:34.570640 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1234/2483] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:34:34 2022] PUT /identity/v3/projects/fddec0a78c2e480eac6130ef71dbcd28/users/a1849c44d8f44d3da60ec6ff45e31c10/roles/aa7ff8e0ec1e48e5811335b9eb38b448 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:34:34.581729 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c91e0-fd0d-465e-8273-b6bf7bbc8c51 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:34.582017 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c91e0-fd0d-465e-8273-b6bf7bbc8c51 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:34.582290 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c91e0-fd0d-465e-8273-b6bf7bbc8c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:34.610392 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-e90c91e0-fd0d-465e-8273-b6bf7bbc8c51 None None] MFA Rules not processed for user `a1849c44d8f44d3da60ec6ff45e31c10`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:34:34.611865 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-e90c91e0-fd0d-465e-8273-b6bf7bbc8c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:34:34.673565 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1250/2484] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:34:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:34:34.678521 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23646f7-7fd4-4f55-b511-cc2b939a5de4 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:34.739019 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23646f7-7fd4-4f55-b511-cc2b939a5de4 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:34.744624 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7b436b-649e-45a1-ac57-f238283f4534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:34.745244 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b436b-649e-45a1-ac57-f238283f4534 admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:34.745522 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b436b-649e-45a1-ac57-f238283f4534 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:34.745792 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b436b-649e-45a1-ac57-f238283f4534 admin admin] PATH_INFO: `/v3/projects` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:34.746418 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7b436b-649e-45a1-ac57-f238283f4534 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:34.748360 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7b436b-649e-45a1-ac57-f238283f4534 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:34:34.758626 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:34:34.777552 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1235/2485] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:34:34 2022] POST /identity/v3/projects => generated 377 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:34:34.781628 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90c91e0-fd0d-465e-8273-b6bf7bbc8c51 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:34.792486 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90c91e0-fd0d-465e-8273-b6bf7bbc8c51 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:34.847871 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef07141b-ea3f-4c70-a3e0-989c4dc04fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:34.848510 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef07141b-ea3f-4c70-a3e0-989c4dc04fc7 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:34.848791 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef07141b-ea3f-4c70-a3e0-989c4dc04fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:34.849061 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef07141b-ea3f-4c70-a3e0-989c4dc04fc7 admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:34.849717 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef07141b-ea3f-4c70-a3e0-989c4dc04fc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:34.851740 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef07141b-ea3f-4c70-a3e0-989c4dc04fc7 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:34:34.873812 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1251/2486] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:34:34 2022] POST /identity/v3/users => generated 295 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 05:34:34.877887 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7b436b-649e-45a1-ac57-f238283f4534 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:34.889665 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7b436b-649e-45a1-ac57-f238283f4534 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:34.894281 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6587f45b-82d7-4a91-bf21-57ba294c2e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:34.894883 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6587f45b-82d7-4a91-bf21-57ba294c2e5e admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:34.895158 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6587f45b-82d7-4a91-bf21-57ba294c2e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:34.895428 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6587f45b-82d7-4a91-bf21-57ba294c2e5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:34.896105 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6587f45b-82d7-4a91-bf21-57ba294c2e5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:34.897688 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6587f45b-82d7-4a91-bf21-57ba294c2e5e admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:34:34.910644 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1236/2487] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:34:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:34:34.912441 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef07141b-ea3f-4c70-a3e0-989c4dc04fc7 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:34.922910 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef07141b-ea3f-4c70-a3e0-989c4dc04fc7 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:34.928357 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa36748d-4342-43e7-b210-3f7f6db0c1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:34.929047 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa36748d-4342-43e7-b210-3f7f6db0c1e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:34.929353 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa36748d-4342-43e7-b210-3f7f6db0c1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:34.929629 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa36748d-4342-43e7-b210-3f7f6db0c1e4 admin admin] PATH_INFO: `/v3/projects/5ed2196d9a5a401d8f842aeff2187f49/users/7a86be2de4a4445588216fdcadbe569c/roles/5b702713e40145b49e0b42abd0a5fba9` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:34.945834 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa36748d-4342-43e7-b210-3f7f6db0c1e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ed2196d9a5a401d8f842aeff2187f49, user_id=7a86be2de4a4445588216fdcadbe569c, role_id=5b702713e40145b49e0b42abd0a5fba9)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:34.948622 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa36748d-4342-43e7-b210-3f7f6db0c1e4 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:34:34.963358 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1252/2488] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:34:34 2022] PUT /identity/v3/projects/5ed2196d9a5a401d8f842aeff2187f49/users/7a86be2de4a4445588216fdcadbe569c/roles/5b702713e40145b49e0b42abd0a5fba9 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:34:34.967482 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6587f45b-82d7-4a91-bf21-57ba294c2e5e admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:34.977547 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6587f45b-82d7-4a91-bf21-57ba294c2e5e admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:35.039959 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde2044d-bdaa-4048-90cb-33276668b716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:35.040563 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde2044d-bdaa-4048-90cb-33276668b716 admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:35.040838 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde2044d-bdaa-4048-90cb-33276668b716 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:35.041107 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde2044d-bdaa-4048-90cb-33276668b716 admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:35.041747 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde2044d-bdaa-4048-90cb-33276668b716 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:35.043327 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde2044d-bdaa-4048-90cb-33276668b716 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:34:35.053465 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1237/2489] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:34:34 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 05:34:35.057578 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa36748d-4342-43e7-b210-3f7f6db0c1e4 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:35.067527 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa36748d-4342-43e7-b210-3f7f6db0c1e4 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:35.072909 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1634db7c-d920-48cf-959c-59f480b7a683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:35.073557 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1634db7c-d920-48cf-959c-59f480b7a683 admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:35.073833 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1634db7c-d920-48cf-959c-59f480b7a683 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:35.074104 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1634db7c-d920-48cf-959c-59f480b7a683 admin admin] PATH_INFO: `/v3/projects/5ed2196d9a5a401d8f842aeff2187f49/users/7a86be2de4a4445588216fdcadbe569c/roles/5b702713e40145b49e0b42abd0a5fba9` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:35.076022 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1634db7c-d920-48cf-959c-59f480b7a683 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ed2196d9a5a401d8f842aeff2187f49, user_id=7a86be2de4a4445588216fdcadbe569c, role_id=5b702713e40145b49e0b42abd0a5fba9)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:35.078703 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1634db7c-d920-48cf-959c-59f480b7a683 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:34:35.088745 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1253/2490] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:34:35 2022] PUT /identity/v3/projects/5ed2196d9a5a401d8f842aeff2187f49/users/7a86be2de4a4445588216fdcadbe569c/roles/5b702713e40145b49e0b42abd0a5fba9 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:34:35.098766 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc1388-0f02-482d-a959-b007e2ec4a21 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:35.099544 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc1388-0f02-482d-a959-b007e2ec4a21 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:35.099856 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc1388-0f02-482d-a959-b007e2ec4a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:35.127569 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-e8cc1388-0f02-482d-a959-b007e2ec4a21 None None] MFA Rules not processed for user `7a86be2de4a4445588216fdcadbe569c`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:34:35.128786 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-e8cc1388-0f02-482d-a959-b007e2ec4a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:34:35.195904 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1238/2491] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:34:35 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:34:35.206717 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1634db7c-d920-48cf-959c-59f480b7a683 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:35.208516 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-1634db7c-d920-48cf-959c-59f480b7a683 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:34:35.214926 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:34:35.266993 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1634db7c-d920-48cf-959c-59f480b7a683 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:35.270551 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dee94b-2f3e-49dc-9002-77c36b617bb0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a147e14b61d481db1cac02c58ac3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:35.271163 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dee94b-2f3e-49dc-9002-77c36b617bb0 service cinder] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:35.271438 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dee94b-2f3e-49dc-9002-77c36b617bb0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:35.271728 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dee94b-2f3e-49dc-9002-77c36b617bb0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:35.327602 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dee94b-2f3e-49dc-9002-77c36b617bb0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:35.329378 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dee94b-2f3e-49dc-9002-77c36b617bb0 service cinder] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:34:35.338349 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1254/2492] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:34:35 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:34:37.946850 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cc1388-0f02-482d-a959-b007e2ec4a21 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:37.957004 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cc1388-0f02-482d-a959-b007e2ec4a21 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:37.960555 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08771633-b7c0-46e0-8cf0-4e1640892fd8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a147e14b61d481db1cac02c58ac3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:37.961157 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08771633-b7c0-46e0-8cf0-4e1640892fd8 service cinder] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:37.961433 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08771633-b7c0-46e0-8cf0-4e1640892fd8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:37.961698 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08771633-b7c0-46e0-8cf0-4e1640892fd8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:37.970670 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08771633-b7c0-46e0-8cf0-4e1640892fd8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:37.972136 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08771633-b7c0-46e0-8cf0-4e1640892fd8 service cinder] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:34:37.981534 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1239/2493] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:34:37 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:34:39.628632 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dee94b-2f3e-49dc-9002-77c36b617bb0 service cinder] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:39.631836 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-02dee94b-2f3e-49dc-9002-77c36b617bb0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:34:39.712243 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dee94b-2f3e-49dc-9002-77c36b617bb0 service cinder] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:39.717201 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42bf2db-f177-4aa5-8a27-dbe96d7c419a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:39.718137 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42bf2db-f177-4aa5-8a27-dbe96d7c419a service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:39.718601 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42bf2db-f177-4aa5-8a27-dbe96d7c419a service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:39.718872 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42bf2db-f177-4aa5-8a27-dbe96d7c419a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:39.720688 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-d42bf2db-f177-4aa5-8a27-dbe96d7c419a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:34:39.794877 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42bf2db-f177-4aa5-8a27-dbe96d7c419a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:39.796365 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42bf2db-f177-4aa5-8a27-dbe96d7c419a service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:34:39.802767 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:34:39.809654 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1255/2494] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:34:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:34:41.009324 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08771633-b7c0-46e0-8cf0-4e1640892fd8 service cinder] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:41.010814 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-08771633-b7c0-46e0-8cf0-4e1640892fd8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:34:41.026442 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08771633-b7c0-46e0-8cf0-4e1640892fd8 service cinder] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:41.032345 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabfecd9-f4dc-44cd-a7f5-be36d161e760 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:41.033146 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabfecd9-f4dc-44cd-a7f5-be36d161e760 service neutron] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:41.033490 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabfecd9-f4dc-44cd-a7f5-be36d161e760 service neutron] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:41.033930 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabfecd9-f4dc-44cd-a7f5-be36d161e760 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:41.035855 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-fabfecd9-f4dc-44cd-a7f5-be36d161e760 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:34:41.053949 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabfecd9-f4dc-44cd-a7f5-be36d161e760 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:41.055559 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabfecd9-f4dc-44cd-a7f5-be36d161e760 service neutron] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:34:41.067776 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1240/2495] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:34:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 05:34:42.543727 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00508450-2565-4006-8e42-f04cda224693 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:42.544183 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00508450-2565-4006-8e42-f04cda224693 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:42.544291 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00508450-2565-4006-8e42-f04cda224693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:42.563037 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-00508450-2565-4006-8e42-f04cda224693 None None] MFA Rules not processed for user `62fffbcf330a4bc183d0885c175f5a90`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:34:42.564251 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-00508450-2565-4006-8e42-f04cda224693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:34:42.618643 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1256/2496] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 05:34:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:34:42.667022 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabfecd9-f4dc-44cd-a7f5-be36d161e760 service neutron] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:42.668565 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-fabfecd9-f4dc-44cd-a7f5-be36d161e760 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:34:42.703814 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:34:42.740702 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabfecd9-f4dc-44cd-a7f5-be36d161e760 service neutron] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:42.745934 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2f73c5-4960-4105-9e3d-b5469d22fc3f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bbe4555380345e485572d2da8b78be1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:42.746686 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2f73c5-4960-4105-9e3d-b5469d22fc3f service swift] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:42.746968 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2f73c5-4960-4105-9e3d-b5469d22fc3f service swift] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:42.747238 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2f73c5-4960-4105-9e3d-b5469d22fc3f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:42.759557 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2f73c5-4960-4105-9e3d-b5469d22fc3f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:42.761233 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2f73c5-4960-4105-9e3d-b5469d22fc3f service swift] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:34:42.769874 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1241/2497] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 05:34:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 05:34:47.671922 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00508450-2565-4006-8e42-f04cda224693 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:47.685274 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00508450-2565-4006-8e42-f04cda224693 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:47.689338 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fc29d6-35b3-4ff7-a6e9-803396bdd35d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:47.690188 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc29d6-35b3-4ff7-a6e9-803396bdd35d service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:47.690582 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc29d6-35b3-4ff7-a6e9-803396bdd35d service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:47.690961 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc29d6-35b3-4ff7-a6e9-803396bdd35d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:47.694245 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-e7fc29d6-35b3-4ff7-a6e9-803396bdd35d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:34:47.791751 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fc29d6-35b3-4ff7-a6e9-803396bdd35d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:47.793035 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fc29d6-35b3-4ff7-a6e9-803396bdd35d service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:34:47.821600 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1257/2498] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:34:47 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:34:51.339984 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2f73c5-4960-4105-9e3d-b5469d22fc3f service swift] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:51.430628 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2f73c5-4960-4105-9e3d-b5469d22fc3f service swift] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:51.436458 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f4d817-4e46-46e4-a2cc-68316e9798c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:51.437544 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f4d817-4e46-46e4-a2cc-68316e9798c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:51.438219 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f4d817-4e46-46e4-a2cc-68316e9798c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:51.438669 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f4d817-4e46-46e4-a2cc-68316e9798c2 admin admin] PATH_INFO: `/v3/users/a1849c44d8f44d3da60ec6ff45e31c10` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:51.440119 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f4d817-4e46-46e4-a2cc-68316e9798c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1849c44d8f44d3da60ec6ff45e31c10)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:51.442347 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f4d817-4e46-46e4-a2cc-68316e9798c2 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:34:51.507017 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-68f4d817-4e46-46e4-a2cc-68316e9798c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1849c44d8f44d3da60ec6ff45e31c10'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:34:51.525820 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-68f4d817-4e46-46e4-a2cc-68316e9798c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1849c44d8f44d3da60ec6ff45e31c10'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:34:51.535083 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-68f4d817-4e46-46e4-a2cc-68316e9798c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1849c44d8f44d3da60ec6ff45e31c10'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:34:51.548640 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-68f4d817-4e46-46e4-a2cc-68316e9798c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1849c44d8f44d3da60ec6ff45e31c10'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:34:51.549673 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-68f4d817-4e46-46e4-a2cc-68316e9798c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1849c44d8f44d3da60ec6ff45e31c10'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:34:51.562999 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1242/2499] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:34:51 2022] DELETE /identity/v3/users/a1849c44d8f44d3da60ec6ff45e31c10 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:34:51.564845 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb65cc2a-f068-4e88-9267-691c84216106 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:51.566293 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb65cc2a-f068-4e88-9267-691c84216106 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:51.566790 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb65cc2a-f068-4e88-9267-691c84216106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:51.591444 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-bb65cc2a-f068-4e88-9267-691c84216106 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:34:51.593060 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-bb65cc2a-f068-4e88-9267-691c84216106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:34:51.678734 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1258/2500] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:34:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:34:51.693437 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f4d817-4e46-46e4-a2cc-68316e9798c2 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:51.695169 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-68f4d817-4e46-46e4-a2cc-68316e9798c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:34:51.791643 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:34:51.813457 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f4d817-4e46-46e4-a2cc-68316e9798c2 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:51.817519 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c3704b-29a3-49c7-b598-f7071ef91bf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:51.818159 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c3704b-29a3-49c7-b598-f7071ef91bf6 service neutron] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:51.818450 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c3704b-29a3-49c7-b598-f7071ef91bf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:51.818714 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c3704b-29a3-49c7-b598-f7071ef91bf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:51.829069 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c3704b-29a3-49c7-b598-f7071ef91bf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:51.830533 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c3704b-29a3-49c7-b598-f7071ef91bf6 service neutron] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:34:51.863232 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1243/2501] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:34:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:34:52.227901 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb65cc2a-f068-4e88-9267-691c84216106 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:52.229053 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-bb65cc2a-f068-4e88-9267-691c84216106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:34:52.249018 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb65cc2a-f068-4e88-9267-691c84216106 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:52.269229 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f70153-53ad-494f-8f92-7e4f85041177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:52.269886 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f70153-53ad-494f-8f92-7e4f85041177 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:52.270698 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f70153-53ad-494f-8f92-7e4f85041177 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:52.270967 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f70153-53ad-494f-8f92-7e4f85041177 admin admin] PATH_INFO: `/v3/projects/fddec0a78c2e480eac6130ef71dbcd28` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:52.272125 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f70153-53ad-494f-8f92-7e4f85041177 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fddec0a78c2e480eac6130ef71dbcd28)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:52.274027 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f70153-53ad-494f-8f92-7e4f85041177 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:34:52.330118 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:34:52.341434 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-09f70153-53ad-494f-8f92-7e4f85041177 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fddec0a78c2e480eac6130ef71dbcd28', 'request_id': 'req-09f70153-53ad-494f-8f92-7e4f85041177'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:34:52.349868 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-09f70153-53ad-494f-8f92-7e4f85041177 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fddec0a78c2e480eac6130ef71dbcd28', 'request_id': 'req-09f70153-53ad-494f-8f92-7e4f85041177'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:34:52.357044 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-09f70153-53ad-494f-8f92-7e4f85041177 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fddec0a78c2e480eac6130ef71dbcd28', 'request_id': 'req-09f70153-53ad-494f-8f92-7e4f85041177'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:34:52.374398 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-09f70153-53ad-494f-8f92-7e4f85041177 admin admin] The token cache is being invalidate because project fddec0a78c2e480eac6130ef71dbcd28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:34:52.374838 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-09f70153-53ad-494f-8f92-7e4f85041177 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:34:52.375784 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-09f70153-53ad-494f-8f92-7e4f85041177 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:34:52.381315 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1259/2502] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:34:52 2022] DELETE /identity/v3/projects/fddec0a78c2e480eac6130ef71dbcd28 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:34:52.382373 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c3704b-29a3-49c7-b598-f7071ef91bf6 service neutron] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:52.392374 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c3704b-29a3-49c7-b598-f7071ef91bf6 service neutron] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:52.465360 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce93f814-a101-4b02-9537-4a140fb425bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:52.466001 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce93f814-a101-4b02-9537-4a140fb425bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:52.466282 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce93f814-a101-4b02-9537-4a140fb425bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:52.466553 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce93f814-a101-4b02-9537-4a140fb425bf admin admin] PATH_INFO: `/v3/users/7a86be2de4a4445588216fdcadbe569c` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:52.467891 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce93f814-a101-4b02-9537-4a140fb425bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a86be2de4a4445588216fdcadbe569c)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:52.469755 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce93f814-a101-4b02-9537-4a140fb425bf admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:34:52.521659 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-ce93f814-a101-4b02-9537-4a140fb425bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a86be2de4a4445588216fdcadbe569c'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:34:52.538196 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-ce93f814-a101-4b02-9537-4a140fb425bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a86be2de4a4445588216fdcadbe569c'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:34:52.548669 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-ce93f814-a101-4b02-9537-4a140fb425bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a86be2de4a4445588216fdcadbe569c'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:34:52.557070 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-ce93f814-a101-4b02-9537-4a140fb425bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a86be2de4a4445588216fdcadbe569c'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:34:52.557793 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-ce93f814-a101-4b02-9537-4a140fb425bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a86be2de4a4445588216fdcadbe569c'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:34:52.564151 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1244/2503] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:34:52 2022] DELETE /identity/v3/users/7a86be2de4a4445588216fdcadbe569c => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 05:34:52.861909 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f70153-53ad-494f-8f92-7e4f85041177 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:52.863462 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-09f70153-53ad-494f-8f92-7e4f85041177 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:34:52.878050 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f70153-53ad-494f-8f92-7e4f85041177 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:52.881577 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce93f814-a101-4b02-9537-4a140fb425bf admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:52.883079 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-ce93f814-a101-4b02-9537-4a140fb425bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:34:52.937653 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c71b5ef-bc9c-417e-b39a-a4a4bdbb3d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:52.938282 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71b5ef-bc9c-417e-b39a-a4a4bdbb3d04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:52.938557 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71b5ef-bc9c-417e-b39a-a4a4bdbb3d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:52.938823 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71b5ef-bc9c-417e-b39a-a4a4bdbb3d04 admin admin] PATH_INFO: `/v3/projects/5ed2196d9a5a401d8f842aeff2187f49` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:52.939965 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c71b5ef-bc9c-417e-b39a-a4a4bdbb3d04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ed2196d9a5a401d8f842aeff2187f49)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:52.942455 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c71b5ef-bc9c-417e-b39a-a4a4bdbb3d04 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:34:52.946568 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce93f814-a101-4b02-9537-4a140fb425bf admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:52.950548 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04e5869-738d-4fdf-8d0d-c93f72d90dfe service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdd09106382447e9bf8b3a6a9ada89b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:52.950994 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04e5869-738d-4fdf-8d0d-c93f72d90dfe service glance] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:52.951273 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04e5869-738d-4fdf-8d0d-c93f72d90dfe service glance] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:52.951544 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04e5869-738d-4fdf-8d0d-c93f72d90dfe service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:52.953313 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-f04e5869-738d-4fdf-8d0d-c93f72d90dfe service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:34:52.972445 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:34:52.991115 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-1c71b5ef-bc9c-417e-b39a-a4a4bdbb3d04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ed2196d9a5a401d8f842aeff2187f49', 'request_id': 'req-1c71b5ef-bc9c-417e-b39a-a4a4bdbb3d04'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:34:52.997480 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-1c71b5ef-bc9c-417e-b39a-a4a4bdbb3d04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ed2196d9a5a401d8f842aeff2187f49', 'request_id': 'req-1c71b5ef-bc9c-417e-b39a-a4a4bdbb3d04'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:34:53.003433 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-1c71b5ef-bc9c-417e-b39a-a4a4bdbb3d04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ed2196d9a5a401d8f842aeff2187f49', 'request_id': 'req-1c71b5ef-bc9c-417e-b39a-a4a4bdbb3d04'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:34:53.026588 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-1c71b5ef-bc9c-417e-b39a-a4a4bdbb3d04 admin admin] The token cache is being invalidate because project 5ed2196d9a5a401d8f842aeff2187f49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:34:53.026874 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-1c71b5ef-bc9c-417e-b39a-a4a4bdbb3d04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:34:53.027516 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-1c71b5ef-bc9c-417e-b39a-a4a4bdbb3d04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:34:53.029156 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1260/2504] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:34:52 2022] DELETE /identity/v3/projects/5ed2196d9a5a401d8f842aeff2187f49 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:34:53.033928 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98d11eb-fcaf-4a20-9521-321c92c74f3e None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:53.034290 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98d11eb-fcaf-4a20-9521-321c92c74f3e None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:53.034647 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98d11eb-fcaf-4a20-9521-321c92c74f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:53.043787 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04e5869-738d-4fdf-8d0d-c93f72d90dfe service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:53.046408 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04e5869-738d-4fdf-8d0d-c93f72d90dfe service glance] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:34:53.063044 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1245/2505] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:34:52 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:34:53.068223 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-d98d11eb-fcaf-4a20-9521-321c92c74f3e None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:34:53.069584 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-d98d11eb-fcaf-4a20-9521-321c92c74f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:34:53.132351 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:34:53.147375 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1261/2506] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:34:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 05:34:53.155003 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb3131-ccc6-4845-b7e6-50049a5a5255 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:53.155320 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb3131-ccc6-4845-b7e6-50049a5a5255 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:53.155623 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb3131-ccc6-4845-b7e6-50049a5a5255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:53.177401 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-1beb3131-ccc6-4845-b7e6-50049a5a5255 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:34:53.178693 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-1beb3131-ccc6-4845-b7e6-50049a5a5255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:34:53.186954 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1246/2507] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:34:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:34:53.191220 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98d11eb-fcaf-4a20-9521-321c92c74f3e None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:53.201226 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98d11eb-fcaf-4a20-9521-321c92c74f3e None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:53.205862 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24ce72d-89f1-4fa2-b633-723fa24ae5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:53.206451 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24ce72d-89f1-4fa2-b633-723fa24ae5c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:53.206727 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24ce72d-89f1-4fa2-b633-723fa24ae5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:53.206995 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24ce72d-89f1-4fa2-b633-723fa24ae5c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:53.207656 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24ce72d-89f1-4fa2-b633-723fa24ae5c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:34:53.207982 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24ce72d-89f1-4fa2-b633-723fa24ae5c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:53.209573 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24ce72d-89f1-4fa2-b633-723fa24ae5c2 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:34:53.221068 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1262/2508] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 05:34:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:34:53.225692 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beb3131-ccc6-4845-b7e6-50049a5a5255 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:53.234867 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beb3131-ccc6-4845-b7e6-50049a5a5255 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:53.240941 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f25f8-65d3-41e2-966a-095563d2df60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:53.241608 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f25f8-65d3-41e2-966a-095563d2df60 admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:53.241807 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f25f8-65d3-41e2-966a-095563d2df60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:53.242084 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f25f8-65d3-41e2-966a-095563d2df60 admin admin] PATH_INFO: `/v3/projects` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:53.242742 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526f25f8-65d3-41e2-966a-095563d2df60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:53.244814 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526f25f8-65d3-41e2-966a-095563d2df60 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:34:53.271130 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1247/2509] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:34:53 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:34:53.275814 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24ce72d-89f1-4fa2-b633-723fa24ae5c2 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:53.286175 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24ce72d-89f1-4fa2-b633-723fa24ae5c2 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:53.345880 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66101ba4-0f8e-493f-b762-c731f6defc46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:53.346506 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66101ba4-0f8e-493f-b762-c731f6defc46 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:53.346794 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66101ba4-0f8e-493f-b762-c731f6defc46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:53.347066 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66101ba4-0f8e-493f-b762-c731f6defc46 admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:53.347732 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66101ba4-0f8e-493f-b762-c731f6defc46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:53.350161 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66101ba4-0f8e-493f-b762-c731f6defc46 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:34:53.372324 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1263/2510] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:34:53 2022] POST /identity/v3/users => generated 286 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:34:53.377802 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f25f8-65d3-41e2-966a-095563d2df60 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:53.388461 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f25f8-65d3-41e2-966a-095563d2df60 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:53.393054 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3200bb4f-226a-4707-a50a-d0f720475aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:53.393652 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3200bb4f-226a-4707-a50a-d0f720475aa4 admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:53.393961 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3200bb4f-226a-4707-a50a-d0f720475aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:53.394229 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3200bb4f-226a-4707-a50a-d0f720475aa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:53.394889 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3200bb4f-226a-4707-a50a-d0f720475aa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:53.396482 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3200bb4f-226a-4707-a50a-d0f720475aa4 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:34:53.406520 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1248/2511] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:34:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:34:53.410371 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66101ba4-0f8e-493f-b762-c731f6defc46 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:53.421365 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66101ba4-0f8e-493f-b762-c731f6defc46 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:53.426061 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db36dc92-c54e-4575-acda-339b65dfabaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:53.427272 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db36dc92-c54e-4575-acda-339b65dfabaa admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:53.427551 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db36dc92-c54e-4575-acda-339b65dfabaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:53.427855 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db36dc92-c54e-4575-acda-339b65dfabaa admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:53.428491 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db36dc92-c54e-4575-acda-339b65dfabaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:53.430148 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db36dc92-c54e-4575-acda-339b65dfabaa admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:34:53.440444 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1264/2512] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:34:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:34:53.444599 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3200bb4f-226a-4707-a50a-d0f720475aa4 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:53.455079 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3200bb4f-226a-4707-a50a-d0f720475aa4 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:53.459734 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435ba444-024d-4153-a57c-f8f95d01600d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:53.460515 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ba444-024d-4153-a57c-f8f95d01600d admin admin] REQUEST_METHOD: `PUT` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:53.460800 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ba444-024d-4153-a57c-f8f95d01600d admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:53.461151 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ba444-024d-4153-a57c-f8f95d01600d admin admin] PATH_INFO: `/v3/projects/b3ca445ed34440e1a9e3be18dd22bf17/users/1f2d119ded0a41afacf2da6af8a8ebc2/roles/aa7ff8e0ec1e48e5811335b9eb38b448` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:53.478866 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435ba444-024d-4153-a57c-f8f95d01600d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3ca445ed34440e1a9e3be18dd22bf17, user_id=1f2d119ded0a41afacf2da6af8a8ebc2, role_id=aa7ff8e0ec1e48e5811335b9eb38b448)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:53.481558 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435ba444-024d-4153-a57c-f8f95d01600d admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:34:53.497114 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1249/2513] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:34:53 2022] PUT /identity/v3/projects/b3ca445ed34440e1a9e3be18dd22bf17/users/1f2d119ded0a41afacf2da6af8a8ebc2/roles/aa7ff8e0ec1e48e5811335b9eb38b448 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 05:34:53.507379 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dec48d-4fd5-42a1-8f8d-df6ae06c7836 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:53.507659 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dec48d-4fd5-42a1-8f8d-df6ae06c7836 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:53.507965 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dec48d-4fd5-42a1-8f8d-df6ae06c7836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:53.536712 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-c7dec48d-4fd5-42a1-8f8d-df6ae06c7836 None None] MFA Rules not processed for user `1f2d119ded0a41afacf2da6af8a8ebc2`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:34:53.537920 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-c7dec48d-4fd5-42a1-8f8d-df6ae06c7836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:34:53.608908 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1265/2514] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:34:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:34:53.620888 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435ba444-024d-4153-a57c-f8f95d01600d admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:53.622828 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-435ba444-024d-4153-a57c-f8f95d01600d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:34:53.681922 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435ba444-024d-4153-a57c-f8f95d01600d admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:53.685653 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b632334-a8a0-4883-93fd-f4888a00db98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a147e14b61d481db1cac02c58ac3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:53.686256 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b632334-a8a0-4883-93fd-f4888a00db98 service cinder] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:53.686534 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b632334-a8a0-4883-93fd-f4888a00db98 service cinder] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:53.686805 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b632334-a8a0-4883-93fd-f4888a00db98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:53.695208 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b632334-a8a0-4883-93fd-f4888a00db98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:53.696682 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b632334-a8a0-4883-93fd-f4888a00db98 service cinder] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:34:53.705461 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1250/2515] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:34:53 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:34:53.728732 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dec48d-4fd5-42a1-8f8d-df6ae06c7836 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:53.781958 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:34:53.797849 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dec48d-4fd5-42a1-8f8d-df6ae06c7836 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:53.804026 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e860a11-deef-4232-a1ba-e91b07cc63d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:53.804689 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e860a11-deef-4232-a1ba-e91b07cc63d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:53.804967 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e860a11-deef-4232-a1ba-e91b07cc63d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:53.805243 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e860a11-deef-4232-a1ba-e91b07cc63d1 admin admin] PATH_INFO: `/v3/users/1f2d119ded0a41afacf2da6af8a8ebc2` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:53.806403 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e860a11-deef-4232-a1ba-e91b07cc63d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f2d119ded0a41afacf2da6af8a8ebc2)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:53.808422 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e860a11-deef-4232-a1ba-e91b07cc63d1 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:34:53.884979 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-0e860a11-deef-4232-a1ba-e91b07cc63d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f2d119ded0a41afacf2da6af8a8ebc2'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:34:53.897643 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-0e860a11-deef-4232-a1ba-e91b07cc63d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f2d119ded0a41afacf2da6af8a8ebc2'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:34:53.904490 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-0e860a11-deef-4232-a1ba-e91b07cc63d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f2d119ded0a41afacf2da6af8a8ebc2'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:34:53.912393 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-0e860a11-deef-4232-a1ba-e91b07cc63d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f2d119ded0a41afacf2da6af8a8ebc2'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:34:53.913046 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-0e860a11-deef-4232-a1ba-e91b07cc63d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f2d119ded0a41afacf2da6af8a8ebc2'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:34:53.919072 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1266/2516] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:34:53 2022] DELETE /identity/v3/users/1f2d119ded0a41afacf2da6af8a8ebc2 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:34:53.923571 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4aeef8-21ed-40cd-b801-c02693013594 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:53.923879 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4aeef8-21ed-40cd-b801-c02693013594 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:53.924165 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4aeef8-21ed-40cd-b801-c02693013594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:53.945145 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-fe4aeef8-21ed-40cd-b801-c02693013594 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:34:53.946577 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-fe4aeef8-21ed-40cd-b801-c02693013594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:34:53.999213 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:34:54.010301 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1251/2517] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:34:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 05:34:54.020706 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e860a11-deef-4232-a1ba-e91b07cc63d1 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:54.022111 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-0e860a11-deef-4232-a1ba-e91b07cc63d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:34:54.080131 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e860a11-deef-4232-a1ba-e91b07cc63d1 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:54.084396 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e9ea11-08cd-440e-b3ff-bb84e8044bd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:54.085020 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e9ea11-08cd-440e-b3ff-bb84e8044bd6 service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:54.085294 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e9ea11-08cd-440e-b3ff-bb84e8044bd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:54.085565 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e9ea11-08cd-440e-b3ff-bb84e8044bd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:54.094721 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e9ea11-08cd-440e-b3ff-bb84e8044bd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:54.096206 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e9ea11-08cd-440e-b3ff-bb84e8044bd6 service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:34:54.105908 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1267/2518] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:34:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:34:54.385688 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4aeef8-21ed-40cd-b801-c02693013594 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:54.387138 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-fe4aeef8-21ed-40cd-b801-c02693013594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:34:54.401041 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4aeef8-21ed-40cd-b801-c02693013594 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:54.407059 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd37e703-9a07-4c59-b35e-c83750f91fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:54.407827 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37e703-9a07-4c59-b35e-c83750f91fd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:54.408230 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37e703-9a07-4c59-b35e-c83750f91fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:54.408495 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37e703-9a07-4c59-b35e-c83750f91fd5 admin admin] PATH_INFO: `/v3/projects/b3ca445ed34440e1a9e3be18dd22bf17` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:54.409935 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd37e703-9a07-4c59-b35e-c83750f91fd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3ca445ed34440e1a9e3be18dd22bf17)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:54.412148 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd37e703-9a07-4c59-b35e-c83750f91fd5 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:34:54.461414 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-dd37e703-9a07-4c59-b35e-c83750f91fd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3ca445ed34440e1a9e3be18dd22bf17', 'request_id': 'req-dd37e703-9a07-4c59-b35e-c83750f91fd5'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:34:54.468896 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-dd37e703-9a07-4c59-b35e-c83750f91fd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3ca445ed34440e1a9e3be18dd22bf17', 'request_id': 'req-dd37e703-9a07-4c59-b35e-c83750f91fd5'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:34:54.474768 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-dd37e703-9a07-4c59-b35e-c83750f91fd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3ca445ed34440e1a9e3be18dd22bf17', 'request_id': 'req-dd37e703-9a07-4c59-b35e-c83750f91fd5'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:34:54.486432 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-dd37e703-9a07-4c59-b35e-c83750f91fd5 admin admin] The token cache is being invalidate because project b3ca445ed34440e1a9e3be18dd22bf17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81383) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:34:54.486719 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-dd37e703-9a07-4c59-b35e-c83750f91fd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:34:54.487396 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-dd37e703-9a07-4c59-b35e-c83750f91fd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:34:54.489541 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1252/2519] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:34:54 2022] DELETE /identity/v3/projects/b3ca445ed34440e1a9e3be18dd22bf17 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:34:54.494917 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef882f90-859f-47b4-87aa-7f5992c67bbe None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:54.495252 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef882f90-859f-47b4-87aa-7f5992c67bbe None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:54.495570 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef882f90-859f-47b4-87aa-7f5992c67bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:54.515665 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-ef882f90-859f-47b4-87aa-7f5992c67bbe None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:34:54.517085 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-ef882f90-859f-47b4-87aa-7f5992c67bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:34:54.578109 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1268/2520] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:34:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:34:54.585879 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51bcfe8-d652-413d-a31f-f63fd035f200 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:54.586167 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51bcfe8-d652-413d-a31f-f63fd035f200 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:54.586444 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51bcfe8-d652-413d-a31f-f63fd035f200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:54.606283 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-a51bcfe8-d652-413d-a31f-f63fd035f200 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:34:54.607451 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-a51bcfe8-d652-413d-a31f-f63fd035f200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:34:54.616257 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1253/2521] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:34:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:34:54.620371 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef882f90-859f-47b4-87aa-7f5992c67bbe None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:54.629893 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef882f90-859f-47b4-87aa-7f5992c67bbe None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:54.634479 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6183dbe7-9605-4300-8cfd-73b47e45f4a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:54.635069 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6183dbe7-9605-4300-8cfd-73b47e45f4a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:54.635347 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6183dbe7-9605-4300-8cfd-73b47e45f4a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:54.635617 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6183dbe7-9605-4300-8cfd-73b47e45f4a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:54.636291 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6183dbe7-9605-4300-8cfd-73b47e45f4a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:34:54.636622 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6183dbe7-9605-4300-8cfd-73b47e45f4a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:54.638211 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6183dbe7-9605-4300-8cfd-73b47e45f4a2 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:34:54.652765 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1269/2522] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 05:34:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:34:54.653786 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51bcfe8-d652-413d-a31f-f63fd035f200 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:54.665525 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51bcfe8-d652-413d-a31f-f63fd035f200 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:54.670502 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c22c1ec-cf15-4ec4-aafa-37f3c431f73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:54.671154 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c22c1ec-cf15-4ec4-aafa-37f3c431f73e admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:54.671439 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c22c1ec-cf15-4ec4-aafa-37f3c431f73e admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:54.671736 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c22c1ec-cf15-4ec4-aafa-37f3c431f73e admin admin] PATH_INFO: `/v3/projects` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:54.672440 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c22c1ec-cf15-4ec4-aafa-37f3c431f73e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:54.674922 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c22c1ec-cf15-4ec4-aafa-37f3c431f73e admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:34:54.718811 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1254/2523] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:34:54 2022] POST /identity/v3/projects => generated 385 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:34:54.723828 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6183dbe7-9605-4300-8cfd-73b47e45f4a2 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:54.729539 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:34:54.736305 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6183dbe7-9605-4300-8cfd-73b47e45f4a2 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:54.798979 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb90758-7fc8-487d-96a0-27f33a265fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:54.799600 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb90758-7fc8-487d-96a0-27f33a265fb9 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:54.800264 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb90758-7fc8-487d-96a0-27f33a265fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:54.800264 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb90758-7fc8-487d-96a0-27f33a265fb9 admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:54.800796 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb90758-7fc8-487d-96a0-27f33a265fb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:54.803371 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb90758-7fc8-487d-96a0-27f33a265fb9 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:34:54.829034 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1270/2524] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:34:54 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:34:54.830537 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c22c1ec-cf15-4ec4-aafa-37f3c431f73e admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:54.842728 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c22c1ec-cf15-4ec4-aafa-37f3c431f73e admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:54.847875 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6544ab25-1103-42de-8149-4a7550afbd29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:54.849076 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6544ab25-1103-42de-8149-4a7550afbd29 admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:54.849397 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6544ab25-1103-42de-8149-4a7550afbd29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:54.849730 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6544ab25-1103-42de-8149-4a7550afbd29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:54.850457 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6544ab25-1103-42de-8149-4a7550afbd29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:54.852142 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6544ab25-1103-42de-8149-4a7550afbd29 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:34:54.862417 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1255/2525] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:34:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:34:54.867228 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb90758-7fc8-487d-96a0-27f33a265fb9 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:54.877900 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb90758-7fc8-487d-96a0-27f33a265fb9 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:54.882584 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7c12d2-d90f-4a66-902e-742356eef104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:54.883181 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c12d2-d90f-4a66-902e-742356eef104 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:54.883461 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c12d2-d90f-4a66-902e-742356eef104 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:54.883773 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c12d2-d90f-4a66-902e-742356eef104 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:54.884421 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7c12d2-d90f-4a66-902e-742356eef104 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:54.886042 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7c12d2-d90f-4a66-902e-742356eef104 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:34:54.896830 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1271/2526] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:34:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:34:54.900938 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6544ab25-1103-42de-8149-4a7550afbd29 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:54.911262 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6544ab25-1103-42de-8149-4a7550afbd29 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:54.915848 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e90e599-dd4a-4497-a203-38ca748ed1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:54.916489 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e90e599-dd4a-4497-a203-38ca748ed1f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:54.916760 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e90e599-dd4a-4497-a203-38ca748ed1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:54.917028 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e90e599-dd4a-4497-a203-38ca748ed1f9 admin admin] PATH_INFO: `/v3/projects/a5391e5d63d04bd98e23bc431d32b977/users/ded4eac157c3460ca60cf71eaa5a5b67/roles/aa7ff8e0ec1e48e5811335b9eb38b448` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:54.932285 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e90e599-dd4a-4497-a203-38ca748ed1f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5391e5d63d04bd98e23bc431d32b977, user_id=ded4eac157c3460ca60cf71eaa5a5b67, role_id=aa7ff8e0ec1e48e5811335b9eb38b448)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:54.934927 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e90e599-dd4a-4497-a203-38ca748ed1f9 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:34:54.948041 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1256/2527] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:34:54 2022] PUT /identity/v3/projects/a5391e5d63d04bd98e23bc431d32b977/users/ded4eac157c3460ca60cf71eaa5a5b67/roles/aa7ff8e0ec1e48e5811335b9eb38b448 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 05:34:54.959151 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e60014c-3f7b-47dc-82ee-2f70f5eb4554 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:54.959435 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e60014c-3f7b-47dc-82ee-2f70f5eb4554 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:54.959726 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e60014c-3f7b-47dc-82ee-2f70f5eb4554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:54.987746 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-3e60014c-3f7b-47dc-82ee-2f70f5eb4554 None None] MFA Rules not processed for user `ded4eac157c3460ca60cf71eaa5a5b67`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:34:54.991280 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-3e60014c-3f7b-47dc-82ee-2f70f5eb4554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:34:55.053942 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1272/2528] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:34:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:34:55.065181 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e90e599-dd4a-4497-a203-38ca748ed1f9 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:55.066869 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-9e90e599-dd4a-4497-a203-38ca748ed1f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:34:55.125520 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e90e599-dd4a-4497-a203-38ca748ed1f9 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:55.129034 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a50c91-57cb-402c-856f-638f69a50e52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a147e14b61d481db1cac02c58ac3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:55.129659 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a50c91-57cb-402c-856f-638f69a50e52 service cinder] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:55.129934 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a50c91-57cb-402c-856f-638f69a50e52 service cinder] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:55.130203 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a50c91-57cb-402c-856f-638f69a50e52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:55.138671 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a50c91-57cb-402c-856f-638f69a50e52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:55.140132 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a50c91-57cb-402c-856f-638f69a50e52 service cinder] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:34:55.149382 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1257/2529] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:34:55 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:34:55.527388 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e60014c-3f7b-47dc-82ee-2f70f5eb4554 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:55.528844 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-3e60014c-3f7b-47dc-82ee-2f70f5eb4554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:34:55.585628 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e60014c-3f7b-47dc-82ee-2f70f5eb4554 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:55.589123 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890d150b-16d5-42aa-800c-4a804f50407d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:55.589748 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d150b-16d5-42aa-800c-4a804f50407d service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:55.590020 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d150b-16d5-42aa-800c-4a804f50407d service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:55.590284 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d150b-16d5-42aa-800c-4a804f50407d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:55.591999 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-890d150b-16d5-42aa-800c-4a804f50407d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:34:55.616963 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:34:55.656906 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890d150b-16d5-42aa-800c-4a804f50407d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:55.658362 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890d150b-16d5-42aa-800c-4a804f50407d service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:34:55.668040 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1273/2530] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:34:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:34:57.026897 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84320c8d-5e7a-4bf5-b70a-51008f1ab486 None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:57.027504 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84320c8d-5e7a-4bf5-b70a-51008f1ab486 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:57.027657 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84320c8d-5e7a-4bf5-b70a-51008f1ab486 None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:57.029748 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1258/2531] 10.222.0.16 () {54 vars in 921 bytes} [Sun Sep 11 05:34:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:34:57.036665 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ae864-c015-4dca-a4e6-053f7b29cb79 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:57.037167 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ae864-c015-4dca-a4e6-053f7b29cb79 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:57.037270 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ae864-c015-4dca-a4e6-053f7b29cb79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:57.068189 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-722ae864-c015-4dca-a4e6-053f7b29cb79 None None] MFA Rules not processed for user `6cd6136036bd467c946cae90d5c29263`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:34:57.070283 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-722ae864-c015-4dca-a4e6-053f7b29cb79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:34:57.140837 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1274/2532] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 11 05:34:57 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:34:57.152341 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84320c8d-5e7a-4bf5-b70a-51008f1ab486 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:57.154068 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-84320c8d-5e7a-4bf5-b70a-51008f1ab486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:34:57.177376 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:34:57.226585 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84320c8d-5e7a-4bf5-b70a-51008f1ab486 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:57.241312 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0530b4d-883f-4610-851e-84641961cc30 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdd09106382447e9bf8b3a6a9ada89b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:57.241887 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0530b4d-883f-4610-851e-84641961cc30 service glance] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:57.242168 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0530b4d-883f-4610-851e-84641961cc30 service glance] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:57.242448 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0530b4d-883f-4610-851e-84641961cc30 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:57.256987 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0530b4d-883f-4610-851e-84641961cc30 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:57.258824 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0530b4d-883f-4610-851e-84641961cc30 service glance] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:34:57.271368 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1259/2533] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:34:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:34:57.354938 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff00ff4-e651-4fed-b714-9dbcdd1ecd2d None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:57.355283 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff00ff4-e651-4fed-b714-9dbcdd1ecd2d None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:57.355566 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff00ff4-e651-4fed-b714-9dbcdd1ecd2d None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:57.357219 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1275/2534] 10.222.0.16 () {54 vars in 921 bytes} [Sun Sep 11 05:34:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:34:57.364845 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa53a5-0547-47e4-98e0-cfacbe36c94d None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:57.365140 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa53a5-0547-47e4-98e0-cfacbe36c94d None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:57.365531 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa53a5-0547-47e4-98e0-cfacbe36c94d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:57.401722 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-81fa53a5-0547-47e4-98e0-cfacbe36c94d None None] MFA Rules not processed for user `72086abb4e0547dc96d76a44886805ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:34:57.402992 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-81fa53a5-0547-47e4-98e0-cfacbe36c94d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:34:57.420042 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1260/2535] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 11 05:34:57 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 05:34:57.429012 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff00ff4-e651-4fed-b714-9dbcdd1ecd2d None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:57.443151 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff00ff4-e651-4fed-b714-9dbcdd1ecd2d None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:57.447415 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238857c8-28c5-4383-8ef5-6474f68c8b9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:57.448066 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238857c8-28c5-4383-8ef5-6474f68c8b9f service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:57.448345 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238857c8-28c5-4383-8ef5-6474f68c8b9f service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:57.448624 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238857c8-28c5-4383-8ef5-6474f68c8b9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:57.459900 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238857c8-28c5-4383-8ef5-6474f68c8b9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:57.463612 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238857c8-28c5-4383-8ef5-6474f68c8b9f service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:34:57.478606 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1276/2536] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:34:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:34:57.569255 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde3948-b4df-4509-b898-8092367caffe None None] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:57.569596 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde3948-b4df-4509-b898-8092367caffe None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:57.569870 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde3948-b4df-4509-b898-8092367caffe None None] PATH_INFO: `/` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:57.571391 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1261/2537] 10.222.0.16 () {54 vars in 921 bytes} [Sun Sep 11 05:34:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 05:34:57.577354 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506fe92a-425f-4196-8243-f4dfe2e48092 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:57.577765 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506fe92a-425f-4196-8243-f4dfe2e48092 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:57.578135 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506fe92a-425f-4196-8243-f4dfe2e48092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:57.600349 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-506fe92a-425f-4196-8243-f4dfe2e48092 None None] MFA Rules not processed for user `6cd6136036bd467c946cae90d5c29263`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:34:57.601740 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-506fe92a-425f-4196-8243-f4dfe2e48092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:34:57.612971 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1277/2538] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 11 05:34:57 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:34:57.623557 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cde3948-b4df-4509-b898-8092367caffe None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:57.637538 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cde3948-b4df-4509-b898-8092367caffe None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:57.642750 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327e63a8-d4b3-4fa8-8864-1daba06105dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:57.643364 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e63a8-d4b3-4fa8-8864-1daba06105dc service neutron] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:57.643648 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e63a8-d4b3-4fa8-8864-1daba06105dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:57.643950 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e63a8-d4b3-4fa8-8864-1daba06105dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:57.658561 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327e63a8-d4b3-4fa8-8864-1daba06105dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:57.660894 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327e63a8-d4b3-4fa8-8864-1daba06105dc service neutron] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:34:57.677390 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1262/2539] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:34:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:34:57.791525 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506fe92a-425f-4196-8243-f4dfe2e48092 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:57.802497 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506fe92a-425f-4196-8243-f4dfe2e48092 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:57.807950 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07ad12e-f649-4ab8-9f2c-498e03ddb455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:57.808665 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07ad12e-f649-4ab8-9f2c-498e03ddb455 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:57.809128 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07ad12e-f649-4ab8-9f2c-498e03ddb455 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:57.809280 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07ad12e-f649-4ab8-9f2c-498e03ddb455 admin admin] PATH_INFO: `/v3/users/ded4eac157c3460ca60cf71eaa5a5b67` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:57.810815 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07ad12e-f649-4ab8-9f2c-498e03ddb455 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ded4eac157c3460ca60cf71eaa5a5b67)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:57.814509 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07ad12e-f649-4ab8-9f2c-498e03ddb455 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:34:57.885430 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-e07ad12e-f649-4ab8-9f2c-498e03ddb455 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ded4eac157c3460ca60cf71eaa5a5b67'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:34:57.903638 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-e07ad12e-f649-4ab8-9f2c-498e03ddb455 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ded4eac157c3460ca60cf71eaa5a5b67'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:34:57.911119 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-e07ad12e-f649-4ab8-9f2c-498e03ddb455 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ded4eac157c3460ca60cf71eaa5a5b67'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:34:57.921581 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-e07ad12e-f649-4ab8-9f2c-498e03ddb455 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ded4eac157c3460ca60cf71eaa5a5b67'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:34:57.922372 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-e07ad12e-f649-4ab8-9f2c-498e03ddb455 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ded4eac157c3460ca60cf71eaa5a5b67'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:34:57.929866 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1278/2540] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:34:57 2022] DELETE /identity/v3/users/ded4eac157c3460ca60cf71eaa5a5b67 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:34:57.934512 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd4b28b-a1ad-4413-8d9b-74562fbfe411 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:57.934826 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd4b28b-a1ad-4413-8d9b-74562fbfe411 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:57.937273 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd4b28b-a1ad-4413-8d9b-74562fbfe411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:57.959263 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-3dd4b28b-a1ad-4413-8d9b-74562fbfe411 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:34:57.960506 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-3dd4b28b-a1ad-4413-8d9b-74562fbfe411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:34:58.036215 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1263/2541] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:34:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:34:58.049303 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07ad12e-f649-4ab8-9f2c-498e03ddb455 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:58.053341 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-e07ad12e-f649-4ab8-9f2c-498e03ddb455 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:34:58.060933 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:34:58.124396 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07ad12e-f649-4ab8-9f2c-498e03ddb455 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:58.128531 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab5df71-99d3-45e3-902f-b15eed98d879 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:58.129813 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab5df71-99d3-45e3-902f-b15eed98d879 service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:58.130211 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab5df71-99d3-45e3-902f-b15eed98d879 service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:58.130483 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab5df71-99d3-45e3-902f-b15eed98d879 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:58.141729 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab5df71-99d3-45e3-902f-b15eed98d879 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:58.143254 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab5df71-99d3-45e3-902f-b15eed98d879 service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:34:58.159877 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1279/2542] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:34:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:34:58.703719 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd4b28b-a1ad-4413-8d9b-74562fbfe411 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:58.705159 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-3dd4b28b-a1ad-4413-8d9b-74562fbfe411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:34:58.719880 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd4b28b-a1ad-4413-8d9b-74562fbfe411 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:58.725559 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7176ab-a25c-4176-856c-184d9afdde09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:58.726237 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7176ab-a25c-4176-856c-184d9afdde09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:58.726497 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7176ab-a25c-4176-856c-184d9afdde09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:58.726892 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7176ab-a25c-4176-856c-184d9afdde09 admin admin] PATH_INFO: `/v3/projects/a5391e5d63d04bd98e23bc431d32b977` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:58.727994 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7176ab-a25c-4176-856c-184d9afdde09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5391e5d63d04bd98e23bc431d32b977)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:58.731159 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7176ab-a25c-4176-856c-184d9afdde09 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:34:58.797730 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-af7176ab-a25c-4176-856c-184d9afdde09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5391e5d63d04bd98e23bc431d32b977', 'request_id': 'req-af7176ab-a25c-4176-856c-184d9afdde09'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:34:58.809865 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-af7176ab-a25c-4176-856c-184d9afdde09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5391e5d63d04bd98e23bc431d32b977', 'request_id': 'req-af7176ab-a25c-4176-856c-184d9afdde09'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:34:58.817161 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-af7176ab-a25c-4176-856c-184d9afdde09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5391e5d63d04bd98e23bc431d32b977', 'request_id': 'req-af7176ab-a25c-4176-856c-184d9afdde09'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:34:58.847593 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-af7176ab-a25c-4176-856c-184d9afdde09 admin admin] The token cache is being invalidate because project a5391e5d63d04bd98e23bc431d32b977 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81383) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:34:58.849065 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-af7176ab-a25c-4176-856c-184d9afdde09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:34:58.849810 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-af7176ab-a25c-4176-856c-184d9afdde09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:34:58.851626 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1264/2543] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:34:58 2022] DELETE /identity/v3/projects/a5391e5d63d04bd98e23bc431d32b977 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:34:58.857272 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ad605-98e9-495e-ac33-c1221821e151 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:58.857655 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ad605-98e9-495e-ac33-c1221821e151 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:58.857860 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ad605-98e9-495e-ac33-c1221821e151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:58.887007 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-6a3ad605-98e9-495e-ac33-c1221821e151 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:34:58.889751 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-6a3ad605-98e9-495e-ac33-c1221821e151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:34:58.980653 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5dcd2f-edc5-4087-8e4b-ddf69c652b77 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:58.980872 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5dcd2f-edc5-4087-8e4b-ddf69c652b77 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:58.981054 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5dcd2f-edc5-4087-8e4b-ddf69c652b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:58.984583 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1280/2544] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:34:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:34:59.006865 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-2e5dcd2f-edc5-4087-8e4b-ddf69c652b77 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:34:59.008385 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-2e5dcd2f-edc5-4087-8e4b-ddf69c652b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:34:59.018113 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1265/2545] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:34:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:34:59.023894 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3ad605-98e9-495e-ac33-c1221821e151 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:59.043131 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3ad605-98e9-495e-ac33-c1221821e151 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:59.048662 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94600629-0d92-4afa-84fa-134c46b20df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:59.049604 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94600629-0d92-4afa-84fa-134c46b20df4 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:59.050648 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94600629-0d92-4afa-84fa-134c46b20df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:59.051139 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94600629-0d92-4afa-84fa-134c46b20df4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:59.052024 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94600629-0d92-4afa-84fa-134c46b20df4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:34:59.052703 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94600629-0d92-4afa-84fa-134c46b20df4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:59.054660 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94600629-0d92-4afa-84fa-134c46b20df4 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:34:59.072588 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1281/2546] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 05:34:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:34:59.077014 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5dcd2f-edc5-4087-8e4b-ddf69c652b77 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:59.090431 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5dcd2f-edc5-4087-8e4b-ddf69c652b77 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:59.096420 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deca24b-55a1-460d-9fee-073419c0b898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:59.098409 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deca24b-55a1-460d-9fee-073419c0b898 admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:59.098871 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deca24b-55a1-460d-9fee-073419c0b898 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:59.099138 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deca24b-55a1-460d-9fee-073419c0b898 admin admin] PATH_INFO: `/v3/projects` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:59.099829 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deca24b-55a1-460d-9fee-073419c0b898 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:59.101919 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deca24b-55a1-460d-9fee-073419c0b898 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:34:59.138431 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:34:59.151879 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1266/2547] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:34:59 2022] POST /identity/v3/projects => generated 375 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 05:34:59.156008 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94600629-0d92-4afa-84fa-134c46b20df4 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:59.178099 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94600629-0d92-4afa-84fa-134c46b20df4 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:59.255843 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a558582-50e1-407a-b111-708732741512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:59.256637 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a558582-50e1-407a-b111-708732741512 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:59.257034 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a558582-50e1-407a-b111-708732741512 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:59.257406 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a558582-50e1-407a-b111-708732741512 admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:59.258574 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a558582-50e1-407a-b111-708732741512 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:59.261089 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a558582-50e1-407a-b111-708732741512 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:34:59.293473 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1282/2548] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:34:59 2022] POST /identity/v3/users => generated 288 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:34:59.298480 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deca24b-55a1-460d-9fee-073419c0b898 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:59.310933 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deca24b-55a1-460d-9fee-073419c0b898 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:59.317076 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcd4063-8070-4f45-b946-69c22d691393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:59.317364 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd4063-8070-4f45-b946-69c22d691393 admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:59.317466 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd4063-8070-4f45-b946-69c22d691393 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:59.317699 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd4063-8070-4f45-b946-69c22d691393 admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:59.318376 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcd4063-8070-4f45-b946-69c22d691393 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:59.320184 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcd4063-8070-4f45-b946-69c22d691393 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:34:59.334617 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1267/2549] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:34:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:34:59.336183 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a558582-50e1-407a-b111-708732741512 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:59.354031 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a558582-50e1-407a-b111-708732741512 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:59.359543 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18436b7c-33aa-47c2-915f-c6c94c7cc9c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:59.360922 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18436b7c-33aa-47c2-915f-c6c94c7cc9c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:59.360922 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18436b7c-33aa-47c2-915f-c6c94c7cc9c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:59.361149 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18436b7c-33aa-47c2-915f-c6c94c7cc9c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:59.361795 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18436b7c-33aa-47c2-915f-c6c94c7cc9c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:59.363444 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18436b7c-33aa-47c2-915f-c6c94c7cc9c5 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:34:59.378070 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1283/2550] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:34:59 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:34:59.380557 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcd4063-8070-4f45-b946-69c22d691393 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:59.393495 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcd4063-8070-4f45-b946-69c22d691393 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:59.401328 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7e3cf2-cc0a-45a8-9771-c4ad94872723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:59.403756 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e3cf2-cc0a-45a8-9771-c4ad94872723 admin admin] REQUEST_METHOD: `PUT` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:59.404040 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e3cf2-cc0a-45a8-9771-c4ad94872723 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:59.404837 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e3cf2-cc0a-45a8-9771-c4ad94872723 admin admin] PATH_INFO: `/v3/projects/f1b2605a5a7c4b2995d59e84ad42ebcc/users/699bd5f04e9646f2b89621c9e9283c9b/roles/aa7ff8e0ec1e48e5811335b9eb38b448` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:59.444449 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18436b7c-33aa-47c2-915f-c6c94c7cc9c5 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:59.446512 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-18436b7c-33aa-47c2-915f-c6c94c7cc9c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:34:59.449921 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7e3cf2-cc0a-45a8-9771-c4ad94872723 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1b2605a5a7c4b2995d59e84ad42ebcc, user_id=699bd5f04e9646f2b89621c9e9283c9b, role_id=aa7ff8e0ec1e48e5811335b9eb38b448)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:59.453455 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7e3cf2-cc0a-45a8-9771-c4ad94872723 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:34:59.464604 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18436b7c-33aa-47c2-915f-c6c94c7cc9c5 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:59.470446 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1268/2551] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:34:59 2022] PUT /identity/v3/projects/f1b2605a5a7c4b2995d59e84ad42ebcc/users/699bd5f04e9646f2b89621c9e9283c9b/roles/aa7ff8e0ec1e48e5811335b9eb38b448 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:34:59.481204 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31029e4e-a206-4fb6-8953-7056cd32c3c6 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:59.482610 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31029e4e-a206-4fb6-8953-7056cd32c3c6 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:59.483061 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31029e4e-a206-4fb6-8953-7056cd32c3c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:59.484236 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:34:59.517918 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-31029e4e-a206-4fb6-8953-7056cd32c3c6 None None] MFA Rules not processed for user `699bd5f04e9646f2b89621c9e9283c9b`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:34:59.519769 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-31029e4e-a206-4fb6-8953-7056cd32c3c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:34:59.545341 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac10e722-fe5a-4e83-8f97-9d8d15d3608f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:59.545858 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac10e722-fe5a-4e83-8f97-9d8d15d3608f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:59.546133 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac10e722-fe5a-4e83-8f97-9d8d15d3608f admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:59.546400 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac10e722-fe5a-4e83-8f97-9d8d15d3608f admin admin] PATH_INFO: `/v3/users/72ae9b828c41476ca9414cd26163d384` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:59.547864 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac10e722-fe5a-4e83-8f97-9d8d15d3608f admin admin] RBAC: Authorizing `identity:delete_user(user_id=72ae9b828c41476ca9414cd26163d384)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:59.551481 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac10e722-fe5a-4e83-8f97-9d8d15d3608f admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:34:59.606224 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1269/2552] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:34:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 05:34:59.606620 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-ac10e722-fe5a-4e83-8f97-9d8d15d3608f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72ae9b828c41476ca9414cd26163d384'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:34:59.618189 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31029e4e-a206-4fb6-8953-7056cd32c3c6 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:59.620115 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-31029e4e-a206-4fb6-8953-7056cd32c3c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:34:59.620471 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-ac10e722-fe5a-4e83-8f97-9d8d15d3608f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72ae9b828c41476ca9414cd26163d384'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:34:59.627402 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-ac10e722-fe5a-4e83-8f97-9d8d15d3608f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72ae9b828c41476ca9414cd26163d384'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:34:59.635790 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-ac10e722-fe5a-4e83-8f97-9d8d15d3608f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72ae9b828c41476ca9414cd26163d384'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:34:59.636457 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-ac10e722-fe5a-4e83-8f97-9d8d15d3608f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72ae9b828c41476ca9414cd26163d384'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:34:59.642316 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1284/2553] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:34:59 2022] DELETE /identity/v3/users/72ae9b828c41476ca9414cd26163d384 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 05:34:59.685750 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31029e4e-a206-4fb6-8953-7056cd32c3c6 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:59.724201 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65772207-ca4a-49f0-b554-2b3df0215189 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:59.724480 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65772207-ca4a-49f0-b554-2b3df0215189 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:59.724774 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65772207-ca4a-49f0-b554-2b3df0215189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:59.756847 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8349e5af-1adc-40a9-a3e6-b9825a0000ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a147e14b61d481db1cac02c58ac3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:59.757759 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8349e5af-1adc-40a9-a3e6-b9825a0000ce service cinder] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:59.758282 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8349e5af-1adc-40a9-a3e6-b9825a0000ce service cinder] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:59.758837 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8349e5af-1adc-40a9-a3e6-b9825a0000ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:59.759208 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-65772207-ca4a-49f0-b554-2b3df0215189 None None] MFA Rules not processed for user `62fffbcf330a4bc183d0885c175f5a90`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:34:59.760470 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-65772207-ca4a-49f0-b554-2b3df0215189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:34:59.760803 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-8349e5af-1adc-40a9-a3e6-b9825a0000ce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:34:59.786410 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:34:59.830718 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8349e5af-1adc-40a9-a3e6-b9825a0000ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:59.832259 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8349e5af-1adc-40a9-a3e6-b9825a0000ce service cinder] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:34:59.840830 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1285/2554] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 05:34:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 05:34:59.860947 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1270/2555] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:34:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 05:34:59.863452 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65772207-ca4a-49f0-b554-2b3df0215189 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:59.868636 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-65772207-ca4a-49f0-b554-2b3df0215189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:34:59.883396 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8349e5af-1adc-40a9-a3e6-b9825a0000ce service cinder] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:34:59.885218 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-8349e5af-1adc-40a9-a3e6-b9825a0000ce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:34:59.935599 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:34:59.975259 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65772207-ca4a-49f0-b554-2b3df0215189 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:59.981120 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a188ace3-cd00-4307-acf5-4ac9b13cdc27 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bbe4555380345e485572d2da8b78be1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:59.981742 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a188ace3-cd00-4307-acf5-4ac9b13cdc27 service swift] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:59.982022 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a188ace3-cd00-4307-acf5-4ac9b13cdc27 service swift] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:59.982299 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a188ace3-cd00-4307-acf5-4ac9b13cdc27 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:59.988287 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8349e5af-1adc-40a9-a3e6-b9825a0000ce service cinder] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:34:59.992820 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a188ace3-cd00-4307-acf5-4ac9b13cdc27 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:59.993995 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540ee2cd-448d-457d-83c8-3cfae268f4fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:34:59.994635 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540ee2cd-448d-457d-83c8-3cfae268f4fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:34:59.994912 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540ee2cd-448d-457d-83c8-3cfae268f4fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:34:59.995186 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540ee2cd-448d-457d-83c8-3cfae268f4fc admin admin] PATH_INFO: `/v3/projects/4ae751d903914a85bf8049a90e21e495` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:34:59.996403 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a188ace3-cd00-4307-acf5-4ac9b13cdc27 service swift] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:34:59.996541 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540ee2cd-448d-457d-83c8-3cfae268f4fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ae751d903914a85bf8049a90e21e495)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:34:59.998242 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540ee2cd-448d-457d-83c8-3cfae268f4fc admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:00.005957 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1286/2556] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 05:34:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 05:35:00.060022 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-540ee2cd-448d-457d-83c8-3cfae268f4fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ae751d903914a85bf8049a90e21e495', 'request_id': 'req-540ee2cd-448d-457d-83c8-3cfae268f4fc'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:00.082131 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-540ee2cd-448d-457d-83c8-3cfae268f4fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ae751d903914a85bf8049a90e21e495', 'request_id': 'req-540ee2cd-448d-457d-83c8-3cfae268f4fc'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:00.102961 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-540ee2cd-448d-457d-83c8-3cfae268f4fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ae751d903914a85bf8049a90e21e495', 'request_id': 'req-540ee2cd-448d-457d-83c8-3cfae268f4fc'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:00.140471 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-540ee2cd-448d-457d-83c8-3cfae268f4fc admin admin] The token cache is being invalidate because project 4ae751d903914a85bf8049a90e21e495 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81383) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:35:00.140814 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-540ee2cd-448d-457d-83c8-3cfae268f4fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:00.142508 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-540ee2cd-448d-457d-83c8-3cfae268f4fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:00.147183 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1271/2557] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:34:59 2022] DELETE /identity/v3/projects/4ae751d903914a85bf8049a90e21e495 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:35:00.152665 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb36ea-044f-44e9-92e0-49ed30473574 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:00.153172 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb36ea-044f-44e9-92e0-49ed30473574 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:00.153604 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb36ea-044f-44e9-92e0-49ed30473574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:00.196248 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-6cdb36ea-044f-44e9-92e0-49ed30473574 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:35:00.198796 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-6cdb36ea-044f-44e9-92e0-49ed30473574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:35:00.315253 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1287/2558] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:35:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 05:35:00.323717 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de400a49-a723-42fb-b951-f54006a79a30 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:00.324260 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de400a49-a723-42fb-b951-f54006a79a30 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:00.324775 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de400a49-a723-42fb-b951-f54006a79a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:00.371019 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-de400a49-a723-42fb-b951-f54006a79a30 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:35:00.374839 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-de400a49-a723-42fb-b951-f54006a79a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:35:00.398599 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1272/2559] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:35:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:35:00.400698 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdb36ea-044f-44e9-92e0-49ed30473574 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:00.414073 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdb36ea-044f-44e9-92e0-49ed30473574 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:00.426605 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c980ee56-b48f-4cae-a5c1-9c661b663bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:00.427445 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980ee56-b48f-4cae-a5c1-9c661b663bd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:00.427902 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980ee56-b48f-4cae-a5c1-9c661b663bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:00.428288 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980ee56-b48f-4cae-a5c1-9c661b663bd5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:00.429164 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c980ee56-b48f-4cae-a5c1-9c661b663bd5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:35:00.429544 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c980ee56-b48f-4cae-a5c1-9c661b663bd5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:00.439482 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c980ee56-b48f-4cae-a5c1-9c661b663bd5 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:00.464600 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1288/2560] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 05:35:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:35:00.468924 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de400a49-a723-42fb-b951-f54006a79a30 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:00.482871 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de400a49-a723-42fb-b951-f54006a79a30 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:00.496338 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2071a00-e33d-4a95-a21c-b39ef8d442ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:00.497241 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2071a00-e33d-4a95-a21c-b39ef8d442ed admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:00.497717 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2071a00-e33d-4a95-a21c-b39ef8d442ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:00.498182 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2071a00-e33d-4a95-a21c-b39ef8d442ed admin admin] PATH_INFO: `/v3/projects` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:00.499174 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2071a00-e33d-4a95-a21c-b39ef8d442ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:00.502797 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2071a00-e33d-4a95-a21c-b39ef8d442ed admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:00.576171 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1273/2561] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:35:00 2022] POST /identity/v3/projects => generated 365 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:35:00.580596 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c980ee56-b48f-4cae-a5c1-9c661b663bd5 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:00.591192 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c980ee56-b48f-4cae-a5c1-9c661b663bd5 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:00.664264 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03993bc0-1102-4c92-86c5-becd8ac24bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:00.664836 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03993bc0-1102-4c92-86c5-becd8ac24bc3 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:00.665104 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03993bc0-1102-4c92-86c5-becd8ac24bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:00.665376 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03993bc0-1102-4c92-86c5-becd8ac24bc3 admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:00.666009 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03993bc0-1102-4c92-86c5-becd8ac24bc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:00.667973 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03993bc0-1102-4c92-86c5-becd8ac24bc3 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:00.698069 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1289/2562] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:35:00 2022] POST /identity/v3/users => generated 283 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:35:00.703220 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2071a00-e33d-4a95-a21c-b39ef8d442ed admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:00.716024 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2071a00-e33d-4a95-a21c-b39ef8d442ed admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:00.721708 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1868551b-80f5-450f-ab5c-d7f5bc2290df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:00.723137 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1868551b-80f5-450f-ab5c-d7f5bc2290df admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:00.723970 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1868551b-80f5-450f-ab5c-d7f5bc2290df admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:00.724860 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1868551b-80f5-450f-ab5c-d7f5bc2290df admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:00.726128 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1868551b-80f5-450f-ab5c-d7f5bc2290df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:00.728376 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1868551b-80f5-450f-ab5c-d7f5bc2290df admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:00.743494 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1274/2563] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:35:00 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:35:00.747929 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03993bc0-1102-4c92-86c5-becd8ac24bc3 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:00.761768 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03993bc0-1102-4c92-86c5-becd8ac24bc3 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:00.767618 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c97194-e7a9-4f0f-84ae-0ae7930229f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:00.768683 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c97194-e7a9-4f0f-84ae-0ae7930229f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:00.769187 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c97194-e7a9-4f0f-84ae-0ae7930229f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:00.769607 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c97194-e7a9-4f0f-84ae-0ae7930229f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:00.770496 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c97194-e7a9-4f0f-84ae-0ae7930229f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:00.772589 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c97194-e7a9-4f0f-84ae-0ae7930229f0 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:00.786842 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1290/2564] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:35:00 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:35:00.790743 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1868551b-80f5-450f-ab5c-d7f5bc2290df admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:00.803627 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1868551b-80f5-450f-ab5c-d7f5bc2290df admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:00.808631 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e1b862-3675-4027-91d1-2a6da3a3fce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:00.809704 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e1b862-3675-4027-91d1-2a6da3a3fce9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:00.810036 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e1b862-3675-4027-91d1-2a6da3a3fce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:00.810490 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e1b862-3675-4027-91d1-2a6da3a3fce9 admin admin] PATH_INFO: `/v3/projects/71e3634a9a1448a5aacedda37b362ef5/users/3fcf62235d384b6b808dabbd3706cb64/roles/aa7ff8e0ec1e48e5811335b9eb38b448` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:00.824230 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:35:00.831234 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e1b862-3675-4027-91d1-2a6da3a3fce9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71e3634a9a1448a5aacedda37b362ef5, user_id=3fcf62235d384b6b808dabbd3706cb64, role_id=aa7ff8e0ec1e48e5811335b9eb38b448)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:00.835611 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e1b862-3675-4027-91d1-2a6da3a3fce9 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:00.858838 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1275/2565] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:35:00 2022] PUT /identity/v3/projects/71e3634a9a1448a5aacedda37b362ef5/users/3fcf62235d384b6b808dabbd3706cb64/roles/aa7ff8e0ec1e48e5811335b9eb38b448 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:35:00.871507 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f1fd48-fab7-43fd-8aee-22f973a588c7 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:00.871825 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f1fd48-fab7-43fd-8aee-22f973a588c7 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:00.872104 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f1fd48-fab7-43fd-8aee-22f973a588c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:00.911554 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-15f1fd48-fab7-43fd-8aee-22f973a588c7 None None] MFA Rules not processed for user `3fcf62235d384b6b808dabbd3706cb64`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:35:00.913031 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-15f1fd48-fab7-43fd-8aee-22f973a588c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:35:00.951631 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:35:01.004800 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1291/2566] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:35:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:35:01.009298 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e1b862-3675-4027-91d1-2a6da3a3fce9 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:01.092847 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e1b862-3675-4027-91d1-2a6da3a3fce9 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:01.098797 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027f3526-3ede-4203-b088-d0a240916f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:01.099375 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f3526-3ede-4203-b088-d0a240916f46 admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:01.099655 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f3526-3ede-4203-b088-d0a240916f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:01.099953 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f3526-3ede-4203-b088-d0a240916f46 admin admin] PATH_INFO: `/v3/projects` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:01.100603 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027f3526-3ede-4203-b088-d0a240916f46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:01.102599 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027f3526-3ede-4203-b088-d0a240916f46 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:01.139688 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1276/2567] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:35:01 2022] POST /identity/v3/projects => generated 365 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:35:01.143285 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f1fd48-fab7-43fd-8aee-22f973a588c7 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:01.154750 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f1fd48-fab7-43fd-8aee-22f973a588c7 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:01.230554 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa221bf4-ef96-4256-833d-ef7eacc2632e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:01.231183 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa221bf4-ef96-4256-833d-ef7eacc2632e admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:01.231526 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa221bf4-ef96-4256-833d-ef7eacc2632e admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:01.231931 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa221bf4-ef96-4256-833d-ef7eacc2632e admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:01.232631 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa221bf4-ef96-4256-833d-ef7eacc2632e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:01.234645 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa221bf4-ef96-4256-833d-ef7eacc2632e admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:01.256997 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1292/2568] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:35:01 2022] POST /identity/v3/users => generated 289 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 05:35:01.261586 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027f3526-3ede-4203-b088-d0a240916f46 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:01.273204 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027f3526-3ede-4203-b088-d0a240916f46 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:01.278033 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da031d3-a8f4-4e78-b7a2-a9c750972607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:01.278643 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da031d3-a8f4-4e78-b7a2-a9c750972607 admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:01.279105 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da031d3-a8f4-4e78-b7a2-a9c750972607 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:01.279254 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da031d3-a8f4-4e78-b7a2-a9c750972607 admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:01.279850 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da031d3-a8f4-4e78-b7a2-a9c750972607 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:01.281440 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da031d3-a8f4-4e78-b7a2-a9c750972607 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:01.295855 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1277/2569] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:35:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:35:01.297217 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa221bf4-ef96-4256-833d-ef7eacc2632e admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:01.307443 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa221bf4-ef96-4256-833d-ef7eacc2632e admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:01.312572 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73f023d-f285-49a9-8b99-fa2533772c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:01.313491 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f023d-f285-49a9-8b99-fa2533772c0d admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:01.313857 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f023d-f285-49a9-8b99-fa2533772c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:01.314200 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f023d-f285-49a9-8b99-fa2533772c0d admin admin] PATH_INFO: `/v3/projects/7429d66f288547889af44f65239a6fc9/users/6f6dd3cd2ab842939750fc51c8ca0d08/roles/5b702713e40145b49e0b42abd0a5fba9` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:01.337019 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73f023d-f285-49a9-8b99-fa2533772c0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7429d66f288547889af44f65239a6fc9, user_id=6f6dd3cd2ab842939750fc51c8ca0d08, role_id=5b702713e40145b49e0b42abd0a5fba9)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:01.340002 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73f023d-f285-49a9-8b99-fa2533772c0d admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:01.358056 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1293/2570] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:35:01 2022] PUT /identity/v3/projects/7429d66f288547889af44f65239a6fc9/users/6f6dd3cd2ab842939750fc51c8ca0d08/roles/5b702713e40145b49e0b42abd0a5fba9 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:35:01.362323 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da031d3-a8f4-4e78-b7a2-a9c750972607 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:01.372833 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da031d3-a8f4-4e78-b7a2-a9c750972607 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:01.442565 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379516d6-155a-412e-a32b-097991d39179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:01.443334 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379516d6-155a-412e-a32b-097991d39179 admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:01.443754 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379516d6-155a-412e-a32b-097991d39179 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:01.444031 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379516d6-155a-412e-a32b-097991d39179 admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:01.444674 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379516d6-155a-412e-a32b-097991d39179 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:01.446300 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379516d6-155a-412e-a32b-097991d39179 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:01.458184 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1278/2571] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:35:01 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 05:35:01.462475 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73f023d-f285-49a9-8b99-fa2533772c0d admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:01.475058 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73f023d-f285-49a9-8b99-fa2533772c0d admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:01.479760 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597319bd-8527-47f7-b528-6c0e4c26c649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:01.480423 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597319bd-8527-47f7-b528-6c0e4c26c649 admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:01.480883 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597319bd-8527-47f7-b528-6c0e4c26c649 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:01.481107 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597319bd-8527-47f7-b528-6c0e4c26c649 admin admin] PATH_INFO: `/v3/projects/7429d66f288547889af44f65239a6fc9/users/6f6dd3cd2ab842939750fc51c8ca0d08/roles/5b702713e40145b49e0b42abd0a5fba9` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:01.483221 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597319bd-8527-47f7-b528-6c0e4c26c649 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7429d66f288547889af44f65239a6fc9, user_id=6f6dd3cd2ab842939750fc51c8ca0d08, role_id=5b702713e40145b49e0b42abd0a5fba9)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:01.486373 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597319bd-8527-47f7-b528-6c0e4c26c649 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:01.498546 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1294/2572] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:35:01 2022] PUT /identity/v3/projects/7429d66f288547889af44f65239a6fc9/users/6f6dd3cd2ab842939750fc51c8ca0d08/roles/5b702713e40145b49e0b42abd0a5fba9 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 05:35:01.509065 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92643d8-997d-4527-afdf-d5dc77abb9ce None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:01.509351 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92643d8-997d-4527-afdf-d5dc77abb9ce None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:01.509628 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92643d8-997d-4527-afdf-d5dc77abb9ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:01.539075 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-d92643d8-997d-4527-afdf-d5dc77abb9ce None None] MFA Rules not processed for user `6f6dd3cd2ab842939750fc51c8ca0d08`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:35:01.543843 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-d92643d8-997d-4527-afdf-d5dc77abb9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:35:01.605580 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:35:01.638660 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1279/2573] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:35:01 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:35:01.646345 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597319bd-8527-47f7-b528-6c0e4c26c649 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:01.648780 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-597319bd-8527-47f7-b528-6c0e4c26c649 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:35:01.736750 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597319bd-8527-47f7-b528-6c0e4c26c649 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:01.742408 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c378757-2160-495d-a876-6ca12cea6c26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a147e14b61d481db1cac02c58ac3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:01.743258 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c378757-2160-495d-a876-6ca12cea6c26 service cinder] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:01.743908 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c378757-2160-495d-a876-6ca12cea6c26 service cinder] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:01.744277 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c378757-2160-495d-a876-6ca12cea6c26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:01.761775 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c378757-2160-495d-a876-6ca12cea6c26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:01.763470 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c378757-2160-495d-a876-6ca12cea6c26 service cinder] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:01.774880 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1295/2574] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:35:01 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 05:35:02.368790 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92643d8-997d-4527-afdf-d5dc77abb9ce None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:02.433917 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92643d8-997d-4527-afdf-d5dc77abb9ce None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:02.447425 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f1e9e5-17c6-4454-a269-0688a601a568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:02.448119 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f1e9e5-17c6-4454-a269-0688a601a568 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:02.448398 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f1e9e5-17c6-4454-a269-0688a601a568 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:02.448668 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f1e9e5-17c6-4454-a269-0688a601a568 admin admin] PATH_INFO: `/v3/users/3fcf62235d384b6b808dabbd3706cb64` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:02.449808 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f1e9e5-17c6-4454-a269-0688a601a568 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fcf62235d384b6b808dabbd3706cb64)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:02.451831 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f1e9e5-17c6-4454-a269-0688a601a568 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:02.502466 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-b2f1e9e5-17c6-4454-a269-0688a601a568 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fcf62235d384b6b808dabbd3706cb64'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:02.514308 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-b2f1e9e5-17c6-4454-a269-0688a601a568 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fcf62235d384b6b808dabbd3706cb64'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:02.521670 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-b2f1e9e5-17c6-4454-a269-0688a601a568 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fcf62235d384b6b808dabbd3706cb64'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:02.529041 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-b2f1e9e5-17c6-4454-a269-0688a601a568 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fcf62235d384b6b808dabbd3706cb64'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:02.529639 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-b2f1e9e5-17c6-4454-a269-0688a601a568 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fcf62235d384b6b808dabbd3706cb64'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:02.536554 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1280/2575] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:35:02 2022] DELETE /identity/v3/users/3fcf62235d384b6b808dabbd3706cb64 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:35:02.541020 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03411e9e-7234-4aa2-9b74-ef0f6d6194e2 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:02.541481 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03411e9e-7234-4aa2-9b74-ef0f6d6194e2 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:02.541575 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03411e9e-7234-4aa2-9b74-ef0f6d6194e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:02.560284 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-03411e9e-7234-4aa2-9b74-ef0f6d6194e2 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:35:02.561501 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-03411e9e-7234-4aa2-9b74-ef0f6d6194e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:35:02.582473 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:35:02.667708 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1296/2576] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:35:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:35:02.679298 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f1e9e5-17c6-4454-a269-0688a601a568 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:02.684717 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-b2f1e9e5-17c6-4454-a269-0688a601a568 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:35:02.774004 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f1e9e5-17c6-4454-a269-0688a601a568 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:02.777682 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286cab62-3f0a-4d21-9a52-b826391c1aee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:02.778312 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286cab62-3f0a-4d21-9a52-b826391c1aee service neutron] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:02.778592 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286cab62-3f0a-4d21-9a52-b826391c1aee service neutron] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:02.778865 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286cab62-3f0a-4d21-9a52-b826391c1aee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:02.789254 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286cab62-3f0a-4d21-9a52-b826391c1aee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:02.790697 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286cab62-3f0a-4d21-9a52-b826391c1aee service neutron] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:02.800461 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1281/2577] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:35:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:35:03.125334 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03411e9e-7234-4aa2-9b74-ef0f6d6194e2 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:03.127024 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-03411e9e-7234-4aa2-9b74-ef0f6d6194e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:35:03.139897 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03411e9e-7234-4aa2-9b74-ef0f6d6194e2 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:03.145739 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a460e8e1-4e55-40b9-8a6b-98107731dcbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:03.146376 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a460e8e1-4e55-40b9-8a6b-98107731dcbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:03.146683 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a460e8e1-4e55-40b9-8a6b-98107731dcbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:03.146956 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a460e8e1-4e55-40b9-8a6b-98107731dcbc admin admin] PATH_INFO: `/v3/projects/71e3634a9a1448a5aacedda37b362ef5` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:03.148147 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a460e8e1-4e55-40b9-8a6b-98107731dcbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=71e3634a9a1448a5aacedda37b362ef5)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:03.150082 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a460e8e1-4e55-40b9-8a6b-98107731dcbc admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:03.220693 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-a460e8e1-4e55-40b9-8a6b-98107731dcbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71e3634a9a1448a5aacedda37b362ef5', 'request_id': 'req-a460e8e1-4e55-40b9-8a6b-98107731dcbc'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:03.241878 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-a460e8e1-4e55-40b9-8a6b-98107731dcbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71e3634a9a1448a5aacedda37b362ef5', 'request_id': 'req-a460e8e1-4e55-40b9-8a6b-98107731dcbc'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:03.253460 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-a460e8e1-4e55-40b9-8a6b-98107731dcbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71e3634a9a1448a5aacedda37b362ef5', 'request_id': 'req-a460e8e1-4e55-40b9-8a6b-98107731dcbc'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:03.269608 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-a460e8e1-4e55-40b9-8a6b-98107731dcbc admin admin] The token cache is being invalidate because project 71e3634a9a1448a5aacedda37b362ef5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:35:03.269608 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-a460e8e1-4e55-40b9-8a6b-98107731dcbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:03.270441 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-a460e8e1-4e55-40b9-8a6b-98107731dcbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:03.275282 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1297/2578] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:35:03 2022] DELETE /identity/v3/projects/71e3634a9a1448a5aacedda37b362ef5 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:35:03.276474 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286cab62-3f0a-4d21-9a52-b826391c1aee service neutron] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:03.288039 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286cab62-3f0a-4d21-9a52-b826391c1aee service neutron] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:03.291876 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:35:03.376620 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35dae90-7c66-42da-80bc-08bedbeef6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:03.378149 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35dae90-7c66-42da-80bc-08bedbeef6dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:03.378661 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35dae90-7c66-42da-80bc-08bedbeef6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:03.379773 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35dae90-7c66-42da-80bc-08bedbeef6dd admin admin] PATH_INFO: `/v3/users/6f6dd3cd2ab842939750fc51c8ca0d08` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:03.389647 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35dae90-7c66-42da-80bc-08bedbeef6dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f6dd3cd2ab842939750fc51c8ca0d08)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:03.393498 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35dae90-7c66-42da-80bc-08bedbeef6dd admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:03.521429 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-a35dae90-7c66-42da-80bc-08bedbeef6dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f6dd3cd2ab842939750fc51c8ca0d08'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:03.537527 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-a35dae90-7c66-42da-80bc-08bedbeef6dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f6dd3cd2ab842939750fc51c8ca0d08'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:03.555287 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-a35dae90-7c66-42da-80bc-08bedbeef6dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f6dd3cd2ab842939750fc51c8ca0d08'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:03.577243 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-a35dae90-7c66-42da-80bc-08bedbeef6dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f6dd3cd2ab842939750fc51c8ca0d08'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:03.577988 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-a35dae90-7c66-42da-80bc-08bedbeef6dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f6dd3cd2ab842939750fc51c8ca0d08'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:03.589484 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1282/2579] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:35:03 2022] DELETE /identity/v3/users/6f6dd3cd2ab842939750fc51c8ca0d08 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 05:35:03.944769 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a460e8e1-4e55-40b9-8a6b-98107731dcbc admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:03.946346 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-a460e8e1-4e55-40b9-8a6b-98107731dcbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:35:03.959589 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a460e8e1-4e55-40b9-8a6b-98107731dcbc admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:04.016084 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a78a64-5c02-451a-968d-582adc69bed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:04.016715 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a78a64-5c02-451a-968d-582adc69bed8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:04.016994 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a78a64-5c02-451a-968d-582adc69bed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:04.017288 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a78a64-5c02-451a-968d-582adc69bed8 admin admin] PATH_INFO: `/v3/projects/7429d66f288547889af44f65239a6fc9` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:04.018389 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a78a64-5c02-451a-968d-582adc69bed8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7429d66f288547889af44f65239a6fc9)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:04.020859 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a78a64-5c02-451a-968d-582adc69bed8 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:04.064849 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:35:04.070536 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-f0a78a64-5c02-451a-968d-582adc69bed8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7429d66f288547889af44f65239a6fc9', 'request_id': 'req-f0a78a64-5c02-451a-968d-582adc69bed8'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:04.093362 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-f0a78a64-5c02-451a-968d-582adc69bed8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7429d66f288547889af44f65239a6fc9', 'request_id': 'req-f0a78a64-5c02-451a-968d-582adc69bed8'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:04.104135 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-f0a78a64-5c02-451a-968d-582adc69bed8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7429d66f288547889af44f65239a6fc9', 'request_id': 'req-f0a78a64-5c02-451a-968d-582adc69bed8'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:04.131290 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-f0a78a64-5c02-451a-968d-582adc69bed8 admin admin] The token cache is being invalidate because project 7429d66f288547889af44f65239a6fc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:35:04.131619 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-f0a78a64-5c02-451a-968d-582adc69bed8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:04.132282 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-f0a78a64-5c02-451a-968d-582adc69bed8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:04.133847 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1298/2580] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:35:03 2022] DELETE /identity/v3/projects/7429d66f288547889af44f65239a6fc9 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:35:04.138737 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c01c805-442f-4ed0-b93e-9c763c926762 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:04.139046 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c01c805-442f-4ed0-b93e-9c763c926762 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:04.139393 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c01c805-442f-4ed0-b93e-9c763c926762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:04.165012 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-4c01c805-442f-4ed0-b93e-9c763c926762 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:35:04.166984 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-4c01c805-442f-4ed0-b93e-9c763c926762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:35:04.241902 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1283/2581] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:35:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:35:04.249511 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16f0bca-693e-40f8-aa55-69df5b0810d4 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:04.249950 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16f0bca-693e-40f8-aa55-69df5b0810d4 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:04.250323 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16f0bca-693e-40f8-aa55-69df5b0810d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:04.272525 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-b16f0bca-693e-40f8-aa55-69df5b0810d4 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:35:04.274053 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-b16f0bca-693e-40f8-aa55-69df5b0810d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:35:04.284409 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1299/2582] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:35:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 05:35:04.289740 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c01c805-442f-4ed0-b93e-9c763c926762 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:04.301150 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c01c805-442f-4ed0-b93e-9c763c926762 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:04.305973 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751a2b7a-1f0b-469a-9d60-50fdd89617f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:04.306595 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a2b7a-1f0b-469a-9d60-50fdd89617f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:04.306871 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a2b7a-1f0b-469a-9d60-50fdd89617f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:04.307142 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a2b7a-1f0b-469a-9d60-50fdd89617f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:04.307845 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751a2b7a-1f0b-469a-9d60-50fdd89617f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:35:04.308152 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751a2b7a-1f0b-469a-9d60-50fdd89617f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:04.309762 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751a2b7a-1f0b-469a-9d60-50fdd89617f0 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:04.322454 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1284/2583] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 05:35:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:35:04.326728 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16f0bca-693e-40f8-aa55-69df5b0810d4 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:04.337457 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16f0bca-693e-40f8-aa55-69df5b0810d4 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:04.342216 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc171df-96ce-4ca9-a530-5f04971db979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:04.342919 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc171df-96ce-4ca9-a530-5f04971db979 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:04.343185 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc171df-96ce-4ca9-a530-5f04971db979 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:04.343463 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc171df-96ce-4ca9-a530-5f04971db979 admin admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:04.344159 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc171df-96ce-4ca9-a530-5f04971db979 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:04.346085 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc171df-96ce-4ca9-a530-5f04971db979 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:04.398420 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1300/2584] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:35:04 2022] POST /identity/v3/projects => generated 387 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:35:04.399524 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751a2b7a-1f0b-469a-9d60-50fdd89617f0 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:04.412908 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751a2b7a-1f0b-469a-9d60-50fdd89617f0 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:04.425091 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:35:04.485898 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d618158a-dc96-4fef-a9a2-1a2c3b8d2b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:04.486703 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d618158a-dc96-4fef-a9a2-1a2c3b8d2b68 admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:04.487127 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d618158a-dc96-4fef-a9a2-1a2c3b8d2b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:04.487503 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d618158a-dc96-4fef-a9a2-1a2c3b8d2b68 admin admin] PATH_INFO: `/v3/users` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:04.488333 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d618158a-dc96-4fef-a9a2-1a2c3b8d2b68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:04.490382 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d618158a-dc96-4fef-a9a2-1a2c3b8d2b68 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:04.512952 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1285/2585] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:35:04 2022] POST /identity/v3/users => generated 294 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:35:04.517189 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc171df-96ce-4ca9-a530-5f04971db979 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:04.531397 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc171df-96ce-4ca9-a530-5f04971db979 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:04.537642 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b2e22d-e6b6-4882-89fe-bd79118d0a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:04.538341 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b2e22d-e6b6-4882-89fe-bd79118d0a12 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:04.538689 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b2e22d-e6b6-4882-89fe-bd79118d0a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:04.538962 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b2e22d-e6b6-4882-89fe-bd79118d0a12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:04.539710 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b2e22d-e6b6-4882-89fe-bd79118d0a12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:04.541576 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b2e22d-e6b6-4882-89fe-bd79118d0a12 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:04.555057 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1301/2586] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:35:04 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:35:04.558751 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d618158a-dc96-4fef-a9a2-1a2c3b8d2b68 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:04.572164 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d618158a-dc96-4fef-a9a2-1a2c3b8d2b68 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:04.584661 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e3e2d9-27ed-4fba-9ccc-3ca30b4605bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:04.585776 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e3e2d9-27ed-4fba-9ccc-3ca30b4605bc admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:04.586282 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e3e2d9-27ed-4fba-9ccc-3ca30b4605bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:04.586770 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e3e2d9-27ed-4fba-9ccc-3ca30b4605bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:04.587889 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e3e2d9-27ed-4fba-9ccc-3ca30b4605bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:04.589852 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e3e2d9-27ed-4fba-9ccc-3ca30b4605bc admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:04.602275 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1286/2587] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:35:04 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:35:04.606295 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b2e22d-e6b6-4882-89fe-bd79118d0a12 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:04.616855 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b2e22d-e6b6-4882-89fe-bd79118d0a12 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:04.630120 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdce282-968d-4b7a-9a20-f9912dcfed2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:04.630785 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdce282-968d-4b7a-9a20-f9912dcfed2a admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:04.631088 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdce282-968d-4b7a-9a20-f9912dcfed2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:04.631359 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdce282-968d-4b7a-9a20-f9912dcfed2a admin admin] PATH_INFO: `/v3/projects/6f7a3099a1774f9cba1d749fd700b275/users/ccb88f0472ad45db864c275ccc59b46b/roles/aa7ff8e0ec1e48e5811335b9eb38b448` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:04.648427 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdce282-968d-4b7a-9a20-f9912dcfed2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f7a3099a1774f9cba1d749fd700b275, user_id=ccb88f0472ad45db864c275ccc59b46b, role_id=aa7ff8e0ec1e48e5811335b9eb38b448)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:04.651347 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdce282-968d-4b7a-9a20-f9912dcfed2a admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:04.666063 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1302/2588] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:35:04 2022] PUT /identity/v3/projects/6f7a3099a1774f9cba1d749fd700b275/users/ccb88f0472ad45db864c275ccc59b46b/roles/aa7ff8e0ec1e48e5811335b9eb38b448 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 05:35:04.677517 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ede66-3d70-4e44-837b-e935b1e85a1a None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:04.677887 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ede66-3d70-4e44-837b-e935b1e85a1a None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:04.678168 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ede66-3d70-4e44-837b-e935b1e85a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:04.733983 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-764ede66-3d70-4e44-837b-e935b1e85a1a None None] MFA Rules not processed for user `ccb88f0472ad45db864c275ccc59b46b`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:35:04.735790 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-764ede66-3d70-4e44-837b-e935b1e85a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:35:04.813944 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1287/2589] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:35:04 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 05:35:04.821461 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdce282-968d-4b7a-9a20-f9912dcfed2a admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:04.922370 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdce282-968d-4b7a-9a20-f9912dcfed2a admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:04.932665 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042e207b-ed31-4b11-873a-f864d477c391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:04.933309 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e207b-ed31-4b11-873a-f864d477c391 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:04.933590 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e207b-ed31-4b11-873a-f864d477c391 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:04.933861 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e207b-ed31-4b11-873a-f864d477c391 admin admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:04.934526 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042e207b-ed31-4b11-873a-f864d477c391 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:04.945107 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042e207b-ed31-4b11-873a-f864d477c391 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:04.987704 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1303/2590] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:35:04 2022] POST /identity/v3/projects => generated 387 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:35:04.988575 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ede66-3d70-4e44-837b-e935b1e85a1a None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:05.001756 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ede66-3d70-4e44-837b-e935b1e85a1a None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:05.229596 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69baf621-edb5-4615-bd27-b0b66afa5502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:05.230218 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69baf621-edb5-4615-bd27-b0b66afa5502 admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:05.230630 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69baf621-edb5-4615-bd27-b0b66afa5502 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:05.230930 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69baf621-edb5-4615-bd27-b0b66afa5502 admin admin] PATH_INFO: `/v3/users` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:05.231560 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69baf621-edb5-4615-bd27-b0b66afa5502 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:05.233462 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69baf621-edb5-4615-bd27-b0b66afa5502 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:05.263668 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042e207b-ed31-4b11-873a-f864d477c391 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:05.275956 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042e207b-ed31-4b11-873a-f864d477c391 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:05.276761 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1288/2591] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:35:04 2022] POST /identity/v3/users => generated 300 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:35:05.285832 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c5cdce-6a38-4f45-bbd2-0af238a03028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:05.286748 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c5cdce-6a38-4f45-bbd2-0af238a03028 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:05.287129 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c5cdce-6a38-4f45-bbd2-0af238a03028 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:05.287650 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c5cdce-6a38-4f45-bbd2-0af238a03028 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:05.288494 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c5cdce-6a38-4f45-bbd2-0af238a03028 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:05.292405 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c5cdce-6a38-4f45-bbd2-0af238a03028 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:05.316975 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1304/2592] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:35:05 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:35:05.320360 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69baf621-edb5-4615-bd27-b0b66afa5502 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:05.350010 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69baf621-edb5-4615-bd27-b0b66afa5502 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:05.354874 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a44ab94-2ee0-4130-8209-300085322d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:05.355767 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a44ab94-2ee0-4130-8209-300085322d3f admin admin] REQUEST_METHOD: `PUT` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:05.356053 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a44ab94-2ee0-4130-8209-300085322d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:05.356325 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a44ab94-2ee0-4130-8209-300085322d3f admin admin] PATH_INFO: `/v3/projects/a9d0fae1f80543c994adf81408f654f5/users/534c5b428ee748dd88c29781f91cfb56/roles/5b702713e40145b49e0b42abd0a5fba9` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:05.383345 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:35:05.409227 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a44ab94-2ee0-4130-8209-300085322d3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9d0fae1f80543c994adf81408f654f5, user_id=534c5b428ee748dd88c29781f91cfb56, role_id=5b702713e40145b49e0b42abd0a5fba9)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:05.412971 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a44ab94-2ee0-4130-8209-300085322d3f admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:05.442177 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1289/2593] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:35:05 2022] PUT /identity/v3/projects/a9d0fae1f80543c994adf81408f654f5/users/534c5b428ee748dd88c29781f91cfb56/roles/5b702713e40145b49e0b42abd0a5fba9 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 05:35:05.445476 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c5cdce-6a38-4f45-bbd2-0af238a03028 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:05.455977 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c5cdce-6a38-4f45-bbd2-0af238a03028 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:05.514272 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:35:05.533569 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c23a6cf-08b7-4206-b409-b39b789f5481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:05.534595 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c23a6cf-08b7-4206-b409-b39b789f5481 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:05.535650 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c23a6cf-08b7-4206-b409-b39b789f5481 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:05.535900 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c23a6cf-08b7-4206-b409-b39b789f5481 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:05.536817 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c23a6cf-08b7-4206-b409-b39b789f5481 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:05.538582 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c23a6cf-08b7-4206-b409-b39b789f5481 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:05.554133 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1305/2594] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:35:05 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:35:05.558652 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a44ab94-2ee0-4130-8209-300085322d3f admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:05.572672 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a44ab94-2ee0-4130-8209-300085322d3f admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:05.578659 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4264f1-04e2-4238-8a38-a096cc359fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:05.579723 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4264f1-04e2-4238-8a38-a096cc359fec admin admin] REQUEST_METHOD: `PUT` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:05.580150 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4264f1-04e2-4238-8a38-a096cc359fec admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:05.580661 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4264f1-04e2-4238-8a38-a096cc359fec admin admin] PATH_INFO: `/v3/projects/a9d0fae1f80543c994adf81408f654f5/users/534c5b428ee748dd88c29781f91cfb56/roles/5b702713e40145b49e0b42abd0a5fba9` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:05.583759 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4264f1-04e2-4238-8a38-a096cc359fec admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9d0fae1f80543c994adf81408f654f5, user_id=534c5b428ee748dd88c29781f91cfb56, role_id=5b702713e40145b49e0b42abd0a5fba9)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:05.589093 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4264f1-04e2-4238-8a38-a096cc359fec admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:05.603009 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1290/2595] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:35:05 2022] PUT /identity/v3/projects/a9d0fae1f80543c994adf81408f654f5/users/534c5b428ee748dd88c29781f91cfb56/roles/5b702713e40145b49e0b42abd0a5fba9 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:35:05.614198 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841371e6-dc5a-46fa-901b-146aa675863f None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:05.614480 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841371e6-dc5a-46fa-901b-146aa675863f None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:05.614758 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841371e6-dc5a-46fa-901b-146aa675863f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:05.647202 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-841371e6-dc5a-46fa-901b-146aa675863f None None] MFA Rules not processed for user `534c5b428ee748dd88c29781f91cfb56`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:35:05.648496 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-841371e6-dc5a-46fa-901b-146aa675863f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:35:05.742704 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1306/2596] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:35:05 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:35:05.755651 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4264f1-04e2-4238-8a38-a096cc359fec admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:05.757432 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-0e4264f1-04e2-4238-8a38-a096cc359fec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:35:05.857023 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4264f1-04e2-4238-8a38-a096cc359fec admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:05.861343 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187fed51-5c4f-4d0a-81ac-d8a309c6a655 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a147e14b61d481db1cac02c58ac3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:05.861964 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187fed51-5c4f-4d0a-81ac-d8a309c6a655 service cinder] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:05.862245 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187fed51-5c4f-4d0a-81ac-d8a309c6a655 service cinder] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:05.862576 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187fed51-5c4f-4d0a-81ac-d8a309c6a655 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:05.888863 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187fed51-5c4f-4d0a-81ac-d8a309c6a655 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:05.890672 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187fed51-5c4f-4d0a-81ac-d8a309c6a655 service cinder] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:05.909246 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1291/2597] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:35:05 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:35:05.953855 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841371e6-dc5a-46fa-901b-146aa675863f None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:06.028766 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841371e6-dc5a-46fa-901b-146aa675863f None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:06.033734 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd75cfa5-157c-48b8-a941-7ea5d076ce16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:06.034368 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd75cfa5-157c-48b8-a941-7ea5d076ce16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:06.034642 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd75cfa5-157c-48b8-a941-7ea5d076ce16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:06.034949 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd75cfa5-157c-48b8-a941-7ea5d076ce16 admin admin] PATH_INFO: `/v3/users/ccb88f0472ad45db864c275ccc59b46b` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:06.036838 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd75cfa5-157c-48b8-a941-7ea5d076ce16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccb88f0472ad45db864c275ccc59b46b)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:06.038868 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd75cfa5-157c-48b8-a941-7ea5d076ce16 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:06.118805 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-dd75cfa5-157c-48b8-a941-7ea5d076ce16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccb88f0472ad45db864c275ccc59b46b'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:06.135186 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-dd75cfa5-157c-48b8-a941-7ea5d076ce16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccb88f0472ad45db864c275ccc59b46b'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:06.136612 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:35:06.147035 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-dd75cfa5-157c-48b8-a941-7ea5d076ce16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccb88f0472ad45db864c275ccc59b46b'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:06.158747 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-dd75cfa5-157c-48b8-a941-7ea5d076ce16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccb88f0472ad45db864c275ccc59b46b'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:06.160321 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-dd75cfa5-157c-48b8-a941-7ea5d076ce16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccb88f0472ad45db864c275ccc59b46b'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:06.178404 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1307/2598] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:35:05 2022] DELETE /identity/v3/users/ccb88f0472ad45db864c275ccc59b46b => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:35:06.180307 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c405c70-73ef-4cb6-94d7-8561f4c219c0 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:06.180695 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c405c70-73ef-4cb6-94d7-8561f4c219c0 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:06.181113 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c405c70-73ef-4cb6-94d7-8561f4c219c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:06.226778 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-3c405c70-73ef-4cb6-94d7-8561f4c219c0 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:35:06.228463 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-3c405c70-73ef-4cb6-94d7-8561f4c219c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:35:06.332746 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1292/2599] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:35:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:35:06.353813 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd75cfa5-157c-48b8-a941-7ea5d076ce16 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:06.355322 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-dd75cfa5-157c-48b8-a941-7ea5d076ce16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:35:06.427191 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd75cfa5-157c-48b8-a941-7ea5d076ce16 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:06.433017 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae335ab-4fb8-46d2-9a94-a8b339c1a486 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:06.433642 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae335ab-4fb8-46d2-9a94-a8b339c1a486 service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:06.434063 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae335ab-4fb8-46d2-9a94-a8b339c1a486 service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:06.434480 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae335ab-4fb8-46d2-9a94-a8b339c1a486 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:06.444297 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae335ab-4fb8-46d2-9a94-a8b339c1a486 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:06.445762 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae335ab-4fb8-46d2-9a94-a8b339c1a486 service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:06.455249 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1308/2600] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:35:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:35:06.880504 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c405c70-73ef-4cb6-94d7-8561f4c219c0 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:06.882090 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-3c405c70-73ef-4cb6-94d7-8561f4c219c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:35:06.902659 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c405c70-73ef-4cb6-94d7-8561f4c219c0 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:06.920831 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc560ae-8001-462c-b48e-859d3de58321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:06.921652 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc560ae-8001-462c-b48e-859d3de58321 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:06.921995 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc560ae-8001-462c-b48e-859d3de58321 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:06.922344 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc560ae-8001-462c-b48e-859d3de58321 admin admin] PATH_INFO: `/v3/projects/6f7a3099a1774f9cba1d749fd700b275` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:06.923885 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc560ae-8001-462c-b48e-859d3de58321 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f7a3099a1774f9cba1d749fd700b275)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:06.930651 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc560ae-8001-462c-b48e-859d3de58321 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:07.014248 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-bdc560ae-8001-462c-b48e-859d3de58321 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f7a3099a1774f9cba1d749fd700b275', 'request_id': 'req-bdc560ae-8001-462c-b48e-859d3de58321'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:07.024928 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-bdc560ae-8001-462c-b48e-859d3de58321 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f7a3099a1774f9cba1d749fd700b275', 'request_id': 'req-bdc560ae-8001-462c-b48e-859d3de58321'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:07.032375 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-bdc560ae-8001-462c-b48e-859d3de58321 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f7a3099a1774f9cba1d749fd700b275', 'request_id': 'req-bdc560ae-8001-462c-b48e-859d3de58321'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:07.041123 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:35:07.045155 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-bdc560ae-8001-462c-b48e-859d3de58321 admin admin] The token cache is being invalidate because project 6f7a3099a1774f9cba1d749fd700b275 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81383) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:35:07.045610 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-bdc560ae-8001-462c-b48e-859d3de58321 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:07.046687 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-bdc560ae-8001-462c-b48e-859d3de58321 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:07.048556 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1293/2601] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:35:06 2022] DELETE /identity/v3/projects/6f7a3099a1774f9cba1d749fd700b275 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:35:07.053218 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae335ab-4fb8-46d2-9a94-a8b339c1a486 service neutron] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:07.063078 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae335ab-4fb8-46d2-9a94-a8b339c1a486 service neutron] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:07.120243 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636c02c4-b1ca-4a6a-af14-1577b55dff64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:07.120882 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c02c4-b1ca-4a6a-af14-1577b55dff64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:07.121163 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c02c4-b1ca-4a6a-af14-1577b55dff64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:07.121436 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c02c4-b1ca-4a6a-af14-1577b55dff64 admin admin] PATH_INFO: `/v3/users/534c5b428ee748dd88c29781f91cfb56` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:07.122583 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636c02c4-b1ca-4a6a-af14-1577b55dff64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=534c5b428ee748dd88c29781f91cfb56)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:07.124729 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636c02c4-b1ca-4a6a-af14-1577b55dff64 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:07.183632 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-636c02c4-b1ca-4a6a-af14-1577b55dff64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '534c5b428ee748dd88c29781f91cfb56'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:07.216615 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-636c02c4-b1ca-4a6a-af14-1577b55dff64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '534c5b428ee748dd88c29781f91cfb56'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:07.232836 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-636c02c4-b1ca-4a6a-af14-1577b55dff64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '534c5b428ee748dd88c29781f91cfb56'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:07.270563 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-636c02c4-b1ca-4a6a-af14-1577b55dff64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '534c5b428ee748dd88c29781f91cfb56'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:07.283826 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-636c02c4-b1ca-4a6a-af14-1577b55dff64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '534c5b428ee748dd88c29781f91cfb56'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:07.302712 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1309/2602] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:35:07 2022] DELETE /identity/v3/users/534c5b428ee748dd88c29781f91cfb56 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:35:07.778168 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc560ae-8001-462c-b48e-859d3de58321 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:07.779628 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-bdc560ae-8001-462c-b48e-859d3de58321 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:35:07.807529 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc560ae-8001-462c-b48e-859d3de58321 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:07.870393 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708a1de2-dcd4-4139-aeda-e0dc4cf243e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:07.871052 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a1de2-dcd4-4139-aeda-e0dc4cf243e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:07.871329 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a1de2-dcd4-4139-aeda-e0dc4cf243e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:07.871624 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a1de2-dcd4-4139-aeda-e0dc4cf243e7 admin admin] PATH_INFO: `/v3/projects/a9d0fae1f80543c994adf81408f654f5` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:07.872811 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708a1de2-dcd4-4139-aeda-e0dc4cf243e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9d0fae1f80543c994adf81408f654f5)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:07.874809 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708a1de2-dcd4-4139-aeda-e0dc4cf243e7 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:07.939908 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-708a1de2-dcd4-4139-aeda-e0dc4cf243e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9d0fae1f80543c994adf81408f654f5', 'request_id': 'req-708a1de2-dcd4-4139-aeda-e0dc4cf243e7'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:07.950836 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-708a1de2-dcd4-4139-aeda-e0dc4cf243e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9d0fae1f80543c994adf81408f654f5', 'request_id': 'req-708a1de2-dcd4-4139-aeda-e0dc4cf243e7'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:07.961083 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-708a1de2-dcd4-4139-aeda-e0dc4cf243e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9d0fae1f80543c994adf81408f654f5', 'request_id': 'req-708a1de2-dcd4-4139-aeda-e0dc4cf243e7'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:07.977535 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-708a1de2-dcd4-4139-aeda-e0dc4cf243e7 admin admin] The token cache is being invalidate because project a9d0fae1f80543c994adf81408f654f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81383) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:35:07.977875 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-708a1de2-dcd4-4139-aeda-e0dc4cf243e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:07.978482 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-708a1de2-dcd4-4139-aeda-e0dc4cf243e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:07.980142 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1294/2603] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:35:07 2022] DELETE /identity/v3/projects/a9d0fae1f80543c994adf81408f654f5 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:35:07.985150 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a3812a-3acf-4966-8828-e5e414426db3 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:07.985952 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a3812a-3acf-4966-8828-e5e414426db3 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:07.986244 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a3812a-3acf-4966-8828-e5e414426db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:07.995311 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:35:08.009964 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-34a3812a-3acf-4966-8828-e5e414426db3 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:35:08.011226 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-34a3812a-3acf-4966-8828-e5e414426db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:35:08.072713 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1310/2604] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:35:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:35:08.080458 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73877526-e685-482a-9bd2-8e13454b4c4f None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:08.080737 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73877526-e685-482a-9bd2-8e13454b4c4f None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:08.081006 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73877526-e685-482a-9bd2-8e13454b4c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:08.101292 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-73877526-e685-482a-9bd2-8e13454b4c4f None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:35:08.102501 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-73877526-e685-482a-9bd2-8e13454b4c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:35:08.110937 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1295/2605] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:35:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:35:08.117510 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a3812a-3acf-4966-8828-e5e414426db3 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:08.131569 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a3812a-3acf-4966-8828-e5e414426db3 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:08.139161 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed951f6-7de8-4274-a36e-d7b9b41fa2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:08.140207 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed951f6-7de8-4274-a36e-d7b9b41fa2f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:08.140648 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed951f6-7de8-4274-a36e-d7b9b41fa2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:08.141107 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed951f6-7de8-4274-a36e-d7b9b41fa2f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:08.141932 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed951f6-7de8-4274-a36e-d7b9b41fa2f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:35:08.142587 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed951f6-7de8-4274-a36e-d7b9b41fa2f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:08.145882 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed951f6-7de8-4274-a36e-d7b9b41fa2f1 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:08.163104 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1311/2606] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 05:35:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:35:08.167016 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73877526-e685-482a-9bd2-8e13454b4c4f None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:08.176885 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73877526-e685-482a-9bd2-8e13454b4c4f None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:08.181591 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd20755-1648-4bbb-b701-210a9bfd6668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:08.182200 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd20755-1648-4bbb-b701-210a9bfd6668 admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:08.182480 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd20755-1648-4bbb-b701-210a9bfd6668 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:08.182754 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd20755-1648-4bbb-b701-210a9bfd6668 admin admin] PATH_INFO: `/v3/projects` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:08.183387 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd20755-1648-4bbb-b701-210a9bfd6668 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:08.185452 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd20755-1648-4bbb-b701-210a9bfd6668 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:08.215360 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1296/2607] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:35:08 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 05:35:08.219591 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed951f6-7de8-4274-a36e-d7b9b41fa2f1 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:08.229520 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed951f6-7de8-4274-a36e-d7b9b41fa2f1 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:08.287254 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0edb60-4ab5-4459-989e-ab1c92f86af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:08.287880 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0edb60-4ab5-4459-989e-ab1c92f86af4 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:08.288156 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0edb60-4ab5-4459-989e-ab1c92f86af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:08.288422 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0edb60-4ab5-4459-989e-ab1c92f86af4 admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:08.289049 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0edb60-4ab5-4459-989e-ab1c92f86af4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:08.290958 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0edb60-4ab5-4459-989e-ab1c92f86af4 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:08.312057 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1312/2608] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:35:08 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:35:08.316583 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd20755-1648-4bbb-b701-210a9bfd6668 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:08.333846 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd20755-1648-4bbb-b701-210a9bfd6668 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:08.340084 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c5f2a0-0f01-4be6-a5d2-e0c1b3cf8c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:08.340707 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5f2a0-0f01-4be6-a5d2-e0c1b3cf8c37 admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:08.340977 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5f2a0-0f01-4be6-a5d2-e0c1b3cf8c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:08.341247 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5f2a0-0f01-4be6-a5d2-e0c1b3cf8c37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:08.341912 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c5f2a0-0f01-4be6-a5d2-e0c1b3cf8c37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:08.343497 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c5f2a0-0f01-4be6-a5d2-e0c1b3cf8c37 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:08.355419 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1297/2609] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:35:08 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 05:35:08.359140 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0edb60-4ab5-4459-989e-ab1c92f86af4 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:08.369963 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0edb60-4ab5-4459-989e-ab1c92f86af4 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:08.374967 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b991116f-898f-4e70-9e3f-f35b8c0cd99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:08.375830 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b991116f-898f-4e70-9e3f-f35b8c0cd99e admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:08.376315 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b991116f-898f-4e70-9e3f-f35b8c0cd99e admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:08.376658 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b991116f-898f-4e70-9e3f-f35b8c0cd99e admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:08.377388 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b991116f-898f-4e70-9e3f-f35b8c0cd99e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:08.379814 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b991116f-898f-4e70-9e3f-f35b8c0cd99e admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:08.391015 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1313/2610] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:35:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 05:35:08.395763 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c5f2a0-0f01-4be6-a5d2-e0c1b3cf8c37 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:08.418134 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c5f2a0-0f01-4be6-a5d2-e0c1b3cf8c37 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:08.423093 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0ff269-59fc-4786-98ea-b11c08a1ecdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:08.423786 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ff269-59fc-4786-98ea-b11c08a1ecdd admin admin] REQUEST_METHOD: `PUT` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:08.424241 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ff269-59fc-4786-98ea-b11c08a1ecdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:08.424754 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ff269-59fc-4786-98ea-b11c08a1ecdd admin admin] PATH_INFO: `/v3/projects/f1342d58633f45c5ac0f9a032bf72f6c/users/dc3e6da6eb8b46ba88113e398df23039/roles/aa7ff8e0ec1e48e5811335b9eb38b448` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:08.441784 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0ff269-59fc-4786-98ea-b11c08a1ecdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1342d58633f45c5ac0f9a032bf72f6c, user_id=dc3e6da6eb8b46ba88113e398df23039, role_id=aa7ff8e0ec1e48e5811335b9eb38b448)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:08.444486 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0ff269-59fc-4786-98ea-b11c08a1ecdd admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:08.459206 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1298/2611] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:35:08 2022] PUT /identity/v3/projects/f1342d58633f45c5ac0f9a032bf72f6c/users/dc3e6da6eb8b46ba88113e398df23039/roles/aa7ff8e0ec1e48e5811335b9eb38b448 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:35:08.470464 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b544a-dd42-4abd-a2bb-adfc073a5688 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:08.470675 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b544a-dd42-4abd-a2bb-adfc073a5688 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:08.470936 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b544a-dd42-4abd-a2bb-adfc073a5688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:08.499195 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-4b8b544a-dd42-4abd-a2bb-adfc073a5688 None None] MFA Rules not processed for user `dc3e6da6eb8b46ba88113e398df23039`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:35:08.500547 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-4b8b544a-dd42-4abd-a2bb-adfc073a5688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:35:08.572492 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:35:08.580078 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1314/2612] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:35:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:35:08.583852 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0ff269-59fc-4786-98ea-b11c08a1ecdd admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:08.617237 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:35:08.656597 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0ff269-59fc-4786-98ea-b11c08a1ecdd admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:08.661257 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934bcb2d-a795-4a2a-9d85-2574beb15a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:08.661859 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934bcb2d-a795-4a2a-9d85-2574beb15a6b admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:08.662131 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934bcb2d-a795-4a2a-9d85-2574beb15a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:08.662397 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934bcb2d-a795-4a2a-9d85-2574beb15a6b admin admin] PATH_INFO: `/v3/projects` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:08.663164 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934bcb2d-a795-4a2a-9d85-2574beb15a6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:08.665089 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934bcb2d-a795-4a2a-9d85-2574beb15a6b admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:08.692584 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1299/2613] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:35:08 2022] POST /identity/v3/projects => generated 377 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 05:35:08.696703 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8b544a-dd42-4abd-a2bb-adfc073a5688 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:08.712196 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8b544a-dd42-4abd-a2bb-adfc073a5688 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:08.822442 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0221566-edbf-4cf3-9948-081b47a7e6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:08.823061 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0221566-edbf-4cf3-9948-081b47a7e6de admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:08.823339 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0221566-edbf-4cf3-9948-081b47a7e6de admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:08.823607 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0221566-edbf-4cf3-9948-081b47a7e6de admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:08.824264 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0221566-edbf-4cf3-9948-081b47a7e6de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:08.826398 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0221566-edbf-4cf3-9948-081b47a7e6de admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:08.855405 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1315/2614] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:35:08 2022] POST /identity/v3/users => generated 295 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:35:08.857448 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934bcb2d-a795-4a2a-9d85-2574beb15a6b admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:08.873460 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934bcb2d-a795-4a2a-9d85-2574beb15a6b admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:08.879202 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f030ce9b-cebe-4aff-afd6-a6deb81fd045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:08.880022 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030ce9b-cebe-4aff-afd6-a6deb81fd045 admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:08.880301 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030ce9b-cebe-4aff-afd6-a6deb81fd045 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:08.880575 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030ce9b-cebe-4aff-afd6-a6deb81fd045 admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:08.881225 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f030ce9b-cebe-4aff-afd6-a6deb81fd045 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:08.883188 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f030ce9b-cebe-4aff-afd6-a6deb81fd045 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:08.895062 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1300/2615] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:35:08 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:35:08.899455 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0221566-edbf-4cf3-9948-081b47a7e6de admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:08.919121 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0221566-edbf-4cf3-9948-081b47a7e6de admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:08.924393 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e528baa-3845-489c-8c41-8a6bdd83cae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:08.927261 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e528baa-3845-489c-8c41-8a6bdd83cae8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:08.927566 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e528baa-3845-489c-8c41-8a6bdd83cae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:08.927874 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e528baa-3845-489c-8c41-8a6bdd83cae8 admin admin] PATH_INFO: `/v3/projects/fbb5fc1d18bc4eb89c2bf61e4ae3c2c4/users/5487e886915c4e1b8a0179e3c98ff8ff/roles/5b702713e40145b49e0b42abd0a5fba9` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:08.946946 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e528baa-3845-489c-8c41-8a6bdd83cae8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbb5fc1d18bc4eb89c2bf61e4ae3c2c4, user_id=5487e886915c4e1b8a0179e3c98ff8ff, role_id=5b702713e40145b49e0b42abd0a5fba9)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:08.949943 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e528baa-3845-489c-8c41-8a6bdd83cae8 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:08.964617 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1316/2616] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:35:08 2022] PUT /identity/v3/projects/fbb5fc1d18bc4eb89c2bf61e4ae3c2c4/users/5487e886915c4e1b8a0179e3c98ff8ff/roles/5b702713e40145b49e0b42abd0a5fba9 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:35:08.968793 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f030ce9b-cebe-4aff-afd6-a6deb81fd045 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:08.981011 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f030ce9b-cebe-4aff-afd6-a6deb81fd045 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:09.040836 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451ff466-d574-4279-b81f-1dd830e02efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:09.041475 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ff466-d574-4279-b81f-1dd830e02efb admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:09.041756 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ff466-d574-4279-b81f-1dd830e02efb admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:09.042029 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ff466-d574-4279-b81f-1dd830e02efb admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:09.042665 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451ff466-d574-4279-b81f-1dd830e02efb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:09.044293 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451ff466-d574-4279-b81f-1dd830e02efb admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:09.054718 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1301/2617] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:35:08 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 05:35:09.059072 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e528baa-3845-489c-8c41-8a6bdd83cae8 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:09.070354 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e528baa-3845-489c-8c41-8a6bdd83cae8 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:09.076025 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb912776-463e-44d4-9e2b-893d4c25f317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:09.076716 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb912776-463e-44d4-9e2b-893d4c25f317 admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:09.076998 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb912776-463e-44d4-9e2b-893d4c25f317 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:09.077268 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb912776-463e-44d4-9e2b-893d4c25f317 admin admin] PATH_INFO: `/v3/projects/fbb5fc1d18bc4eb89c2bf61e4ae3c2c4/users/5487e886915c4e1b8a0179e3c98ff8ff/roles/5b702713e40145b49e0b42abd0a5fba9` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:09.079500 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb912776-463e-44d4-9e2b-893d4c25f317 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbb5fc1d18bc4eb89c2bf61e4ae3c2c4, user_id=5487e886915c4e1b8a0179e3c98ff8ff, role_id=5b702713e40145b49e0b42abd0a5fba9)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:09.082597 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb912776-463e-44d4-9e2b-893d4c25f317 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:09.095456 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1317/2618] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:35:09 2022] PUT /identity/v3/projects/fbb5fc1d18bc4eb89c2bf61e4ae3c2c4/users/5487e886915c4e1b8a0179e3c98ff8ff/roles/5b702713e40145b49e0b42abd0a5fba9 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:35:09.106426 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8fbaf7-726b-48c0-b892-f03bdb96c56a None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:09.106715 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8fbaf7-726b-48c0-b892-f03bdb96c56a None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:09.106993 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8fbaf7-726b-48c0-b892-f03bdb96c56a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:09.135664 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-8f8fbaf7-726b-48c0-b892-f03bdb96c56a None None] MFA Rules not processed for user `5487e886915c4e1b8a0179e3c98ff8ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:35:09.136919 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-8f8fbaf7-726b-48c0-b892-f03bdb96c56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:35:09.202864 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1302/2619] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:35:09 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 05:35:09.214448 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb912776-463e-44d4-9e2b-893d4c25f317 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:09.216285 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-fb912776-463e-44d4-9e2b-893d4c25f317 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:35:09.283415 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb912776-463e-44d4-9e2b-893d4c25f317 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:09.287426 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe95f5d9-938d-4561-8c0b-917b9418fb74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a147e14b61d481db1cac02c58ac3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:09.288058 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe95f5d9-938d-4561-8c0b-917b9418fb74 service cinder] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:09.288337 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe95f5d9-938d-4561-8c0b-917b9418fb74 service cinder] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:09.288609 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe95f5d9-938d-4561-8c0b-917b9418fb74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:09.344817 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe95f5d9-938d-4561-8c0b-917b9418fb74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:09.346492 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe95f5d9-938d-4561-8c0b-917b9418fb74 service cinder] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:09.355397 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1318/2620] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:35:09 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:35:10.704618 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8fbaf7-726b-48c0-b892-f03bdb96c56a None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:10.715805 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-8f8fbaf7-726b-48c0-b892-f03bdb96c56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:35:10.724392 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe95f5d9-938d-4561-8c0b-917b9418fb74 service cinder] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:10.739241 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe95f5d9-938d-4561-8c0b-917b9418fb74 service cinder] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:10.744525 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c6ee38-47a8-4ce1-88a3-8f3b62d3fd56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a147e14b61d481db1cac02c58ac3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:10.745795 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6ee38-47a8-4ce1-88a3-8f3b62d3fd56 service cinder] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:10.746290 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6ee38-47a8-4ce1-88a3-8f3b62d3fd56 service cinder] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:10.746635 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6ee38-47a8-4ce1-88a3-8f3b62d3fd56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:10.754928 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:35:10.763159 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c6ee38-47a8-4ce1-88a3-8f3b62d3fd56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:10.765106 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:35:10.766492 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c6ee38-47a8-4ce1-88a3-8f3b62d3fd56 service cinder] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:10.805980 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1319/2621] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:35:10 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 05:35:10.827079 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8fbaf7-726b-48c0-b892-f03bdb96c56a None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:10.844088 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2200ac4-fb35-4fbe-ae74-6130794609cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:10.844088 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2200ac4-fb35-4fbe-ae74-6130794609cb service neutron] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:10.844088 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2200ac4-fb35-4fbe-ae74-6130794609cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:10.844088 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2200ac4-fb35-4fbe-ae74-6130794609cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:10.844465 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-a2200ac4-fb35-4fbe-ae74-6130794609cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:35:10.861539 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2200ac4-fb35-4fbe-ae74-6130794609cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:10.864691 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2200ac4-fb35-4fbe-ae74-6130794609cb service neutron] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:10.894910 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1303/2622] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:35:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:35:11.100372 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c6ee38-47a8-4ce1-88a3-8f3b62d3fd56 service cinder] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:11.102586 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-95c6ee38-47a8-4ce1-88a3-8f3b62d3fd56 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:35:11.189278 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c6ee38-47a8-4ce1-88a3-8f3b62d3fd56 service cinder] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:11.195731 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bca778-e418-4963-b0a1-91767ceefe68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:11.196667 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bca778-e418-4963-b0a1-91767ceefe68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:11.197111 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bca778-e418-4963-b0a1-91767ceefe68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:11.197583 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bca778-e418-4963-b0a1-91767ceefe68 admin admin] PATH_INFO: `/v3/users/699bd5f04e9646f2b89621c9e9283c9b` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:11.198967 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bca778-e418-4963-b0a1-91767ceefe68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=699bd5f04e9646f2b89621c9e9283c9b)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:11.201301 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bca778-e418-4963-b0a1-91767ceefe68 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:11.256678 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-06bca778-e418-4963-b0a1-91767ceefe68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '699bd5f04e9646f2b89621c9e9283c9b'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:11.278081 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-06bca778-e418-4963-b0a1-91767ceefe68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '699bd5f04e9646f2b89621c9e9283c9b'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:11.289875 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-06bca778-e418-4963-b0a1-91767ceefe68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '699bd5f04e9646f2b89621c9e9283c9b'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:11.302949 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-06bca778-e418-4963-b0a1-91767ceefe68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '699bd5f04e9646f2b89621c9e9283c9b'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:11.304523 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-06bca778-e418-4963-b0a1-91767ceefe68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '699bd5f04e9646f2b89621c9e9283c9b'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:11.314011 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1320/2623] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:35:11 2022] DELETE /identity/v3/users/699bd5f04e9646f2b89621c9e9283c9b => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:35:11.318614 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e896accb-568c-4647-a99e-c38b3e6786a9 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:11.319008 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e896accb-568c-4647-a99e-c38b3e6786a9 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:11.319389 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e896accb-568c-4647-a99e-c38b3e6786a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:11.340083 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-e896accb-568c-4647-a99e-c38b3e6786a9 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:35:11.341590 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-e896accb-568c-4647-a99e-c38b3e6786a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:35:11.425371 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1304/2624] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:35:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:35:11.436888 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bca778-e418-4963-b0a1-91767ceefe68 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:11.438517 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-06bca778-e418-4963-b0a1-91767ceefe68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:35:11.516259 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bca778-e418-4963-b0a1-91767ceefe68 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:11.522560 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eedfa28-4a79-4e4a-9b83-2c0df316f5ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:11.523177 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eedfa28-4a79-4e4a-9b83-2c0df316f5ef service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:11.523451 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eedfa28-4a79-4e4a-9b83-2c0df316f5ef service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:11.523773 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eedfa28-4a79-4e4a-9b83-2c0df316f5ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:11.539373 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eedfa28-4a79-4e4a-9b83-2c0df316f5ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:11.541937 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eedfa28-4a79-4e4a-9b83-2c0df316f5ef service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:11.552863 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1321/2625] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:35:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:35:12.110500 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e896accb-568c-4647-a99e-c38b3e6786a9 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:12.112154 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-e896accb-568c-4647-a99e-c38b3e6786a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:35:12.146523 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e896accb-568c-4647-a99e-c38b3e6786a9 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:12.151787 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0308af66-ae9f-44d0-a22a-68278002bab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:12.152445 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308af66-ae9f-44d0-a22a-68278002bab4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:12.152727 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308af66-ae9f-44d0-a22a-68278002bab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:12.153046 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308af66-ae9f-44d0-a22a-68278002bab4 admin admin] PATH_INFO: `/v3/projects/f1b2605a5a7c4b2995d59e84ad42ebcc` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:12.154241 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0308af66-ae9f-44d0-a22a-68278002bab4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1b2605a5a7c4b2995d59e84ad42ebcc)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:12.156796 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0308af66-ae9f-44d0-a22a-68278002bab4 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:12.229690 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-0308af66-ae9f-44d0-a22a-68278002bab4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1b2605a5a7c4b2995d59e84ad42ebcc', 'request_id': 'req-0308af66-ae9f-44d0-a22a-68278002bab4'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:12.248451 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-0308af66-ae9f-44d0-a22a-68278002bab4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1b2605a5a7c4b2995d59e84ad42ebcc', 'request_id': 'req-0308af66-ae9f-44d0-a22a-68278002bab4'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:12.267087 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-0308af66-ae9f-44d0-a22a-68278002bab4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1b2605a5a7c4b2995d59e84ad42ebcc', 'request_id': 'req-0308af66-ae9f-44d0-a22a-68278002bab4'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:12.302239 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-0308af66-ae9f-44d0-a22a-68278002bab4 admin admin] The token cache is being invalidate because project f1b2605a5a7c4b2995d59e84ad42ebcc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81383) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:35:12.302543 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-0308af66-ae9f-44d0-a22a-68278002bab4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:12.303237 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-0308af66-ae9f-44d0-a22a-68278002bab4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:12.307482 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1305/2626] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:35:12 2022] DELETE /identity/v3/projects/f1b2605a5a7c4b2995d59e84ad42ebcc => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:35:12.316894 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e03b3c1-16bc-4499-8f4a-5b791efef141 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:12.317505 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e03b3c1-16bc-4499-8f4a-5b791efef141 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:12.317505 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e03b3c1-16bc-4499-8f4a-5b791efef141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:12.357949 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-2e03b3c1-16bc-4499-8f4a-5b791efef141 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:35:12.359335 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-2e03b3c1-16bc-4499-8f4a-5b791efef141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:35:12.372587 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:35:12.472358 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1322/2627] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:35:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:35:12.537480 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f55a64-bc23-413a-9eac-0cab9ae04b4e None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:12.537592 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f55a64-bc23-413a-9eac-0cab9ae04b4e None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:12.537784 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f55a64-bc23-413a-9eac-0cab9ae04b4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:12.583973 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-53f55a64-bc23-413a-9eac-0cab9ae04b4e None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:35:12.585544 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-53f55a64-bc23-413a-9eac-0cab9ae04b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:35:12.611269 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1306/2628] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:35:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:35:12.614984 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e03b3c1-16bc-4499-8f4a-5b791efef141 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:12.631854 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e03b3c1-16bc-4499-8f4a-5b791efef141 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:12.643387 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d23ae1-cc47-46c3-bb6e-e44f7d55a8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:12.644805 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d23ae1-cc47-46c3-bb6e-e44f7d55a8a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:12.645034 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d23ae1-cc47-46c3-bb6e-e44f7d55a8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:12.645360 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d23ae1-cc47-46c3-bb6e-e44f7d55a8a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:12.647139 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d23ae1-cc47-46c3-bb6e-e44f7d55a8a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:35:12.647455 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d23ae1-cc47-46c3-bb6e-e44f7d55a8a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:12.649187 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d23ae1-cc47-46c3-bb6e-e44f7d55a8a5 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:12.663074 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1323/2629] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 05:35:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:35:12.667086 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f55a64-bc23-413a-9eac-0cab9ae04b4e None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:12.681637 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f55a64-bc23-413a-9eac-0cab9ae04b4e None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:12.686916 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae5e408-9f2e-4be3-a6d4-45cffa2ca0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:12.688173 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae5e408-9f2e-4be3-a6d4-45cffa2ca0e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:12.688173 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae5e408-9f2e-4be3-a6d4-45cffa2ca0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:12.688173 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae5e408-9f2e-4be3-a6d4-45cffa2ca0e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:12.688771 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae5e408-9f2e-4be3-a6d4-45cffa2ca0e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:12.691589 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae5e408-9f2e-4be3-a6d4-45cffa2ca0e6 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:12.739211 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1307/2630] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:35:12 2022] POST /identity/v3/projects => generated 383 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:35:12.742455 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d23ae1-cc47-46c3-bb6e-e44f7d55a8a5 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:12.754798 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d23ae1-cc47-46c3-bb6e-e44f7d55a8a5 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:12.846859 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b205892b-7d0b-4df9-ada2-32ede1e3e809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:12.848501 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b205892b-7d0b-4df9-ada2-32ede1e3e809 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:12.848501 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b205892b-7d0b-4df9-ada2-32ede1e3e809 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:12.848731 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b205892b-7d0b-4df9-ada2-32ede1e3e809 admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:12.849881 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b205892b-7d0b-4df9-ada2-32ede1e3e809 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:12.851904 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b205892b-7d0b-4df9-ada2-32ede1e3e809 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:12.885148 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1324/2631] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:35:12 2022] POST /identity/v3/users => generated 292 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 05:35:12.886407 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae5e408-9f2e-4be3-a6d4-45cffa2ca0e6 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:12.905413 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae5e408-9f2e-4be3-a6d4-45cffa2ca0e6 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:12.914461 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5469a78d-2275-44bc-bde0-1f061cdd17a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:12.915482 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5469a78d-2275-44bc-bde0-1f061cdd17a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:12.915604 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5469a78d-2275-44bc-bde0-1f061cdd17a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:12.915855 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5469a78d-2275-44bc-bde0-1f061cdd17a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:12.916751 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5469a78d-2275-44bc-bde0-1f061cdd17a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:12.920206 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5469a78d-2275-44bc-bde0-1f061cdd17a0 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:12.947974 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1308/2632] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:35:12 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:35:12.950059 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b205892b-7d0b-4df9-ada2-32ede1e3e809 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:12.960810 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b205892b-7d0b-4df9-ada2-32ede1e3e809 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:12.965856 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd6a8b8-4e28-4e4d-95b2-b31349499f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:12.966468 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd6a8b8-4e28-4e4d-95b2-b31349499f83 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:12.966749 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd6a8b8-4e28-4e4d-95b2-b31349499f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:12.967021 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd6a8b8-4e28-4e4d-95b2-b31349499f83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:12.967669 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd6a8b8-4e28-4e4d-95b2-b31349499f83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:12.969323 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd6a8b8-4e28-4e4d-95b2-b31349499f83 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:12.980996 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1325/2633] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:35:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:35:12.985478 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5469a78d-2275-44bc-bde0-1f061cdd17a0 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:13.000534 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5469a78d-2275-44bc-bde0-1f061cdd17a0 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:13.005591 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ccc98d-712c-4920-b8b9-08a6f461b994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:13.006265 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ccc98d-712c-4920-b8b9-08a6f461b994 admin admin] REQUEST_METHOD: `PUT` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:13.006589 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ccc98d-712c-4920-b8b9-08a6f461b994 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:13.007376 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ccc98d-712c-4920-b8b9-08a6f461b994 admin admin] PATH_INFO: `/v3/projects/cb13ab3298724362af9bfb5777527621/users/90be99a58aa04bddb65cb18a38889043/roles/aa7ff8e0ec1e48e5811335b9eb38b448` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:13.012930 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:35:13.037122 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ccc98d-712c-4920-b8b9-08a6f461b994 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb13ab3298724362af9bfb5777527621, user_id=90be99a58aa04bddb65cb18a38889043, role_id=aa7ff8e0ec1e48e5811335b9eb38b448)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:13.039918 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ccc98d-712c-4920-b8b9-08a6f461b994 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:13.062744 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1309/2634] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:35:12 2022] PUT /identity/v3/projects/cb13ab3298724362af9bfb5777527621/users/90be99a58aa04bddb65cb18a38889043/roles/aa7ff8e0ec1e48e5811335b9eb38b448 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 05:35:13.068463 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b3f4af-4e1f-4eca-bc2a-01136ead0b54 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:13.068707 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b3f4af-4e1f-4eca-bc2a-01136ead0b54 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:13.069056 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b3f4af-4e1f-4eca-bc2a-01136ead0b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:13.092806 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-03b3f4af-4e1f-4eca-bc2a-01136ead0b54 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:35:13.094224 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-03b3f4af-4e1f-4eca-bc2a-01136ead0b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:35:13.165946 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1326/2635] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:35:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:35:13.176154 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ccc98d-712c-4920-b8b9-08a6f461b994 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:13.177976 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-04ccc98d-712c-4920-b8b9-08a6f461b994 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:35:13.245450 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ccc98d-712c-4920-b8b9-08a6f461b994 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:13.249277 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db44516a-5229-4aca-816d-4e76c2abe192 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:13.250108 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db44516a-5229-4aca-816d-4e76c2abe192 service neutron] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:13.250483 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db44516a-5229-4aca-816d-4e76c2abe192 service neutron] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:13.250853 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db44516a-5229-4aca-816d-4e76c2abe192 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:13.261307 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db44516a-5229-4aca-816d-4e76c2abe192 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:13.262840 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db44516a-5229-4aca-816d-4e76c2abe192 service neutron] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:13.275028 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1310/2636] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:35:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:35:14.128915 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3198620-99f6-46ad-97ef-eec1bfeafa35 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:14.129489 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3198620-99f6-46ad-97ef-eec1bfeafa35 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:14.129489 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3198620-99f6-46ad-97ef-eec1bfeafa35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:14.160294 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-f3198620-99f6-46ad-97ef-eec1bfeafa35 None None] MFA Rules not processed for user `90be99a58aa04bddb65cb18a38889043`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:35:14.161507 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-f3198620-99f6-46ad-97ef-eec1bfeafa35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:35:14.172319 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:35:14.229999 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1327/2637] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:35:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:35:14.241671 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db44516a-5229-4aca-816d-4e76c2abe192 service neutron] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:14.243136 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-db44516a-5229-4aca-816d-4e76c2abe192 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:35:14.301103 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db44516a-5229-4aca-816d-4e76c2abe192 service neutron] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:14.304790 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a519e9-a39f-45ad-aa43-0391bff195b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a147e14b61d481db1cac02c58ac3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:14.305402 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a519e9-a39f-45ad-aa43-0391bff195b8 service cinder] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:14.305682 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a519e9-a39f-45ad-aa43-0391bff195b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:14.305955 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a519e9-a39f-45ad-aa43-0391bff195b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:14.315671 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a519e9-a39f-45ad-aa43-0391bff195b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:14.317118 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a519e9-a39f-45ad-aa43-0391bff195b8 service cinder] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:14.326550 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1311/2638] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:35:14 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:35:14.984391 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3198620-99f6-46ad-97ef-eec1bfeafa35 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:14.986041 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-f3198620-99f6-46ad-97ef-eec1bfeafa35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:35:15.001241 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3198620-99f6-46ad-97ef-eec1bfeafa35 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:15.006601 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8604318c-f511-4b67-92ea-ce2a6b609d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:15.006888 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8604318c-f511-4b67-92ea-ce2a6b609d25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:15.007261 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8604318c-f511-4b67-92ea-ce2a6b609d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:15.007579 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8604318c-f511-4b67-92ea-ce2a6b609d25 admin admin] PATH_INFO: `/v3/users/dc3e6da6eb8b46ba88113e398df23039` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:15.008779 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8604318c-f511-4b67-92ea-ce2a6b609d25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc3e6da6eb8b46ba88113e398df23039)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:15.011978 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8604318c-f511-4b67-92ea-ce2a6b609d25 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:15.070874 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-8604318c-f511-4b67-92ea-ce2a6b609d25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc3e6da6eb8b46ba88113e398df23039'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:15.083800 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-8604318c-f511-4b67-92ea-ce2a6b609d25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc3e6da6eb8b46ba88113e398df23039'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:15.091111 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-8604318c-f511-4b67-92ea-ce2a6b609d25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc3e6da6eb8b46ba88113e398df23039'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:15.099545 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-8604318c-f511-4b67-92ea-ce2a6b609d25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc3e6da6eb8b46ba88113e398df23039'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:15.100194 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-8604318c-f511-4b67-92ea-ce2a6b609d25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc3e6da6eb8b46ba88113e398df23039'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:15.106733 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1328/2639] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:35:14 2022] DELETE /identity/v3/users/dc3e6da6eb8b46ba88113e398df23039 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:35:15.111489 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b4851-3d2f-40be-808b-38096b240d56 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:15.111889 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b4851-3d2f-40be-808b-38096b240d56 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:15.112169 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b4851-3d2f-40be-808b-38096b240d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:15.131775 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-1b0b4851-3d2f-40be-808b-38096b240d56 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:35:15.132982 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-1b0b4851-3d2f-40be-808b-38096b240d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:35:15.189939 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1312/2640] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:35:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:35:15.200168 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8604318c-f511-4b67-92ea-ce2a6b609d25 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:15.201561 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-8604318c-f511-4b67-92ea-ce2a6b609d25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:35:15.258578 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8604318c-f511-4b67-92ea-ce2a6b609d25 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:15.262213 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4876be95-92f0-4d4d-b142-a688f3b88adf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:15.262811 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4876be95-92f0-4d4d-b142-a688f3b88adf service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:15.263092 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4876be95-92f0-4d4d-b142-a688f3b88adf service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:15.263367 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4876be95-92f0-4d4d-b142-a688f3b88adf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:15.272754 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4876be95-92f0-4d4d-b142-a688f3b88adf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:15.274193 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4876be95-92f0-4d4d-b142-a688f3b88adf service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:15.284379 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1329/2641] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:35:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:35:15.562311 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0b4851-3d2f-40be-808b-38096b240d56 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:15.563872 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-1b0b4851-3d2f-40be-808b-38096b240d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:35:15.576336 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0b4851-3d2f-40be-808b-38096b240d56 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:15.581092 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4fbc3a-f717-4947-9d2b-a1ece6923b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:15.582262 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4fbc3a-f717-4947-9d2b-a1ece6923b5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:15.582538 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4fbc3a-f717-4947-9d2b-a1ece6923b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:15.582848 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4fbc3a-f717-4947-9d2b-a1ece6923b5d admin admin] PATH_INFO: `/v3/projects/f1342d58633f45c5ac0f9a032bf72f6c` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:15.584078 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4fbc3a-f717-4947-9d2b-a1ece6923b5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1342d58633f45c5ac0f9a032bf72f6c)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:15.586138 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4fbc3a-f717-4947-9d2b-a1ece6923b5d admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:15.617442 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:35:15.641080 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-7f4fbc3a-f717-4947-9d2b-a1ece6923b5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1342d58633f45c5ac0f9a032bf72f6c', 'request_id': 'req-7f4fbc3a-f717-4947-9d2b-a1ece6923b5d'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:15.650252 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-7f4fbc3a-f717-4947-9d2b-a1ece6923b5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1342d58633f45c5ac0f9a032bf72f6c', 'request_id': 'req-7f4fbc3a-f717-4947-9d2b-a1ece6923b5d'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:15.657301 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-7f4fbc3a-f717-4947-9d2b-a1ece6923b5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1342d58633f45c5ac0f9a032bf72f6c', 'request_id': 'req-7f4fbc3a-f717-4947-9d2b-a1ece6923b5d'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:15.669039 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-7f4fbc3a-f717-4947-9d2b-a1ece6923b5d admin admin] The token cache is being invalidate because project f1342d58633f45c5ac0f9a032bf72f6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81383) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:35:15.669584 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-7f4fbc3a-f717-4947-9d2b-a1ece6923b5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:15.670230 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-7f4fbc3a-f717-4947-9d2b-a1ece6923b5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:15.671726 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1313/2642] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:35:15 2022] DELETE /identity/v3/projects/f1342d58633f45c5ac0f9a032bf72f6c => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:35:15.677449 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4876be95-92f0-4d4d-b142-a688f3b88adf service neutron] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:15.684072 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f2d497-1b04-4cff-bb4e-19487fd37355 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:15.684358 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f2d497-1b04-4cff-bb4e-19487fd37355 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:15.684662 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f2d497-1b04-4cff-bb4e-19487fd37355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:15.687783 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4876be95-92f0-4d4d-b142-a688f3b88adf service neutron] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:15.703368 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-41f2d497-1b04-4cff-bb4e-19487fd37355 None None] MFA Rules not processed for user `90be99a58aa04bddb65cb18a38889043`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:35:15.704842 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-41f2d497-1b04-4cff-bb4e-19487fd37355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:35:15.712161 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:35:15.748061 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41a9b24-bf14-49fc-9f1e-b79858b29984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:15.748690 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a9b24-bf14-49fc-9f1e-b79858b29984 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:15.748983 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a9b24-bf14-49fc-9f1e-b79858b29984 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:15.749252 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a9b24-bf14-49fc-9f1e-b79858b29984 admin admin] PATH_INFO: `/v3/users/5487e886915c4e1b8a0179e3c98ff8ff` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:15.750495 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41a9b24-bf14-49fc-9f1e-b79858b29984 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5487e886915c4e1b8a0179e3c98ff8ff)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:15.752467 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41a9b24-bf14-49fc-9f1e-b79858b29984 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:15.770632 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1314/2643] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:35:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 05:35:15.804523 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-c41a9b24-bf14-49fc-9f1e-b79858b29984 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5487e886915c4e1b8a0179e3c98ff8ff'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:15.819734 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-c41a9b24-bf14-49fc-9f1e-b79858b29984 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5487e886915c4e1b8a0179e3c98ff8ff'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:15.828812 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-c41a9b24-bf14-49fc-9f1e-b79858b29984 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5487e886915c4e1b8a0179e3c98ff8ff'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:15.836790 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-c41a9b24-bf14-49fc-9f1e-b79858b29984 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5487e886915c4e1b8a0179e3c98ff8ff'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:15.837420 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-c41a9b24-bf14-49fc-9f1e-b79858b29984 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5487e886915c4e1b8a0179e3c98ff8ff'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:15.843699 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1330/2644] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:35:15 2022] DELETE /identity/v3/users/5487e886915c4e1b8a0179e3c98ff8ff => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:35:16.016674 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f2d497-1b04-4cff-bb4e-19487fd37355 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:16.018295 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-41f2d497-1b04-4cff-bb4e-19487fd37355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:35:16.079103 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f2d497-1b04-4cff-bb4e-19487fd37355 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:16.130992 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2875871b-bfd2-4df5-90f3-21916d017144 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:16.131721 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2875871b-bfd2-4df5-90f3-21916d017144 service neutron] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:16.132007 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2875871b-bfd2-4df5-90f3-21916d017144 service neutron] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:16.132276 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2875871b-bfd2-4df5-90f3-21916d017144 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:16.134044 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-2875871b-bfd2-4df5-90f3-21916d017144 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:35:16.145543 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2875871b-bfd2-4df5-90f3-21916d017144 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:16.147479 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2875871b-bfd2-4df5-90f3-21916d017144 service neutron] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:16.158361 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1315/2645] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:35:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:35:16.178003 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41a9b24-bf14-49fc-9f1e-b79858b29984 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:16.180423 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-c41a9b24-bf14-49fc-9f1e-b79858b29984 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:35:16.271964 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41a9b24-bf14-49fc-9f1e-b79858b29984 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:16.277200 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2b1299-15dc-4583-ba53-377383fd86a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:16.277847 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b1299-15dc-4583-ba53-377383fd86a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:16.278352 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b1299-15dc-4583-ba53-377383fd86a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:16.278467 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b1299-15dc-4583-ba53-377383fd86a3 admin admin] PATH_INFO: `/v3/projects/fbb5fc1d18bc4eb89c2bf61e4ae3c2c4` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:16.279583 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2b1299-15dc-4583-ba53-377383fd86a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbb5fc1d18bc4eb89c2bf61e4ae3c2c4)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:16.281557 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2b1299-15dc-4583-ba53-377383fd86a3 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:16.342570 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:35:16.345050 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-bc2b1299-15dc-4583-ba53-377383fd86a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbb5fc1d18bc4eb89c2bf61e4ae3c2c4', 'request_id': 'req-bc2b1299-15dc-4583-ba53-377383fd86a3'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:16.358885 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-bc2b1299-15dc-4583-ba53-377383fd86a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbb5fc1d18bc4eb89c2bf61e4ae3c2c4', 'request_id': 'req-bc2b1299-15dc-4583-ba53-377383fd86a3'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:16.375669 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-bc2b1299-15dc-4583-ba53-377383fd86a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbb5fc1d18bc4eb89c2bf61e4ae3c2c4', 'request_id': 'req-bc2b1299-15dc-4583-ba53-377383fd86a3'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:16.397005 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-bc2b1299-15dc-4583-ba53-377383fd86a3 admin admin] The token cache is being invalidate because project fbb5fc1d18bc4eb89c2bf61e4ae3c2c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:35:16.397130 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-bc2b1299-15dc-4583-ba53-377383fd86a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:16.398056 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-bc2b1299-15dc-4583-ba53-377383fd86a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:16.400165 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1331/2646] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:35:16 2022] DELETE /identity/v3/projects/fbb5fc1d18bc4eb89c2bf61e4ae3c2c4 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:35:16.405249 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4907855a-2817-46a0-9f07-4e7325c84b29 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:16.405537 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4907855a-2817-46a0-9f07-4e7325c84b29 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:16.405814 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4907855a-2817-46a0-9f07-4e7325c84b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:16.427326 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-4907855a-2817-46a0-9f07-4e7325c84b29 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:35:16.428844 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-4907855a-2817-46a0-9f07-4e7325c84b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:35:16.461897 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:35:16.525261 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1316/2647] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:35:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 05:35:16.533333 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fde4a0-dc2c-4408-9542-83be9648640e None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:16.533625 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fde4a0-dc2c-4408-9542-83be9648640e None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:16.533903 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fde4a0-dc2c-4408-9542-83be9648640e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:16.548785 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4907855a-2817-46a0-9f07-4e7325c84b29 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:16.550846 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-4907855a-2817-46a0-9f07-4e7325c84b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:35:16.560550 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-d8fde4a0-dc2c-4408-9542-83be9648640e None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:35:16.561819 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-d8fde4a0-dc2c-4408-9542-83be9648640e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:35:16.571737 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1332/2648] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:35:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:35:16.576290 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fde4a0-dc2c-4408-9542-83be9648640e None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:16.589819 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fde4a0-dc2c-4408-9542-83be9648640e None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:16.598348 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10274c87-24e5-48e4-841b-f0b2da7f20d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:16.599216 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10274c87-24e5-48e4-841b-f0b2da7f20d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:16.599798 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10274c87-24e5-48e4-841b-f0b2da7f20d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:16.600258 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10274c87-24e5-48e4-841b-f0b2da7f20d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:16.601644 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10274c87-24e5-48e4-841b-f0b2da7f20d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:35:16.602226 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10274c87-24e5-48e4-841b-f0b2da7f20d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:16.604497 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10274c87-24e5-48e4-841b-f0b2da7f20d0 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:16.621757 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1333/2649] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 05:35:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:35:16.626033 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10274c87-24e5-48e4-841b-f0b2da7f20d0 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:16.633295 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4907855a-2817-46a0-9f07-4e7325c84b29 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:16.638482 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10274c87-24e5-48e4-841b-f0b2da7f20d0 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:16.638829 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abbb5a4-70da-4a25-9e3c-bbf233b568ec service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72e1d7dd79ff43e7b585b5090762465f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:16.639446 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abbb5a4-70da-4a25-9e3c-bbf233b568ec service placement] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:16.639765 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abbb5a4-70da-4a25-9e3c-bbf233b568ec service placement] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:16.640021 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abbb5a4-70da-4a25-9e3c-bbf233b568ec service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:16.641711 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-1abbb5a4-70da-4a25-9e3c-bbf233b568ec service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:35:16.645082 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0291aa05-2d0f-4d61-b797-c66c9af579fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:16.646149 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0291aa05-2d0f-4d61-b797-c66c9af579fd admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:16.646615 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0291aa05-2d0f-4d61-b797-c66c9af579fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:16.647371 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0291aa05-2d0f-4d61-b797-c66c9af579fd admin admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:16.648223 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0291aa05-2d0f-4d61-b797-c66c9af579fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:16.650676 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0291aa05-2d0f-4d61-b797-c66c9af579fd admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:16.653815 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abbb5a4-70da-4a25-9e3c-bbf233b568ec service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:16.656154 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abbb5a4-70da-4a25-9e3c-bbf233b568ec service placement] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:16.669678 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1317/2650] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:35:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:35:16.684690 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1334/2651] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:35:16 2022] POST /identity/v3/projects => generated 407 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 05:35:16.689075 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abbb5a4-70da-4a25-9e3c-bbf233b568ec service placement] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:16.703373 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abbb5a4-70da-4a25-9e3c-bbf233b568ec service placement] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:16.775560 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5de55e-4af9-47ee-a334-ed133af7a9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:16.776208 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5de55e-4af9-47ee-a334-ed133af7a9e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:16.776544 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5de55e-4af9-47ee-a334-ed133af7a9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:16.777505 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5de55e-4af9-47ee-a334-ed133af7a9e1 admin admin] PATH_INFO: `/v3/users` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:16.777505 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5de55e-4af9-47ee-a334-ed133af7a9e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:16.779564 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5de55e-4af9-47ee-a334-ed133af7a9e1 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:16.808833 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1318/2652] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:35:16 2022] POST /identity/v3/users => generated 304 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:35:16.813067 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0291aa05-2d0f-4d61-b797-c66c9af579fd admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:16.824054 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0291aa05-2d0f-4d61-b797-c66c9af579fd admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:16.828994 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60f4b53-e75e-4d7a-990b-6e2041976fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:16.829727 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60f4b53-e75e-4d7a-990b-6e2041976fac admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:16.830028 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60f4b53-e75e-4d7a-990b-6e2041976fac admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:16.830300 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60f4b53-e75e-4d7a-990b-6e2041976fac admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:16.831714 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60f4b53-e75e-4d7a-990b-6e2041976fac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:16.833089 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60f4b53-e75e-4d7a-990b-6e2041976fac admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:16.843725 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1335/2653] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:35:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:35:16.848668 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5de55e-4af9-47ee-a334-ed133af7a9e1 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:16.859557 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5de55e-4af9-47ee-a334-ed133af7a9e1 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:16.865727 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72bce2f-e27a-42d6-987b-1a30d75d435f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:16.866404 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72bce2f-e27a-42d6-987b-1a30d75d435f admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:16.867037 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72bce2f-e27a-42d6-987b-1a30d75d435f admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:16.867304 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72bce2f-e27a-42d6-987b-1a30d75d435f admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:16.868195 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72bce2f-e27a-42d6-987b-1a30d75d435f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:16.869606 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72bce2f-e27a-42d6-987b-1a30d75d435f admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:16.880315 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1319/2654] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:35:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:35:16.884178 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60f4b53-e75e-4d7a-990b-6e2041976fac admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:16.896268 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60f4b53-e75e-4d7a-990b-6e2041976fac admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:16.901387 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d40c959-21c3-4b56-9ab9-9d2d98f9addb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:16.902061 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40c959-21c3-4b56-9ab9-9d2d98f9addb admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:16.902336 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40c959-21c3-4b56-9ab9-9d2d98f9addb admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:16.902610 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40c959-21c3-4b56-9ab9-9d2d98f9addb admin admin] PATH_INFO: `/v3/projects/45fe7f1751594ab09b2836b37f5b148f/users/9be2be0322244c9296832b7303785290/roles/aa7ff8e0ec1e48e5811335b9eb38b448` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:16.919805 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d40c959-21c3-4b56-9ab9-9d2d98f9addb admin admin] RBAC: Authorizing `identity:create_grant(project_id=45fe7f1751594ab09b2836b37f5b148f, user_id=9be2be0322244c9296832b7303785290, role_id=aa7ff8e0ec1e48e5811335b9eb38b448)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:16.922591 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d40c959-21c3-4b56-9ab9-9d2d98f9addb admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:16.936831 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1336/2655] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:35:16 2022] PUT /identity/v3/projects/45fe7f1751594ab09b2836b37f5b148f/users/9be2be0322244c9296832b7303785290/roles/aa7ff8e0ec1e48e5811335b9eb38b448 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:35:16.947806 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6867758-e430-43e8-93b5-c4b3d4b1eaee None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:16.948098 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6867758-e430-43e8-93b5-c4b3d4b1eaee None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:16.948389 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6867758-e430-43e8-93b5-c4b3d4b1eaee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:16.980772 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-b6867758-e430-43e8-93b5-c4b3d4b1eaee None None] MFA Rules not processed for user `9be2be0322244c9296832b7303785290`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:35:16.982191 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-b6867758-e430-43e8-93b5-c4b3d4b1eaee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:35:16.997123 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:35:17.084669 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1320/2656] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:35:16 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:35:17.089598 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d40c959-21c3-4b56-9ab9-9d2d98f9addb admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:17.159587 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d40c959-21c3-4b56-9ab9-9d2d98f9addb admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:17.164331 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d9cb07-5506-4de9-91fe-1458277f8e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:17.164928 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d9cb07-5506-4de9-91fe-1458277f8e55 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:17.165203 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d9cb07-5506-4de9-91fe-1458277f8e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:17.165471 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d9cb07-5506-4de9-91fe-1458277f8e55 admin admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:17.166100 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d9cb07-5506-4de9-91fe-1458277f8e55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:17.168034 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d9cb07-5506-4de9-91fe-1458277f8e55 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:17.194361 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1337/2657] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:35:17 2022] POST /identity/v3/projects => generated 407 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:35:17.198415 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6867758-e430-43e8-93b5-c4b3d4b1eaee None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:17.209562 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6867758-e430-43e8-93b5-c4b3d4b1eaee None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:17.266395 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c42eb2-6522-4f7c-8a4e-b28708926dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:17.267099 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c42eb2-6522-4f7c-8a4e-b28708926dc2 admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:17.267449 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c42eb2-6522-4f7c-8a4e-b28708926dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:17.267858 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c42eb2-6522-4f7c-8a4e-b28708926dc2 admin admin] PATH_INFO: `/v3/users` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:17.268555 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c42eb2-6522-4f7c-8a4e-b28708926dc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:17.271107 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c42eb2-6522-4f7c-8a4e-b28708926dc2 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:17.299334 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1321/2658] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:35:17 2022] POST /identity/v3/users => generated 310 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:35:17.303649 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d9cb07-5506-4de9-91fe-1458277f8e55 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:17.314774 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d9cb07-5506-4de9-91fe-1458277f8e55 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:17.320888 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5e15e5-6be7-4c8d-8c6a-13c95d224c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:17.324211 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e15e5-6be7-4c8d-8c6a-13c95d224c6d admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:17.324894 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e15e5-6be7-4c8d-8c6a-13c95d224c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:17.325351 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e15e5-6be7-4c8d-8c6a-13c95d224c6d admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:17.326257 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5e15e5-6be7-4c8d-8c6a-13c95d224c6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:17.328195 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5e15e5-6be7-4c8d-8c6a-13c95d224c6d admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:17.351647 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1338/2659] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:35:17 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:35:17.355750 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c42eb2-6522-4f7c-8a4e-b28708926dc2 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:17.365945 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c42eb2-6522-4f7c-8a4e-b28708926dc2 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:17.370506 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66608984-c53f-4591-a9ef-75c01d0906f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:17.371147 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66608984-c53f-4591-a9ef-75c01d0906f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:17.371423 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66608984-c53f-4591-a9ef-75c01d0906f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:17.371708 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66608984-c53f-4591-a9ef-75c01d0906f7 admin admin] PATH_INFO: `/v3/projects/509f3c7725074584ad5b50b5a8806fbf/users/9aff04d94f994272aa4ea62f2df6cc16/roles/5b702713e40145b49e0b42abd0a5fba9` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:17.387886 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66608984-c53f-4591-a9ef-75c01d0906f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=509f3c7725074584ad5b50b5a8806fbf, user_id=9aff04d94f994272aa4ea62f2df6cc16, role_id=5b702713e40145b49e0b42abd0a5fba9)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:17.390758 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66608984-c53f-4591-a9ef-75c01d0906f7 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:17.407986 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1322/2660] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:35:17 2022] PUT /identity/v3/projects/509f3c7725074584ad5b50b5a8806fbf/users/9aff04d94f994272aa4ea62f2df6cc16/roles/5b702713e40145b49e0b42abd0a5fba9 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:35:17.411750 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5e15e5-6be7-4c8d-8c6a-13c95d224c6d admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:17.422866 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5e15e5-6be7-4c8d-8c6a-13c95d224c6d admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:17.464388 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:35:17.504879 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e750773f-f750-408f-9a2a-b61a64a9060a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:17.505113 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e750773f-f750-408f-9a2a-b61a64a9060a admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:17.505352 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e750773f-f750-408f-9a2a-b61a64a9060a admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:17.505623 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e750773f-f750-408f-9a2a-b61a64a9060a admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:17.506281 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e750773f-f750-408f-9a2a-b61a64a9060a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:17.509883 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e750773f-f750-408f-9a2a-b61a64a9060a admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:17.527582 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66608984-c53f-4591-a9ef-75c01d0906f7 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:17.528658 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1339/2661] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:35:17 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:35:17.541310 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66608984-c53f-4591-a9ef-75c01d0906f7 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:17.546246 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374c59da-9e75-4856-8795-302d5e10cd64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:17.547026 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374c59da-9e75-4856-8795-302d5e10cd64 admin admin] REQUEST_METHOD: `PUT` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:17.547421 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374c59da-9e75-4856-8795-302d5e10cd64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:17.547835 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374c59da-9e75-4856-8795-302d5e10cd64 admin admin] PATH_INFO: `/v3/projects/509f3c7725074584ad5b50b5a8806fbf/users/9aff04d94f994272aa4ea62f2df6cc16/roles/5b702713e40145b49e0b42abd0a5fba9` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:17.550719 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374c59da-9e75-4856-8795-302d5e10cd64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=509f3c7725074584ad5b50b5a8806fbf, user_id=9aff04d94f994272aa4ea62f2df6cc16, role_id=5b702713e40145b49e0b42abd0a5fba9)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:17.556952 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374c59da-9e75-4856-8795-302d5e10cd64 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:17.569565 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1323/2662] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:35:17 2022] PUT /identity/v3/projects/509f3c7725074584ad5b50b5a8806fbf/users/9aff04d94f994272aa4ea62f2df6cc16/roles/5b702713e40145b49e0b42abd0a5fba9 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:35:17.579710 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e8a98-7a1c-4e0a-a10f-333e55700765 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:17.579990 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e8a98-7a1c-4e0a-a10f-333e55700765 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:17.580268 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e8a98-7a1c-4e0a-a10f-333e55700765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:17.619586 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-ad6e8a98-7a1c-4e0a-a10f-333e55700765 None None] MFA Rules not processed for user `9aff04d94f994272aa4ea62f2df6cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:35:17.621457 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-ad6e8a98-7a1c-4e0a-a10f-333e55700765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:35:17.700758 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1340/2663] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:35:17 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:35:17.718162 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374c59da-9e75-4856-8795-302d5e10cd64 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:17.720064 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-374c59da-9e75-4856-8795-302d5e10cd64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:35:17.776609 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374c59da-9e75-4856-8795-302d5e10cd64 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:17.780243 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f473dd-d5f7-4b61-b3a8-98e53b3751e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a147e14b61d481db1cac02c58ac3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:17.780834 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f473dd-d5f7-4b61-b3a8-98e53b3751e6 service cinder] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:17.781106 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f473dd-d5f7-4b61-b3a8-98e53b3751e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:17.781370 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f473dd-d5f7-4b61-b3a8-98e53b3751e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:17.790935 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f473dd-d5f7-4b61-b3a8-98e53b3751e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:17.792410 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f473dd-d5f7-4b61-b3a8-98e53b3751e6 service cinder] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:17.801688 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1324/2664] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:35:17 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:35:17.949361 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6e8a98-7a1c-4e0a-a10f-333e55700765 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:17.959559 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6e8a98-7a1c-4e0a-a10f-333e55700765 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:17.963095 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d780df10-e910-4092-9f4a-4dc4704531d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a147e14b61d481db1cac02c58ac3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:17.963749 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780df10-e910-4092-9f4a-4dc4704531d0 service cinder] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:17.964030 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780df10-e910-4092-9f4a-4dc4704531d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:17.964328 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780df10-e910-4092-9f4a-4dc4704531d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:18.019941 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d780df10-e910-4092-9f4a-4dc4704531d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:18.021388 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d780df10-e910-4092-9f4a-4dc4704531d0 service cinder] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:18.030166 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1341/2665] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:35:17 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:35:18.077526 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07af7793-f4a2-4a70-840f-8557497e5a4c None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:18.077932 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07af7793-f4a2-4a70-840f-8557497e5a4c None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:18.078211 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07af7793-f4a2-4a70-840f-8557497e5a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:18.097670 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-07af7793-f4a2-4a70-840f-8557497e5a4c None None] MFA Rules not processed for user `62fffbcf330a4bc183d0885c175f5a90`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:35:18.098884 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-07af7793-f4a2-4a70-840f-8557497e5a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:35:18.104535 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:35:18.158486 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1325/2666] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 11 05:35:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:35:18.172431 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d780df10-e910-4092-9f4a-4dc4704531d0 service cinder] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:18.173924 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-d780df10-e910-4092-9f4a-4dc4704531d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:35:18.234187 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:35:18.252013 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d780df10-e910-4092-9f4a-4dc4704531d0 service cinder] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:18.257858 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9771d74-d59d-4a33-8de3-19995fd0f125 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bbe4555380345e485572d2da8b78be1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:18.258453 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9771d74-d59d-4a33-8de3-19995fd0f125 service swift] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:18.258735 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9771d74-d59d-4a33-8de3-19995fd0f125 service swift] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:18.259004 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9771d74-d59d-4a33-8de3-19995fd0f125 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:18.280079 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9771d74-d59d-4a33-8de3-19995fd0f125 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:18.282128 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9771d74-d59d-4a33-8de3-19995fd0f125 service swift] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:18.293292 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1342/2667] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 05:35:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 05:35:19.625365 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003868fc-bfd8-463b-8039-dcbc04fa82c4 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:19.625859 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003868fc-bfd8-463b-8039-dcbc04fa82c4 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:19.626057 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003868fc-bfd8-463b-8039-dcbc04fa82c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:19.648043 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-003868fc-bfd8-463b-8039-dcbc04fa82c4 None None] MFA Rules not processed for user `62fffbcf330a4bc183d0885c175f5a90`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:35:19.649363 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-003868fc-bfd8-463b-8039-dcbc04fa82c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:35:19.657138 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1326/2668] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 11 05:35:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 05:35:19.669509 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9771d74-d59d-4a33-8de3-19995fd0f125 service swift] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:19.680181 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9771d74-d59d-4a33-8de3-19995fd0f125 service swift] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:19.685730 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7422add1-c424-45c0-8d7e-a7740a0b68d1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bbe4555380345e485572d2da8b78be1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:19.686353 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7422add1-c424-45c0-8d7e-a7740a0b68d1 service swift] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:19.686635 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7422add1-c424-45c0-8d7e-a7740a0b68d1 service swift] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:19.686912 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7422add1-c424-45c0-8d7e-a7740a0b68d1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:19.697110 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7422add1-c424-45c0-8d7e-a7740a0b68d1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:19.698846 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7422add1-c424-45c0-8d7e-a7740a0b68d1 service swift] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:19.708701 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1343/2669] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 05:35:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 05:35:20.581807 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003868fc-bfd8-463b-8039-dcbc04fa82c4 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:20.583796 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-003868fc-bfd8-463b-8039-dcbc04fa82c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:35:20.705448 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003868fc-bfd8-463b-8039-dcbc04fa82c4 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:20.711617 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632943a9-0600-442a-92ba-8df969043108 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cd6136036bd467c946cae90d5c29263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:20.713250 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632943a9-0600-442a-92ba-8df969043108 service nova] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:20.713692 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632943a9-0600-442a-92ba-8df969043108 service nova] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:20.715655 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632943a9-0600-442a-92ba-8df969043108 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:20.720418 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-632943a9-0600-442a-92ba-8df969043108 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:35:20.736445 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632943a9-0600-442a-92ba-8df969043108 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:20.738783 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632943a9-0600-442a-92ba-8df969043108 service nova] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:20.773044 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1327/2670] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:35:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:35:23.528029 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7422add1-c424-45c0-8d7e-a7740a0b68d1 service swift] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:23.600545 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7422add1-c424-45c0-8d7e-a7740a0b68d1 service swift] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:23.606653 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a12db3e-662d-4ed3-b0ba-79e4807c71ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:23.607377 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a12db3e-662d-4ed3-b0ba-79e4807c71ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:23.607663 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a12db3e-662d-4ed3-b0ba-79e4807c71ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:23.607978 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a12db3e-662d-4ed3-b0ba-79e4807c71ad admin admin] PATH_INFO: `/v3/users/9be2be0322244c9296832b7303785290` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:23.609392 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a12db3e-662d-4ed3-b0ba-79e4807c71ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=9be2be0322244c9296832b7303785290)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:23.611754 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a12db3e-662d-4ed3-b0ba-79e4807c71ad admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:23.671298 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-1a12db3e-662d-4ed3-b0ba-79e4807c71ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9be2be0322244c9296832b7303785290'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:23.689013 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-1a12db3e-662d-4ed3-b0ba-79e4807c71ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9be2be0322244c9296832b7303785290'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:23.692855 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632943a9-0600-442a-92ba-8df969043108 service nova] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:23.696837 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-1a12db3e-662d-4ed3-b0ba-79e4807c71ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9be2be0322244c9296832b7303785290'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:23.708649 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-1a12db3e-662d-4ed3-b0ba-79e4807c71ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9be2be0322244c9296832b7303785290'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:23.709843 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-1a12db3e-662d-4ed3-b0ba-79e4807c71ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9be2be0322244c9296832b7303785290'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:23.718953 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1344/2671] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:35:23 2022] DELETE /identity/v3/users/9be2be0322244c9296832b7303785290 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:35:23.726360 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4a8d6-aa8b-4405-aa1f-b4dcda49abe7 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:23.726883 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4a8d6-aa8b-4405-aa1f-b4dcda49abe7 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:23.727388 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4a8d6-aa8b-4405-aa1f-b4dcda49abe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:23.755166 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-00d4a8d6-aa8b-4405-aa1f-b4dcda49abe7 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:35:23.755166 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-00d4a8d6-aa8b-4405-aa1f-b4dcda49abe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:35:23.797399 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632943a9-0600-442a-92ba-8df969043108 service nova] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:23.812916 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:35:23.836808 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1345/2672] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:35:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:35:23.848829 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d4a8d6-aa8b-4405-aa1f-b4dcda49abe7 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:23.850525 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-00d4a8d6-aa8b-4405-aa1f-b4dcda49abe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:35:23.851840 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:35:23.903767 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856fa8d0-c348-4851-80c9-eedc9fbb9b08 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72e1d7dd79ff43e7b585b5090762465f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:23.904840 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856fa8d0-c348-4851-80c9-eedc9fbb9b08 service placement] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:23.905325 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856fa8d0-c348-4851-80c9-eedc9fbb9b08 service placement] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:23.905827 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856fa8d0-c348-4851-80c9-eedc9fbb9b08 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:23.909114 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-856fa8d0-c348-4851-80c9-eedc9fbb9b08 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:35:23.915829 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d4a8d6-aa8b-4405-aa1f-b4dcda49abe7 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:23.920446 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b4018d-bab2-436f-b365-9810d365d2a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:23.921055 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b4018d-bab2-436f-b365-9810d365d2a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:23.921336 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b4018d-bab2-436f-b365-9810d365d2a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:23.921663 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b4018d-bab2-436f-b365-9810d365d2a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:23.927263 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856fa8d0-c348-4851-80c9-eedc9fbb9b08 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:23.929720 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856fa8d0-c348-4851-80c9-eedc9fbb9b08 service placement] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:23.931190 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b4018d-bab2-436f-b365-9810d365d2a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:23.932681 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b4018d-bab2-436f-b365-9810d365d2a1 service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:23.943782 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1346/2673] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:35:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:35:23.945325 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1328/2674] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:35:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 05:35:24.337893 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b4018d-bab2-436f-b365-9810d365d2a1 service neutron] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:24.339778 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-60b4018d-bab2-436f-b365-9810d365d2a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:35:24.358279 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b4018d-bab2-436f-b365-9810d365d2a1 service neutron] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:24.364917 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175c4b3e-ba5f-49f9-bdde-af1579e138e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:24.365466 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175c4b3e-ba5f-49f9-bdde-af1579e138e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:24.365737 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175c4b3e-ba5f-49f9-bdde-af1579e138e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:24.366010 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175c4b3e-ba5f-49f9-bdde-af1579e138e6 admin admin] PATH_INFO: `/v3/projects/45fe7f1751594ab09b2836b37f5b148f` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:24.367164 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175c4b3e-ba5f-49f9-bdde-af1579e138e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45fe7f1751594ab09b2836b37f5b148f)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:24.369098 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175c4b3e-ba5f-49f9-bdde-af1579e138e6 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:24.417929 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-175c4b3e-ba5f-49f9-bdde-af1579e138e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45fe7f1751594ab09b2836b37f5b148f', 'request_id': 'req-175c4b3e-ba5f-49f9-bdde-af1579e138e6'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:24.425029 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-175c4b3e-ba5f-49f9-bdde-af1579e138e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45fe7f1751594ab09b2836b37f5b148f', 'request_id': 'req-175c4b3e-ba5f-49f9-bdde-af1579e138e6'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:24.430583 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-175c4b3e-ba5f-49f9-bdde-af1579e138e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45fe7f1751594ab09b2836b37f5b148f', 'request_id': 'req-175c4b3e-ba5f-49f9-bdde-af1579e138e6'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:24.445691 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-175c4b3e-ba5f-49f9-bdde-af1579e138e6 admin admin] The token cache is being invalidate because project 45fe7f1751594ab09b2836b37f5b148f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:35:24.445979 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-175c4b3e-ba5f-49f9-bdde-af1579e138e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:24.446615 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-175c4b3e-ba5f-49f9-bdde-af1579e138e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:24.451403 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1347/2675] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:35:24 2022] DELETE /identity/v3/projects/45fe7f1751594ab09b2836b37f5b148f => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:35:24.452501 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856fa8d0-c348-4851-80c9-eedc9fbb9b08 service placement] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:24.462832 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856fa8d0-c348-4851-80c9-eedc9fbb9b08 service placement] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:24.520885 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df5fc7-1636-4191-ac3e-b60290a0a26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:24.521521 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df5fc7-1636-4191-ac3e-b60290a0a26d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:24.521798 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df5fc7-1636-4191-ac3e-b60290a0a26d admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:24.522068 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df5fc7-1636-4191-ac3e-b60290a0a26d admin admin] PATH_INFO: `/v3/users/9aff04d94f994272aa4ea62f2df6cc16` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:24.523191 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83df5fc7-1636-4191-ac3e-b60290a0a26d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9aff04d94f994272aa4ea62f2df6cc16)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:24.525146 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83df5fc7-1636-4191-ac3e-b60290a0a26d admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:24.571967 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-83df5fc7-1636-4191-ac3e-b60290a0a26d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9aff04d94f994272aa4ea62f2df6cc16'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:24.584356 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-83df5fc7-1636-4191-ac3e-b60290a0a26d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9aff04d94f994272aa4ea62f2df6cc16'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:24.591331 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-83df5fc7-1636-4191-ac3e-b60290a0a26d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9aff04d94f994272aa4ea62f2df6cc16'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:24.599435 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-83df5fc7-1636-4191-ac3e-b60290a0a26d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9aff04d94f994272aa4ea62f2df6cc16'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:24.600312 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-83df5fc7-1636-4191-ac3e-b60290a0a26d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9aff04d94f994272aa4ea62f2df6cc16'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:24.606549 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1329/2676] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:35:24 2022] DELETE /identity/v3/users/9aff04d94f994272aa4ea62f2df6cc16 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:35:24.914055 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175c4b3e-ba5f-49f9-bdde-af1579e138e6 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:24.915610 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-175c4b3e-ba5f-49f9-bdde-af1579e138e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:35:24.938223 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175c4b3e-ba5f-49f9-bdde-af1579e138e6 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:25.040664 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01ccb61-5be9-4e7c-8a8c-75a207edcc67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:25.041553 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ccb61-5be9-4e7c-8a8c-75a207edcc67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:25.042012 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ccb61-5be9-4e7c-8a8c-75a207edcc67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:25.042279 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ccb61-5be9-4e7c-8a8c-75a207edcc67 admin admin] PATH_INFO: `/v3/projects/509f3c7725074584ad5b50b5a8806fbf` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:25.043591 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01ccb61-5be9-4e7c-8a8c-75a207edcc67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=509f3c7725074584ad5b50b5a8806fbf)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:25.045596 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01ccb61-5be9-4e7c-8a8c-75a207edcc67 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:25.066032 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:35:25.106132 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-a01ccb61-5be9-4e7c-8a8c-75a207edcc67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '509f3c7725074584ad5b50b5a8806fbf', 'request_id': 'req-a01ccb61-5be9-4e7c-8a8c-75a207edcc67'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:25.114304 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-a01ccb61-5be9-4e7c-8a8c-75a207edcc67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '509f3c7725074584ad5b50b5a8806fbf', 'request_id': 'req-a01ccb61-5be9-4e7c-8a8c-75a207edcc67'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:25.122186 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-a01ccb61-5be9-4e7c-8a8c-75a207edcc67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '509f3c7725074584ad5b50b5a8806fbf', 'request_id': 'req-a01ccb61-5be9-4e7c-8a8c-75a207edcc67'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:25.137986 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-a01ccb61-5be9-4e7c-8a8c-75a207edcc67 admin admin] The token cache is being invalidate because project 509f3c7725074584ad5b50b5a8806fbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:35:25.138324 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-a01ccb61-5be9-4e7c-8a8c-75a207edcc67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:25.138958 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-a01ccb61-5be9-4e7c-8a8c-75a207edcc67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:25.140666 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1348/2677] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:35:24 2022] DELETE /identity/v3/projects/509f3c7725074584ad5b50b5a8806fbf => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:35:25.145510 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e0e8e-5e62-4185-94cb-238d9dade271 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:25.146017 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e0e8e-5e62-4185-94cb-238d9dade271 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:25.146137 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e0e8e-5e62-4185-94cb-238d9dade271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:25.166089 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-bf7e0e8e-5e62-4185-94cb-238d9dade271 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:35:25.167272 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-bf7e0e8e-5e62-4185-94cb-238d9dade271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:35:25.210747 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:35:25.233266 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1330/2678] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:35:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:35:25.243931 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a565c-3d0e-4d53-949a-581a3c97d717 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:25.244373 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a565c-3d0e-4d53-949a-581a3c97d717 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:25.244820 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a565c-3d0e-4d53-949a-581a3c97d717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:25.269156 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-762a565c-3d0e-4d53-949a-581a3c97d717 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:35:25.270645 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-762a565c-3d0e-4d53-949a-581a3c97d717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:35:25.282690 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1349/2679] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:35:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:35:25.284527 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e0e8e-5e62-4185-94cb-238d9dade271 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:25.295719 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e0e8e-5e62-4185-94cb-238d9dade271 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:25.307767 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da779a1-7ec5-4fcf-8ebb-0ce5c50e49dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:25.308530 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da779a1-7ec5-4fcf-8ebb-0ce5c50e49dc admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:25.308913 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da779a1-7ec5-4fcf-8ebb-0ce5c50e49dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:25.309291 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da779a1-7ec5-4fcf-8ebb-0ce5c50e49dc admin admin] PATH_INFO: `/v3/domains` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:25.310060 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da779a1-7ec5-4fcf-8ebb-0ce5c50e49dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:35:25.310602 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da779a1-7ec5-4fcf-8ebb-0ce5c50e49dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:25.312361 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da779a1-7ec5-4fcf-8ebb-0ce5c50e49dc admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:25.329308 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1331/2680] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 05:35:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:35:25.330476 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a565c-3d0e-4d53-949a-581a3c97d717 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:25.341393 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a565c-3d0e-4d53-949a-581a3c97d717 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:25.347966 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d095b9-70dc-4450-9a4d-990ebf2bc4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:25.349056 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d095b9-70dc-4450-9a4d-990ebf2bc4fa admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:25.349564 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d095b9-70dc-4450-9a4d-990ebf2bc4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:25.350054 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d095b9-70dc-4450-9a4d-990ebf2bc4fa admin admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:25.351639 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d095b9-70dc-4450-9a4d-990ebf2bc4fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:25.355354 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d095b9-70dc-4450-9a4d-990ebf2bc4fa admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:25.394719 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1350/2681] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:35:25 2022] POST /identity/v3/projects => generated 371 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:35:25.398608 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da779a1-7ec5-4fcf-8ebb-0ce5c50e49dc admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:25.431816 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da779a1-7ec5-4fcf-8ebb-0ce5c50e49dc admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:25.517859 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854e6b90-e7a8-4e66-a2f4-e28e611d2c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:25.519053 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e6b90-e7a8-4e66-a2f4-e28e611d2c7f admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:25.519337 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e6b90-e7a8-4e66-a2f4-e28e611d2c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:25.519613 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e6b90-e7a8-4e66-a2f4-e28e611d2c7f admin admin] PATH_INFO: `/v3/users` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:25.520285 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854e6b90-e7a8-4e66-a2f4-e28e611d2c7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:25.522226 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854e6b90-e7a8-4e66-a2f4-e28e611d2c7f admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:25.550706 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1332/2682] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:35:25 2022] POST /identity/v3/users => generated 286 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:35:25.552739 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d095b9-70dc-4450-9a4d-990ebf2bc4fa admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:25.565508 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d095b9-70dc-4450-9a4d-990ebf2bc4fa admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:25.574115 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0f0e03-7465-47f8-90dd-09ea07f82ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:25.574994 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f0e03-7465-47f8-90dd-09ea07f82ae3 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:25.575246 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f0e03-7465-47f8-90dd-09ea07f82ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:25.575504 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f0e03-7465-47f8-90dd-09ea07f82ae3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:25.576211 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0f0e03-7465-47f8-90dd-09ea07f82ae3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:25.577906 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0f0e03-7465-47f8-90dd-09ea07f82ae3 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:25.591782 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1351/2683] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:35:25 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:35:25.592903 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854e6b90-e7a8-4e66-a2f4-e28e611d2c7f admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:25.606051 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854e6b90-e7a8-4e66-a2f4-e28e611d2c7f admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:25.613264 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9ee00b-e611-4505-9aa6-8dddcf97d3a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:25.614007 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ee00b-e611-4505-9aa6-8dddcf97d3a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:25.614391 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ee00b-e611-4505-9aa6-8dddcf97d3a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:25.614670 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ee00b-e611-4505-9aa6-8dddcf97d3a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:25.615338 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9ee00b-e611-4505-9aa6-8dddcf97d3a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:25.617040 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9ee00b-e611-4505-9aa6-8dddcf97d3a9 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:25.630259 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1333/2684] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:35:25 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 05:35:25.634537 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0f0e03-7465-47f8-90dd-09ea07f82ae3 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:25.646279 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0f0e03-7465-47f8-90dd-09ea07f82ae3 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:25.651819 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da14265-ed16-40bb-a43b-13a7cbf8715a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:25.652495 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da14265-ed16-40bb-a43b-13a7cbf8715a admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:25.652775 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da14265-ed16-40bb-a43b-13a7cbf8715a admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:25.653044 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da14265-ed16-40bb-a43b-13a7cbf8715a admin admin] PATH_INFO: `/v3/projects/b49afe3b4d2e49aeb6100b9cd072a17d/users/72f9dbd0fb6b46f7b88337d49d2bde45/roles/aa7ff8e0ec1e48e5811335b9eb38b448` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:25.670476 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da14265-ed16-40bb-a43b-13a7cbf8715a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b49afe3b4d2e49aeb6100b9cd072a17d, user_id=72f9dbd0fb6b46f7b88337d49d2bde45, role_id=aa7ff8e0ec1e48e5811335b9eb38b448)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:25.673215 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da14265-ed16-40bb-a43b-13a7cbf8715a admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:25.689276 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1352/2685] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:35:25 2022] PUT /identity/v3/projects/b49afe3b4d2e49aeb6100b9cd072a17d/users/72f9dbd0fb6b46f7b88337d49d2bde45/roles/aa7ff8e0ec1e48e5811335b9eb38b448 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:35:25.694483 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861d4e0-10aa-41f5-98da-30949e8a324e None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:25.695032 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861d4e0-10aa-41f5-98da-30949e8a324e None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:25.695392 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861d4e0-10aa-41f5-98da-30949e8a324e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:25.716226 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-8861d4e0-10aa-41f5-98da-30949e8a324e None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:35:25.717851 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-8861d4e0-10aa-41f5-98da-30949e8a324e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:35:25.786803 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1334/2686] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:35:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 05:35:25.799965 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da14265-ed16-40bb-a43b-13a7cbf8715a admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:25.801825 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-3da14265-ed16-40bb-a43b-13a7cbf8715a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:35:25.866921 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da14265-ed16-40bb-a43b-13a7cbf8715a admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:25.870854 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c547ff-209c-4d70-bf35-8a3150827d3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:25.871461 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c547ff-209c-4d70-bf35-8a3150827d3c service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:25.871798 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c547ff-209c-4d70-bf35-8a3150827d3c service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:25.872058 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c547ff-209c-4d70-bf35-8a3150827d3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:25.882937 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c547ff-209c-4d70-bf35-8a3150827d3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:25.883289 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c547ff-209c-4d70-bf35-8a3150827d3c service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:25.894562 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1353/2687] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:35:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:35:26.947798 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b07e29-b713-489a-b5fb-ab77cba00024 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:26.948389 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b07e29-b713-489a-b5fb-ab77cba00024 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:26.948628 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b07e29-b713-489a-b5fb-ab77cba00024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:26.981347 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-85b07e29-b713-489a-b5fb-ab77cba00024 None None] MFA Rules not processed for user `72f9dbd0fb6b46f7b88337d49d2bde45`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:35:26.982643 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-85b07e29-b713-489a-b5fb-ab77cba00024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:35:27.049994 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:35:27.095745 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1335/2688] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:35:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:35:27.098924 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c547ff-209c-4d70-bf35-8a3150827d3c service neutron] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:27.111391 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c547ff-209c-4d70-bf35-8a3150827d3c service neutron] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:27.116775 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec99a3c-46f1-4687-b273-f0aee32ce472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:27.117471 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec99a3c-46f1-4687-b273-f0aee32ce472 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:27.117932 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec99a3c-46f1-4687-b273-f0aee32ce472 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:27.118219 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec99a3c-46f1-4687-b273-f0aee32ce472 admin admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:27.119032 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec99a3c-46f1-4687-b273-f0aee32ce472 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:27.121015 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec99a3c-46f1-4687-b273-f0aee32ce472 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:27.156204 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b07e29-b713-489a-b5fb-ab77cba00024 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:27.158761 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1354/2689] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:35:27 2022] POST /identity/v3/projects => generated 371 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:35:27.170346 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b07e29-b713-489a-b5fb-ab77cba00024 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:27.246338 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74438b65-9630-4d92-b6f8-5482d32608ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:27.247012 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74438b65-9630-4d92-b6f8-5482d32608ac admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:27.247297 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74438b65-9630-4d92-b6f8-5482d32608ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:27.253924 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74438b65-9630-4d92-b6f8-5482d32608ac admin admin] PATH_INFO: `/v3/users` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:27.254647 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74438b65-9630-4d92-b6f8-5482d32608ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:27.256614 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74438b65-9630-4d92-b6f8-5482d32608ac admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:27.283752 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1336/2690] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:35:27 2022] POST /identity/v3/users => generated 292 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 05:35:27.287196 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec99a3c-46f1-4687-b273-f0aee32ce472 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:27.301812 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec99a3c-46f1-4687-b273-f0aee32ce472 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:27.307295 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1875b91d-0ca3-4b4c-af8c-9ccccdee1ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:27.308047 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1875b91d-0ca3-4b4c-af8c-9ccccdee1ce7 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:27.308394 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1875b91d-0ca3-4b4c-af8c-9ccccdee1ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:27.308736 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1875b91d-0ca3-4b4c-af8c-9ccccdee1ce7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:27.309599 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1875b91d-0ca3-4b4c-af8c-9ccccdee1ce7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:27.311281 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1875b91d-0ca3-4b4c-af8c-9ccccdee1ce7 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:27.327534 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1355/2691] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:35:27 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:35:27.328063 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74438b65-9630-4d92-b6f8-5482d32608ac admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:27.330291 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-74438b65-9630-4d92-b6f8-5482d32608ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:35:27.331546 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1875b91d-0ca3-4b4c-af8c-9ccccdee1ce7 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:27.341875 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1875b91d-0ca3-4b4c-af8c-9ccccdee1ce7 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:27.347911 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafd87c7-316b-4649-a41c-62057bd8d751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:27.349376 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd87c7-316b-4649-a41c-62057bd8d751 admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:27.349664 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd87c7-316b-4649-a41c-62057bd8d751 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:27.349950 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd87c7-316b-4649-a41c-62057bd8d751 admin admin] PATH_INFO: `/v3/projects/eb1e1b2f61ee44b3bc01a17957791b90/users/a9fcdc6056ea4771abc50d9c09e73dc7/roles/5b702713e40145b49e0b42abd0a5fba9` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:27.360836 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:35:27.371448 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafd87c7-316b-4649-a41c-62057bd8d751 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb1e1b2f61ee44b3bc01a17957791b90, user_id=a9fcdc6056ea4771abc50d9c09e73dc7, role_id=5b702713e40145b49e0b42abd0a5fba9)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:27.382363 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafd87c7-316b-4649-a41c-62057bd8d751 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:27.403780 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1356/2692] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:35:27 2022] PUT /identity/v3/projects/eb1e1b2f61ee44b3bc01a17957791b90/users/a9fcdc6056ea4771abc50d9c09e73dc7/roles/5b702713e40145b49e0b42abd0a5fba9 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:35:27.403780 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafd87c7-316b-4649-a41c-62057bd8d751 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:27.403780 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-fafd87c7-316b-4649-a41c-62057bd8d751 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:35:27.421119 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74438b65-9630-4d92-b6f8-5482d32608ac admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:27.481339 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafd87c7-316b-4649-a41c-62057bd8d751 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:27.486617 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2003ed89-1469-4df2-9d92-db17fce083a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:27.489583 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003ed89-1469-4df2-9d92-db17fce083a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:27.489857 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003ed89-1469-4df2-9d92-db17fce083a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:27.490207 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003ed89-1469-4df2-9d92-db17fce083a2 admin admin] PATH_INFO: `/v3/users/5f449d21dca9413698012f0258f79b08` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:27.491338 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2003ed89-1469-4df2-9d92-db17fce083a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f449d21dca9413698012f0258f79b08)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:27.493340 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2003ed89-1469-4df2-9d92-db17fce083a2 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:27.494079 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97be4995-4df9-493e-8655-82ec2a6151f4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72e1d7dd79ff43e7b585b5090762465f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:27.494981 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be4995-4df9-493e-8655-82ec2a6151f4 service placement] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:27.495367 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be4995-4df9-493e-8655-82ec2a6151f4 service placement] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:27.495772 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be4995-4df9-493e-8655-82ec2a6151f4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:27.497670 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-97be4995-4df9-493e-8655-82ec2a6151f4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:35:27.510638 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97be4995-4df9-493e-8655-82ec2a6151f4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:27.512401 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97be4995-4df9-493e-8655-82ec2a6151f4 service placement] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:27.523814 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1337/2693] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:35:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 05:35:27.524588 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97be4995-4df9-493e-8655-82ec2a6151f4 service placement] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:27.531582 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:35:27.536632 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97be4995-4df9-493e-8655-82ec2a6151f4 service placement] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:27.547289 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd552a9-43da-4b78-8e49-43d36ebf1dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:27.548062 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd552a9-43da-4b78-8e49-43d36ebf1dd4 admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:27.548440 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd552a9-43da-4b78-8e49-43d36ebf1dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:27.548818 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd552a9-43da-4b78-8e49-43d36ebf1dd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:27.550368 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd552a9-43da-4b78-8e49-43d36ebf1dd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:27.551978 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd552a9-43da-4b78-8e49-43d36ebf1dd4 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:27.555642 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-2003ed89-1469-4df2-9d92-db17fce083a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f449d21dca9413698012f0258f79b08'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:27.564971 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1338/2694] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:35:27 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:35:27.569976 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd552a9-43da-4b78-8e49-43d36ebf1dd4 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:27.575187 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-2003ed89-1469-4df2-9d92-db17fce083a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f449d21dca9413698012f0258f79b08'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:27.580066 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd552a9-43da-4b78-8e49-43d36ebf1dd4 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:27.582982 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-2003ed89-1469-4df2-9d92-db17fce083a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f449d21dca9413698012f0258f79b08'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:27.584856 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d38447-97f9-40b4-aac5-527864a3de68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:27.585499 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d38447-97f9-40b4-aac5-527864a3de68 admin admin] REQUEST_METHOD: `PUT` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:27.585775 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d38447-97f9-40b4-aac5-527864a3de68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:27.586051 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d38447-97f9-40b4-aac5-527864a3de68 admin admin] PATH_INFO: `/v3/projects/eb1e1b2f61ee44b3bc01a17957791b90/users/a9fcdc6056ea4771abc50d9c09e73dc7/roles/5b702713e40145b49e0b42abd0a5fba9` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:27.588065 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d38447-97f9-40b4-aac5-527864a3de68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb1e1b2f61ee44b3bc01a17957791b90, user_id=a9fcdc6056ea4771abc50d9c09e73dc7, role_id=5b702713e40145b49e0b42abd0a5fba9)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:27.591454 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d38447-97f9-40b4-aac5-527864a3de68 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:27.592711 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-2003ed89-1469-4df2-9d92-db17fce083a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f449d21dca9413698012f0258f79b08'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:27.593370 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-2003ed89-1469-4df2-9d92-db17fce083a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f449d21dca9413698012f0258f79b08'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:27.600157 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1357/2695] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:35:27 2022] DELETE /identity/v3/users/5f449d21dca9413698012f0258f79b08 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:35:27.602624 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1339/2696] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:35:27 2022] PUT /identity/v3/projects/eb1e1b2f61ee44b3bc01a17957791b90/users/a9fcdc6056ea4771abc50d9c09e73dc7/roles/5b702713e40145b49e0b42abd0a5fba9 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 05:35:27.781444 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2003ed89-1469-4df2-9d92-db17fce083a2 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:27.788955 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-2003ed89-1469-4df2-9d92-db17fce083a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:35:27.871922 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2003ed89-1469-4df2-9d92-db17fce083a2 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:27.877140 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da7b322-1509-4e34-9e47-0a4948d69f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:27.877798 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7b322-1509-4e34-9e47-0a4948d69f79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:27.878076 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7b322-1509-4e34-9e47-0a4948d69f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:27.878350 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7b322-1509-4e34-9e47-0a4948d69f79 admin admin] PATH_INFO: `/v3/projects/a8146b7067a04a3f9c5a4d0bcde240ff` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:27.879478 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da7b322-1509-4e34-9e47-0a4948d69f79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8146b7067a04a3f9c5a4d0bcde240ff)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:27.881517 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da7b322-1509-4e34-9e47-0a4948d69f79 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:27.889643 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:35:27.940331 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-5da7b322-1509-4e34-9e47-0a4948d69f79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8146b7067a04a3f9c5a4d0bcde240ff', 'request_id': 'req-5da7b322-1509-4e34-9e47-0a4948d69f79'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:27.949810 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-5da7b322-1509-4e34-9e47-0a4948d69f79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8146b7067a04a3f9c5a4d0bcde240ff', 'request_id': 'req-5da7b322-1509-4e34-9e47-0a4948d69f79'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:27.960375 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-5da7b322-1509-4e34-9e47-0a4948d69f79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8146b7067a04a3f9c5a4d0bcde240ff', 'request_id': 'req-5da7b322-1509-4e34-9e47-0a4948d69f79'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:27.976962 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-5da7b322-1509-4e34-9e47-0a4948d69f79 admin admin] The token cache is being invalidate because project a8146b7067a04a3f9c5a4d0bcde240ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:35:27.977350 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-5da7b322-1509-4e34-9e47-0a4948d69f79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:27.978128 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-5da7b322-1509-4e34-9e47-0a4948d69f79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:27.980762 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1358/2697] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:35:27 2022] DELETE /identity/v3/projects/a8146b7067a04a3f9c5a4d0bcde240ff => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:35:27.984650 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d38447-97f9-40b4-aac5-527864a3de68 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:27.987556 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-c6d38447-97f9-40b4-aac5-527864a3de68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:35:28.060384 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d38447-97f9-40b4-aac5-527864a3de68 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:28.118440 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e076d4-9727-43b8-9b9f-f876d5049686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:28.119081 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e076d4-9727-43b8-9b9f-f876d5049686 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:28.119357 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e076d4-9727-43b8-9b9f-f876d5049686 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:28.119626 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e076d4-9727-43b8-9b9f-f876d5049686 admin admin] PATH_INFO: `/v3/users/f153fd710ba24a96a024b184a91a6557` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:28.121126 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e076d4-9727-43b8-9b9f-f876d5049686 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f153fd710ba24a96a024b184a91a6557)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:28.123115 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e076d4-9727-43b8-9b9f-f876d5049686 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:28.174852 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-36e076d4-9727-43b8-9b9f-f876d5049686 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f153fd710ba24a96a024b184a91a6557'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:28.188177 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-36e076d4-9727-43b8-9b9f-f876d5049686 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f153fd710ba24a96a024b184a91a6557'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:28.196238 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-36e076d4-9727-43b8-9b9f-f876d5049686 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f153fd710ba24a96a024b184a91a6557'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:28.204839 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-36e076d4-9727-43b8-9b9f-f876d5049686 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f153fd710ba24a96a024b184a91a6557'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:28.206618 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-36e076d4-9727-43b8-9b9f-f876d5049686 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f153fd710ba24a96a024b184a91a6557'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:28.219752 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1340/2698] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:35:27 2022] DELETE /identity/v3/users/f153fd710ba24a96a024b184a91a6557 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:35:28.377373 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163de665-bb6f-4a08-bc56-f8fa3808d6c9 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:28.378152 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163de665-bb6f-4a08-bc56-f8fa3808d6c9 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:28.379514 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163de665-bb6f-4a08-bc56-f8fa3808d6c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:28.451093 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e076d4-9727-43b8-9b9f-f876d5049686 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:28.452631 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-36e076d4-9727-43b8-9b9f-f876d5049686 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:35:28.463149 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-163de665-bb6f-4a08-bc56-f8fa3808d6c9 None None] MFA Rules not processed for user `a9fcdc6056ea4771abc50d9c09e73dc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:35:28.464837 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:35:28.465479 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-163de665-bb6f-4a08-bc56-f8fa3808d6c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:35:28.559324 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e076d4-9727-43b8-9b9f-f876d5049686 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:28.566936 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6261aa-4707-4093-a8a7-930a6aef17c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:28.567939 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6261aa-4707-4093-a8a7-930a6aef17c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:28.569314 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6261aa-4707-4093-a8a7-930a6aef17c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:28.569862 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6261aa-4707-4093-a8a7-930a6aef17c1 admin admin] PATH_INFO: `/v3/projects/afd7733b5dc04f7b9107ddaee16d27fe` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:28.571913 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6261aa-4707-4093-a8a7-930a6aef17c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=afd7733b5dc04f7b9107ddaee16d27fe)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:28.576554 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6261aa-4707-4093-a8a7-930a6aef17c1 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:28.633846 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1359/2699] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:35:28 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:35:28.651730 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6121f60b-153a-4e41-a339-9a34986ff3a2 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:28.652268 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6121f60b-153a-4e41-a339-9a34986ff3a2 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:28.652746 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6121f60b-153a-4e41-a339-9a34986ff3a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:28.655423 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-4e6261aa-4707-4093-a8a7-930a6aef17c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afd7733b5dc04f7b9107ddaee16d27fe', 'request_id': 'req-4e6261aa-4707-4093-a8a7-930a6aef17c1'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:28.665864 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-4e6261aa-4707-4093-a8a7-930a6aef17c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afd7733b5dc04f7b9107ddaee16d27fe', 'request_id': 'req-4e6261aa-4707-4093-a8a7-930a6aef17c1'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:28.673270 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-4e6261aa-4707-4093-a8a7-930a6aef17c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afd7733b5dc04f7b9107ddaee16d27fe', 'request_id': 'req-4e6261aa-4707-4093-a8a7-930a6aef17c1'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:28.677618 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-6121f60b-153a-4e41-a339-9a34986ff3a2 None None] MFA Rules not processed for user `72f9dbd0fb6b46f7b88337d49d2bde45`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:35:28.679724 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-6121f60b-153a-4e41-a339-9a34986ff3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:35:28.691033 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-4e6261aa-4707-4093-a8a7-930a6aef17c1 admin admin] The token cache is being invalidate because project afd7733b5dc04f7b9107ddaee16d27fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81383) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:35:28.691418 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-4e6261aa-4707-4093-a8a7-930a6aef17c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:28.693306 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-4e6261aa-4707-4093-a8a7-930a6aef17c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:35:28.695967 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1341/2700] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:35:28 2022] DELETE /identity/v3/projects/afd7733b5dc04f7b9107ddaee16d27fe => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 05:35:28.808489 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1360/2701] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:35:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:35:28.827891 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6261aa-4707-4093-a8a7-930a6aef17c1 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:28.832291 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-4e6261aa-4707-4093-a8a7-930a6aef17c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:35:28.953349 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6261aa-4707-4093-a8a7-930a6aef17c1 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:28.960672 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6d79dd-14b7-4702-9c7e-cde0f7269de4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cd6136036bd467c946cae90d5c29263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:28.961302 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d79dd-14b7-4702-9c7e-cde0f7269de4 service nova] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:28.961582 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d79dd-14b7-4702-9c7e-cde0f7269de4 service nova] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:28.961854 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d79dd-14b7-4702-9c7e-cde0f7269de4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:28.963664 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-6d6d79dd-14b7-4702-9c7e-cde0f7269de4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:35:28.977345 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6d79dd-14b7-4702-9c7e-cde0f7269de4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:28.979191 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6d79dd-14b7-4702-9c7e-cde0f7269de4 service nova] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:28.990878 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1342/2702] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:35:28 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:35:29.221763 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6121f60b-153a-4e41-a339-9a34986ff3a2 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:29.223156 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-6121f60b-153a-4e41-a339-9a34986ff3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:35:29.268276 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:35:29.300185 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6121f60b-153a-4e41-a339-9a34986ff3a2 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:29.303857 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec86244-acab-4c8a-9d77-fe7a6421b446 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:29.304466 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec86244-acab-4c8a-9d77-fe7a6421b446 service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:29.304744 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec86244-acab-4c8a-9d77-fe7a6421b446 service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:29.305019 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec86244-acab-4c8a-9d77-fe7a6421b446 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:29.306754 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-1ec86244-acab-4c8a-9d77-fe7a6421b446 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:35:29.317045 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec86244-acab-4c8a-9d77-fe7a6421b446 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:29.318510 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec86244-acab-4c8a-9d77-fe7a6421b446 service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:29.326556 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1361/2703] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:35:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:35:37.001018 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6d79dd-14b7-4702-9c7e-cde0f7269de4 service nova] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:37.003184 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-6d6d79dd-14b7-4702-9c7e-cde0f7269de4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:35:37.018847 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6d79dd-14b7-4702-9c7e-cde0f7269de4 service nova] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:37.024595 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9541a84d-8f01-41cb-949f-0c1169b50ab9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cd6136036bd467c946cae90d5c29263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:37.025472 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9541a84d-8f01-41cb-949f-0c1169b50ab9 service nova] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:37.025754 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9541a84d-8f01-41cb-949f-0c1169b50ab9 service nova] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:37.026025 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9541a84d-8f01-41cb-949f-0c1169b50ab9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:37.027779 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-9541a84d-8f01-41cb-949f-0c1169b50ab9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:35:37.040328 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9541a84d-8f01-41cb-949f-0c1169b50ab9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:37.041934 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9541a84d-8f01-41cb-949f-0c1169b50ab9 service nova] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:37.054089 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1343/2704] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:35:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:35:39.323059 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=14 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:35:41.965361 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec86244-acab-4c8a-9d77-fe7a6421b446 service neutron] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:41.966774 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-1ec86244-acab-4c8a-9d77-fe7a6421b446 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:35:42.025381 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec86244-acab-4c8a-9d77-fe7a6421b446 service neutron] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:42.029490 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec56d5-7484-4208-802d-0faa24a96e27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a147e14b61d481db1cac02c58ac3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:42.030143 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec56d5-7484-4208-802d-0faa24a96e27 service cinder] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:42.030426 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec56d5-7484-4208-802d-0faa24a96e27 service cinder] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:42.030700 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec56d5-7484-4208-802d-0faa24a96e27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:42.032669 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-98ec56d5-7484-4208-802d-0faa24a96e27 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:35:42.101259 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ec56d5-7484-4208-802d-0faa24a96e27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:42.102727 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ec56d5-7484-4208-802d-0faa24a96e27 service cinder] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:42.113149 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1362/2705] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:35:41 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:35:45.730346 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c885453-9aaa-454d-9f1e-80965727e85a None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:45.730920 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c885453-9aaa-454d-9f1e-80965727e85a None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:45.730920 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c885453-9aaa-454d-9f1e-80965727e85a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:45.750367 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-1c885453-9aaa-454d-9f1e-80965727e85a None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:35:45.751562 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-1c885453-9aaa-454d-9f1e-80965727e85a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:35:45.756283 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:35:45.815524 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1344/2706] 10.222.0.43 () {58 vars in 1016 bytes} [Sun Sep 11 05:35:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:35:45.831941 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec56d5-7484-4208-802d-0faa24a96e27 service cinder] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:45.844230 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec56d5-7484-4208-802d-0faa24a96e27 service cinder] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:45.849572 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63193b22-6e77-478e-8078-c67c33e20e80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cd6136036bd467c946cae90d5c29263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:45.850160 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63193b22-6e77-478e-8078-c67c33e20e80 service nova] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:45.850450 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63193b22-6e77-478e-8078-c67c33e20e80 service nova] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:45.850702 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63193b22-6e77-478e-8078-c67c33e20e80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:45.858727 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63193b22-6e77-478e-8078-c67c33e20e80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:45.860607 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63193b22-6e77-478e-8078-c67c33e20e80 service nova] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:45.869744 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1363/2707] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:35:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:35:48.758464 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50897bfa-a0f2-4f97-ad70-af5c8ccf74a7 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:48.758990 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50897bfa-a0f2-4f97-ad70-af5c8ccf74a7 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:48.758990 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50897bfa-a0f2-4f97-ad70-af5c8ccf74a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:48.778962 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-50897bfa-a0f2-4f97-ad70-af5c8ccf74a7 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:35:48.780203 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-50897bfa-a0f2-4f97-ad70-af5c8ccf74a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:35:48.788873 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1345/2708] 10.222.0.43 () {58 vars in 1016 bytes} [Sun Sep 11 05:35:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:35:48.802713 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63193b22-6e77-478e-8078-c67c33e20e80 service nova] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:48.813966 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63193b22-6e77-478e-8078-c67c33e20e80 service nova] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:48.820142 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5244a98-91fa-426d-8aa1-17feb77fa9b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cd6136036bd467c946cae90d5c29263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:48.820748 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5244a98-91fa-426d-8aa1-17feb77fa9b3 service nova] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:48.821040 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5244a98-91fa-426d-8aa1-17feb77fa9b3 service nova] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:48.821309 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5244a98-91fa-426d-8aa1-17feb77fa9b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:48.830190 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5244a98-91fa-426d-8aa1-17feb77fa9b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:48.832461 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5244a98-91fa-426d-8aa1-17feb77fa9b3 service nova] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:48.842851 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1364/2709] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:35:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:35:52.015900 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ecf399-ef7a-4259-ab77-8341f3e3604d None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:52.016459 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ecf399-ef7a-4259-ab77-8341f3e3604d None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:52.016459 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ecf399-ef7a-4259-ab77-8341f3e3604d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:52.036432 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-66ecf399-ef7a-4259-ab77-8341f3e3604d None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:35:52.037628 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-66ecf399-ef7a-4259-ab77-8341f3e3604d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:35:52.045666 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1346/2710] 10.222.0.43 () {58 vars in 1016 bytes} [Sun Sep 11 05:35:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:35:52.062757 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5244a98-91fa-426d-8aa1-17feb77fa9b3 service nova] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:52.074450 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5244a98-91fa-426d-8aa1-17feb77fa9b3 service nova] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:52.079789 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5d98fb-1bc0-4515-8b3a-51e315c90181 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cd6136036bd467c946cae90d5c29263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:52.080375 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5d98fb-1bc0-4515-8b3a-51e315c90181 service nova] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:52.080649 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5d98fb-1bc0-4515-8b3a-51e315c90181 service nova] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:52.080923 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5d98fb-1bc0-4515-8b3a-51e315c90181 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:52.088752 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5d98fb-1bc0-4515-8b3a-51e315c90181 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:52.090310 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5d98fb-1bc0-4515-8b3a-51e315c90181 service nova] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:52.099461 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1365/2711] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:35:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 05:35:55.106322 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4282b3e-f120-4587-ab2e-a8bac85de712 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:55.106841 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4282b3e-f120-4587-ab2e-a8bac85de712 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:55.106841 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4282b3e-f120-4587-ab2e-a8bac85de712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:55.126574 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-f4282b3e-f120-4587-ab2e-a8bac85de712 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:35:55.127784 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-f4282b3e-f120-4587-ab2e-a8bac85de712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:35:55.136183 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1347/2712] 10.222.0.43 () {58 vars in 1016 bytes} [Sun Sep 11 05:35:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:35:55.152414 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5d98fb-1bc0-4515-8b3a-51e315c90181 service nova] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:55.164041 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5d98fb-1bc0-4515-8b3a-51e315c90181 service nova] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:55.169581 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d39183-e90d-490d-88f1-80ee5c86d585 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cd6136036bd467c946cae90d5c29263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:55.170170 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d39183-e90d-490d-88f1-80ee5c86d585 service nova] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:55.170448 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d39183-e90d-490d-88f1-80ee5c86d585 service nova] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:55.170716 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d39183-e90d-490d-88f1-80ee5c86d585 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:55.179151 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d39183-e90d-490d-88f1-80ee5c86d585 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:55.180758 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d39183-e90d-490d-88f1-80ee5c86d585 service nova] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:55.190357 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1366/2713] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:35:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:35:58.284712 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d868f88c-d76d-450b-a9be-04a9cedb31a5 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:58.285219 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d868f88c-d76d-450b-a9be-04a9cedb31a5 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:58.285341 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d868f88c-d76d-450b-a9be-04a9cedb31a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:58.305665 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-d868f88c-d76d-450b-a9be-04a9cedb31a5 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:35:58.306946 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-d868f88c-d76d-450b-a9be-04a9cedb31a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:35:58.315482 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1348/2714] 10.222.0.43 () {58 vars in 1016 bytes} [Sun Sep 11 05:35:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:35:58.335426 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d39183-e90d-490d-88f1-80ee5c86d585 service nova] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:35:58.348040 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d39183-e90d-490d-88f1-80ee5c86d585 service nova] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:35:58.360899 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f6068c-9eb3-4f8e-b51d-89bcd2ccd722 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cd6136036bd467c946cae90d5c29263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:35:58.360899 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f6068c-9eb3-4f8e-b51d-89bcd2ccd722 service nova] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:35:58.360899 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f6068c-9eb3-4f8e-b51d-89bcd2ccd722 service nova] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:35:58.360899 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f6068c-9eb3-4f8e-b51d-89bcd2ccd722 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:35:58.366187 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f6068c-9eb3-4f8e-b51d-89bcd2ccd722 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:35:58.367805 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f6068c-9eb3-4f8e-b51d-89bcd2ccd722 service nova] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:35:58.378743 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1367/2715] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:35:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:36:01.840242 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d868f88c-d76d-450b-a9be-04a9cedb31a5 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:36:01.843023 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-d868f88c-d76d-450b-a9be-04a9cedb31a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:36:01.858533 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d868f88c-d76d-450b-a9be-04a9cedb31a5 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:36:01.868052 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfa7a73-ce10-40a2-bd67-0631e63e5518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:36:01.868757 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfa7a73-ce10-40a2-bd67-0631e63e5518 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:36:01.869031 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfa7a73-ce10-40a2-bd67-0631e63e5518 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:36:01.869520 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfa7a73-ce10-40a2-bd67-0631e63e5518 admin admin] PATH_INFO: `/v3/users/72f9dbd0fb6b46f7b88337d49d2bde45` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:36:01.871550 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfa7a73-ce10-40a2-bd67-0631e63e5518 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72f9dbd0fb6b46f7b88337d49d2bde45)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:36:01.873763 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfa7a73-ce10-40a2-bd67-0631e63e5518 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:36:01.952247 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-3dfa7a73-ce10-40a2-bd67-0631e63e5518 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72f9dbd0fb6b46f7b88337d49d2bde45'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:36:01.971834 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-3dfa7a73-ce10-40a2-bd67-0631e63e5518 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72f9dbd0fb6b46f7b88337d49d2bde45'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:36:01.979607 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-3dfa7a73-ce10-40a2-bd67-0631e63e5518 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72f9dbd0fb6b46f7b88337d49d2bde45'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:36:01.990362 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-3dfa7a73-ce10-40a2-bd67-0631e63e5518 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72f9dbd0fb6b46f7b88337d49d2bde45'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:36:01.991080 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-3dfa7a73-ce10-40a2-bd67-0631e63e5518 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72f9dbd0fb6b46f7b88337d49d2bde45'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:36:01.997913 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1349/2716] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:36:01 2022] DELETE /identity/v3/users/72f9dbd0fb6b46f7b88337d49d2bde45 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:36:02.174201 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f6068c-9eb3-4f8e-b51d-89bcd2ccd722 service nova] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:36:02.186657 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f6068c-9eb3-4f8e-b51d-89bcd2ccd722 service nova] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:36:02.237152 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:36:02.268614 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d979f9-3194-4f30-8c4f-3d58b66a3f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:36:02.269808 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d979f9-3194-4f30-8c4f-3d58b66a3f8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:36:02.270272 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d979f9-3194-4f30-8c4f-3d58b66a3f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:36:02.270693 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d979f9-3194-4f30-8c4f-3d58b66a3f8f admin admin] PATH_INFO: `/v3/projects/b49afe3b4d2e49aeb6100b9cd072a17d` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:36:02.273274 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d979f9-3194-4f30-8c4f-3d58b66a3f8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b49afe3b4d2e49aeb6100b9cd072a17d)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:36:02.288517 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d979f9-3194-4f30-8c4f-3d58b66a3f8f admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:36:02.358061 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-a3d979f9-3194-4f30-8c4f-3d58b66a3f8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b49afe3b4d2e49aeb6100b9cd072a17d', 'request_id': 'req-a3d979f9-3194-4f30-8c4f-3d58b66a3f8f'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:36:02.365430 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-a3d979f9-3194-4f30-8c4f-3d58b66a3f8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b49afe3b4d2e49aeb6100b9cd072a17d', 'request_id': 'req-a3d979f9-3194-4f30-8c4f-3d58b66a3f8f'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:36:02.371285 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-a3d979f9-3194-4f30-8c4f-3d58b66a3f8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b49afe3b4d2e49aeb6100b9cd072a17d', 'request_id': 'req-a3d979f9-3194-4f30-8c4f-3d58b66a3f8f'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:36:02.388307 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-a3d979f9-3194-4f30-8c4f-3d58b66a3f8f admin admin] The token cache is being invalidate because project b49afe3b4d2e49aeb6100b9cd072a17d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:36:02.388496 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-a3d979f9-3194-4f30-8c4f-3d58b66a3f8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:36:02.389306 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-a3d979f9-3194-4f30-8c4f-3d58b66a3f8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:36:02.391180 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1368/2717] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:36:02 2022] DELETE /identity/v3/projects/b49afe3b4d2e49aeb6100b9cd072a17d => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:36:02.395176 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfa7a73-ce10-40a2-bd67-0631e63e5518 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:36:02.396898 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-3dfa7a73-ce10-40a2-bd67-0631e63e5518 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:36:02.414268 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfa7a73-ce10-40a2-bd67-0631e63e5518 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:36:02.478190 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:36:02.486973 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3829b23c-0dd4-4f85-942d-1d6cca4c4a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:36:02.487921 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3829b23c-0dd4-4f85-942d-1d6cca4c4a59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:36:02.488592 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3829b23c-0dd4-4f85-942d-1d6cca4c4a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:36:02.488873 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3829b23c-0dd4-4f85-942d-1d6cca4c4a59 admin admin] PATH_INFO: `/v3/users/a9fcdc6056ea4771abc50d9c09e73dc7` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:36:02.496802 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3829b23c-0dd4-4f85-942d-1d6cca4c4a59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9fcdc6056ea4771abc50d9c09e73dc7)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:36:02.499180 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3829b23c-0dd4-4f85-942d-1d6cca4c4a59 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:36:02.499673 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b324a-e442-45ce-aea6-3c3d30b26415 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:36:02.500543 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b324a-e442-45ce-aea6-3c3d30b26415 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:36:02.500543 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b324a-e442-45ce-aea6-3c3d30b26415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:36:02.525953 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-939b324a-e442-45ce-aea6-3c3d30b26415 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:36:02.527544 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-939b324a-e442-45ce-aea6-3c3d30b26415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:36:02.536994 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1369/2718] 10.222.0.43 () {58 vars in 1016 bytes} [Sun Sep 11 05:36:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 05:36:02.550987 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-3829b23c-0dd4-4f85-942d-1d6cca4c4a59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9fcdc6056ea4771abc50d9c09e73dc7'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:36:02.559874 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b324a-e442-45ce-aea6-3c3d30b26415 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:36:02.561330 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-939b324a-e442-45ce-aea6-3c3d30b26415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:36:02.566536 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-3829b23c-0dd4-4f85-942d-1d6cca4c4a59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9fcdc6056ea4771abc50d9c09e73dc7'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:36:02.574987 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-3829b23c-0dd4-4f85-942d-1d6cca4c4a59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9fcdc6056ea4771abc50d9c09e73dc7'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:36:02.584229 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-3829b23c-0dd4-4f85-942d-1d6cca4c4a59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9fcdc6056ea4771abc50d9c09e73dc7'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:36:02.584921 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-3829b23c-0dd4-4f85-942d-1d6cca4c4a59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9fcdc6056ea4771abc50d9c09e73dc7'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:36:02.592033 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1350/2719] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:36:02 2022] DELETE /identity/v3/users/a9fcdc6056ea4771abc50d9c09e73dc7 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:36:02.644315 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b324a-e442-45ce-aea6-3c3d30b26415 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:36:02.709996 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:36:02.720170 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90d4142-1f3f-4ab3-b4c2-2520f86cac7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cd6136036bd467c946cae90d5c29263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:36:02.721231 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d4142-1f3f-4ab3-b4c2-2520f86cac7f service nova] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:36:02.721335 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d4142-1f3f-4ab3-b4c2-2520f86cac7f service nova] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:36:02.721574 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d4142-1f3f-4ab3-b4c2-2520f86cac7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:36:02.724205 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-f90d4142-1f3f-4ab3-b4c2-2520f86cac7f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:36:02.787960 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3829b23c-0dd4-4f85-942d-1d6cca4c4a59 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:36:02.789496 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-3829b23c-0dd4-4f85-942d-1d6cca4c4a59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:36:02.828567 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90d4142-1f3f-4ab3-b4c2-2520f86cac7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:36:02.830204 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90d4142-1f3f-4ab3-b4c2-2520f86cac7f service nova] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:36:02.841650 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1370/2720] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:36:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:36:02.869869 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3829b23c-0dd4-4f85-942d-1d6cca4c4a59 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:36:02.874580 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd560f1e-047f-40f4-8d3a-82b383af1133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:36:02.875227 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd560f1e-047f-40f4-8d3a-82b383af1133 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:36:02.875507 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd560f1e-047f-40f4-8d3a-82b383af1133 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:36:02.875843 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd560f1e-047f-40f4-8d3a-82b383af1133 admin admin] PATH_INFO: `/v3/projects/eb1e1b2f61ee44b3bc01a17957791b90` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:36:02.876983 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd560f1e-047f-40f4-8d3a-82b383af1133 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb1e1b2f61ee44b3bc01a17957791b90)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:36:02.878901 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd560f1e-047f-40f4-8d3a-82b383af1133 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:36:02.937289 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-fd560f1e-047f-40f4-8d3a-82b383af1133 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb1e1b2f61ee44b3bc01a17957791b90', 'request_id': 'req-fd560f1e-047f-40f4-8d3a-82b383af1133'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:36:02.945568 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-fd560f1e-047f-40f4-8d3a-82b383af1133 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb1e1b2f61ee44b3bc01a17957791b90', 'request_id': 'req-fd560f1e-047f-40f4-8d3a-82b383af1133'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:36:02.952632 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-fd560f1e-047f-40f4-8d3a-82b383af1133 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb1e1b2f61ee44b3bc01a17957791b90', 'request_id': 'req-fd560f1e-047f-40f4-8d3a-82b383af1133'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:36:02.964899 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-fd560f1e-047f-40f4-8d3a-82b383af1133 admin admin] The token cache is being invalidate because project eb1e1b2f61ee44b3bc01a17957791b90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81383) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:36:02.965360 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-fd560f1e-047f-40f4-8d3a-82b383af1133 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:36:02.965926 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-fd560f1e-047f-40f4-8d3a-82b383af1133 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:36:02.967514 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1351/2721] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:36:02 2022] DELETE /identity/v3/projects/eb1e1b2f61ee44b3bc01a17957791b90 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 05:36:02.972534 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a074ee61-e022-400a-8d4e-5978b5124485 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:36:02.972891 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a074ee61-e022-400a-8d4e-5978b5124485 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:36:02.973270 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a074ee61-e022-400a-8d4e-5978b5124485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:36:02.995465 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-a074ee61-e022-400a-8d4e-5978b5124485 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:36:02.996732 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-a074ee61-e022-400a-8d4e-5978b5124485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:36:03.055966 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1371/2722] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:36:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:36:03.064159 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aee9c6-b323-4bee-9084-baef12a1fbfc None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:36:03.064448 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aee9c6-b323-4bee-9084-baef12a1fbfc None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:36:03.064727 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aee9c6-b323-4bee-9084-baef12a1fbfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:36:03.073369 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:36:03.086304 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-86aee9c6-b323-4bee-9084-baef12a1fbfc None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:36:03.087526 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-86aee9c6-b323-4bee-9084-baef12a1fbfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:36:03.095483 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1352/2723] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:36:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:36:03.100163 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a074ee61-e022-400a-8d4e-5978b5124485 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:36:03.110037 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a074ee61-e022-400a-8d4e-5978b5124485 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:36:03.115186 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5efe41-4506-48e9-b083-e1d211ecb966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:36:03.115739 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5efe41-4506-48e9-b083-e1d211ecb966 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:36:03.116018 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5efe41-4506-48e9-b083-e1d211ecb966 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:36:03.116311 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5efe41-4506-48e9-b083-e1d211ecb966 admin admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:36:03.116945 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5efe41-4506-48e9-b083-e1d211ecb966 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:36:03.117262 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5efe41-4506-48e9-b083-e1d211ecb966 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:36:03.118855 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5efe41-4506-48e9-b083-e1d211ecb966 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:36:03.130145 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1372/2724] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 05:36:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:36:03.134218 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aee9c6-b323-4bee-9084-baef12a1fbfc None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:36:03.143369 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aee9c6-b323-4bee-9084-baef12a1fbfc None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:36:03.148694 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43b03a0-c1bb-41d3-b3d8-aec6eede140d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:36:03.149283 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43b03a0-c1bb-41d3-b3d8-aec6eede140d admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:36:03.149582 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43b03a0-c1bb-41d3-b3d8-aec6eede140d admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:36:03.149852 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43b03a0-c1bb-41d3-b3d8-aec6eede140d admin admin] PATH_INFO: `/v3/projects` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:36:03.150479 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43b03a0-c1bb-41d3-b3d8-aec6eede140d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:36:03.152425 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43b03a0-c1bb-41d3-b3d8-aec6eede140d admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:36:03.179740 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1353/2725] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:36:03 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 05:36:03.183965 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5efe41-4506-48e9-b083-e1d211ecb966 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:36:03.193708 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5efe41-4506-48e9-b083-e1d211ecb966 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:36:03.250379 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ac020d-3f5b-48bd-929a-bb2772ae4160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:36:03.251028 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ac020d-3f5b-48bd-929a-bb2772ae4160 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:36:03.251311 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ac020d-3f5b-48bd-929a-bb2772ae4160 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:36:03.251610 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ac020d-3f5b-48bd-929a-bb2772ae4160 admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:36:03.252267 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ac020d-3f5b-48bd-929a-bb2772ae4160 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:36:03.254195 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ac020d-3f5b-48bd-929a-bb2772ae4160 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:36:03.276397 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1373/2726] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:36:03 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 05:36:03.280429 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43b03a0-c1bb-41d3-b3d8-aec6eede140d admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:36:03.291200 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43b03a0-c1bb-41d3-b3d8-aec6eede140d admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:36:03.296155 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643fa184-c8a1-4802-95ba-7c467cba9e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:36:03.296757 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643fa184-c8a1-4802-95ba-7c467cba9e3c admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:36:03.297032 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643fa184-c8a1-4802-95ba-7c467cba9e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:36:03.297303 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643fa184-c8a1-4802-95ba-7c467cba9e3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:36:03.297944 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643fa184-c8a1-4802-95ba-7c467cba9e3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:36:03.299562 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643fa184-c8a1-4802-95ba-7c467cba9e3c admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:36:03.309396 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1354/2727] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:36:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:36:03.313162 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ac020d-3f5b-48bd-929a-bb2772ae4160 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:36:03.323023 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ac020d-3f5b-48bd-929a-bb2772ae4160 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:36:03.327691 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb658874-978e-4903-a5be-0859ab9646cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:36:03.328296 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb658874-978e-4903-a5be-0859ab9646cb admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:36:03.328574 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb658874-978e-4903-a5be-0859ab9646cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:36:03.328846 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb658874-978e-4903-a5be-0859ab9646cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:36:03.329481 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb658874-978e-4903-a5be-0859ab9646cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:36:03.331076 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb658874-978e-4903-a5be-0859ab9646cb admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:36:03.342007 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1374/2728] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:36:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:36:03.345950 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643fa184-c8a1-4802-95ba-7c467cba9e3c admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:36:03.356345 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643fa184-c8a1-4802-95ba-7c467cba9e3c admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:36:03.361164 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a82046c-6c77-426a-8500-06e7c177e62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:36:03.361929 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a82046c-6c77-426a-8500-06e7c177e62b admin admin] REQUEST_METHOD: `PUT` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:36:03.362294 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a82046c-6c77-426a-8500-06e7c177e62b admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:36:03.362480 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a82046c-6c77-426a-8500-06e7c177e62b admin admin] PATH_INFO: `/v3/projects/5ed6f5d6cbfb4a17b02d814feff3c6e6/users/f1f749dabb3f4013b32a7d9b2280569e/roles/aa7ff8e0ec1e48e5811335b9eb38b448` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:36:03.378825 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a82046c-6c77-426a-8500-06e7c177e62b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ed6f5d6cbfb4a17b02d814feff3c6e6, user_id=f1f749dabb3f4013b32a7d9b2280569e, role_id=aa7ff8e0ec1e48e5811335b9eb38b448)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:36:03.381514 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a82046c-6c77-426a-8500-06e7c177e62b admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:36:03.397144 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1355/2729] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:36:03 2022] PUT /identity/v3/projects/5ed6f5d6cbfb4a17b02d814feff3c6e6/users/f1f749dabb3f4013b32a7d9b2280569e/roles/aa7ff8e0ec1e48e5811335b9eb38b448 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:36:03.469851 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec2b5b7-de77-44da-aac8-c980597044df None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:36:03.470136 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec2b5b7-de77-44da-aac8-c980597044df None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:36:03.470409 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec2b5b7-de77-44da-aac8-c980597044df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:36:03.479438 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:36:03.502138 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-2ec2b5b7-de77-44da-aac8-c980597044df None None] MFA Rules not processed for user `f1f749dabb3f4013b32a7d9b2280569e`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:36:03.503380 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-2ec2b5b7-de77-44da-aac8-c980597044df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:36:03.576254 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1375/2730] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:36:03 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:36:03.587931 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a82046c-6c77-426a-8500-06e7c177e62b admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:36:03.589708 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-7a82046c-6c77-426a-8500-06e7c177e62b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:36:03.659529 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a82046c-6c77-426a-8500-06e7c177e62b admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:36:03.663582 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cf8608-9315-4a37-83f3-bfc28e170459 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a147e14b61d481db1cac02c58ac3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:36:03.664278 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf8608-9315-4a37-83f3-bfc28e170459 service cinder] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:36:03.664540 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf8608-9315-4a37-83f3-bfc28e170459 service cinder] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:36:03.664813 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf8608-9315-4a37-83f3-bfc28e170459 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:36:03.674035 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cf8608-9315-4a37-83f3-bfc28e170459 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:36:03.675542 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cf8608-9315-4a37-83f3-bfc28e170459 service cinder] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:36:03.685385 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1356/2731] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:36:03 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:36:06.758529 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec2b5b7-de77-44da-aac8-c980597044df None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:36:06.760219 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-2ec2b5b7-de77-44da-aac8-c980597044df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:36:06.820511 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec2b5b7-de77-44da-aac8-c980597044df None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:36:06.824417 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3702aec6-02c2-453b-9e7b-9256522a64d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:36:06.825002 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3702aec6-02c2-453b-9e7b-9256522a64d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:36:06.825277 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3702aec6-02c2-453b-9e7b-9256522a64d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:36:06.825553 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3702aec6-02c2-453b-9e7b-9256522a64d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:36:06.827380 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-3702aec6-02c2-453b-9e7b-9256522a64d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:36:06.906656 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3702aec6-02c2-453b-9e7b-9256522a64d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:36:06.908229 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3702aec6-02c2-453b-9e7b-9256522a64d6 service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:36:06.923491 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1376/2732] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:36:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:36:09.093019 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cf8608-9315-4a37-83f3-bfc28e170459 service cinder] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:36:09.104099 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cf8608-9315-4a37-83f3-bfc28e170459 service cinder] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:36:09.108525 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039a0215-815f-4b94-82a2-7876c701baac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:36:09.109397 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a0215-815f-4b94-82a2-7876c701baac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:36:09.109676 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a0215-815f-4b94-82a2-7876c701baac admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:36:09.109950 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a0215-815f-4b94-82a2-7876c701baac admin admin] PATH_INFO: `/v3/users/f1f749dabb3f4013b32a7d9b2280569e` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:36:09.111074 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039a0215-815f-4b94-82a2-7876c701baac admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1f749dabb3f4013b32a7d9b2280569e)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:36:09.113097 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039a0215-815f-4b94-82a2-7876c701baac admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:36:09.170671 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-039a0215-815f-4b94-82a2-7876c701baac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1f749dabb3f4013b32a7d9b2280569e'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:36:09.185185 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-039a0215-815f-4b94-82a2-7876c701baac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1f749dabb3f4013b32a7d9b2280569e'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:36:09.193691 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-039a0215-815f-4b94-82a2-7876c701baac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1f749dabb3f4013b32a7d9b2280569e'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:36:09.203234 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-039a0215-815f-4b94-82a2-7876c701baac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1f749dabb3f4013b32a7d9b2280569e'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:36:09.203899 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-039a0215-815f-4b94-82a2-7876c701baac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1f749dabb3f4013b32a7d9b2280569e'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:36:09.211158 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1357/2733] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:36:09 2022] DELETE /identity/v3/users/f1f749dabb3f4013b32a7d9b2280569e => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:36:09.215979 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b1cbb-b385-4e8b-a185-1835ddcc8265 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:36:09.216509 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b1cbb-b385-4e8b-a185-1835ddcc8265 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:36:09.216509 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b1cbb-b385-4e8b-a185-1835ddcc8265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:36:09.238209 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-4c8b1cbb-b385-4e8b-a185-1835ddcc8265 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:36:09.239496 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-4c8b1cbb-b385-4e8b-a185-1835ddcc8265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:36:09.290457 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:36:09.309975 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1377/2734] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:36:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:36:09.319846 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039a0215-815f-4b94-82a2-7876c701baac admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:36:09.321260 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-039a0215-815f-4b94-82a2-7876c701baac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:36:09.340422 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:36:09.382600 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039a0215-815f-4b94-82a2-7876c701baac admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:36:09.386232 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9807d5c9-776e-40ee-8b84-b1d232a44faa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:36:09.386850 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9807d5c9-776e-40ee-8b84-b1d232a44faa service neutron] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:36:09.387127 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9807d5c9-776e-40ee-8b84-b1d232a44faa service neutron] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:36:09.387399 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9807d5c9-776e-40ee-8b84-b1d232a44faa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:36:09.397225 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9807d5c9-776e-40ee-8b84-b1d232a44faa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:36:09.398790 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9807d5c9-776e-40ee-8b84-b1d232a44faa service neutron] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:36:09.414491 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1358/2735] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:36:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:36:09.937086 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8b1cbb-b385-4e8b-a185-1835ddcc8265 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:36:09.938408 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-4c8b1cbb-b385-4e8b-a185-1835ddcc8265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:36:09.959401 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8b1cbb-b385-4e8b-a185-1835ddcc8265 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:36:09.976058 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6d1fff-6a65-47be-8203-1a3bed3f9f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:36:09.976866 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6d1fff-6a65-47be-8203-1a3bed3f9f80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:36:09.977155 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6d1fff-6a65-47be-8203-1a3bed3f9f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:36:09.977426 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6d1fff-6a65-47be-8203-1a3bed3f9f80 admin admin] PATH_INFO: `/v3/projects/5ed6f5d6cbfb4a17b02d814feff3c6e6` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:36:09.980534 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6d1fff-6a65-47be-8203-1a3bed3f9f80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ed6f5d6cbfb4a17b02d814feff3c6e6)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:36:09.982503 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6d1fff-6a65-47be-8203-1a3bed3f9f80 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:36:10.078059 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-8c6d1fff-6a65-47be-8203-1a3bed3f9f80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ed6f5d6cbfb4a17b02d814feff3c6e6', 'request_id': 'req-8c6d1fff-6a65-47be-8203-1a3bed3f9f80'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:36:10.090338 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-8c6d1fff-6a65-47be-8203-1a3bed3f9f80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ed6f5d6cbfb4a17b02d814feff3c6e6', 'request_id': 'req-8c6d1fff-6a65-47be-8203-1a3bed3f9f80'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:36:10.099357 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-8c6d1fff-6a65-47be-8203-1a3bed3f9f80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ed6f5d6cbfb4a17b02d814feff3c6e6', 'request_id': 'req-8c6d1fff-6a65-47be-8203-1a3bed3f9f80'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:36:10.113399 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-8c6d1fff-6a65-47be-8203-1a3bed3f9f80 admin admin] The token cache is being invalidate because project 5ed6f5d6cbfb4a17b02d814feff3c6e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:36:10.114217 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-8c6d1fff-6a65-47be-8203-1a3bed3f9f80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:36:10.114851 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-8c6d1fff-6a65-47be-8203-1a3bed3f9f80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:36:10.116953 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1378/2736] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:36:09 2022] DELETE /identity/v3/projects/5ed6f5d6cbfb4a17b02d814feff3c6e6 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:36:10.121854 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7aff25-5d62-4c28-8f17-766497c21dd7 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:36:10.122383 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7aff25-5d62-4c28-8f17-766497c21dd7 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:36:10.122383 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7aff25-5d62-4c28-8f17-766497c21dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:36:10.152557 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-ab7aff25-5d62-4c28-8f17-766497c21dd7 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:36:10.153885 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-ab7aff25-5d62-4c28-8f17-766497c21dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:36:10.226929 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1359/2737] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:36:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:36:10.227220 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6d1fff-6a65-47be-8203-1a3bed3f9f80 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:36:10.227671 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-8c6d1fff-6a65-47be-8203-1a3bed3f9f80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:36:10.228440 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c67c00-ccaf-4ffc-bd7c-4ea4fd6c77f5 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:36:10.228775 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c67c00-ccaf-4ffc-bd7c-4ea4fd6c77f5 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:36:10.229059 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c67c00-ccaf-4ffc-bd7c-4ea4fd6c77f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:36:10.242569 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6d1fff-6a65-47be-8203-1a3bed3f9f80 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:36:10.247493 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c1bd67-d108-4e6d-a00e-c5459ac949f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:36:10.248231 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c1bd67-d108-4e6d-a00e-c5459ac949f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:36:10.248583 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c1bd67-d108-4e6d-a00e-c5459ac949f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:36:10.248927 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c1bd67-d108-4e6d-a00e-c5459ac949f9 admin admin] PATH_INFO: `/v3/users/2733ccb746fd454b8e53bf6ae162f38e` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:36:10.250177 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c1bd67-d108-4e6d-a00e-c5459ac949f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2733ccb746fd454b8e53bf6ae162f38e)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:36:10.250867 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-76c67c00-ccaf-4ffc-bd7c-4ea4fd6c77f5 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:36:10.252114 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-76c67c00-ccaf-4ffc-bd7c-4ea4fd6c77f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:36:10.252374 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c1bd67-d108-4e6d-a00e-c5459ac949f9 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:36:10.260858 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1360/2738] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:36:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 05:36:10.264964 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c67c00-ccaf-4ffc-bd7c-4ea4fd6c77f5 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:36:10.274858 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c67c00-ccaf-4ffc-bd7c-4ea4fd6c77f5 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:36:10.279894 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827249e3-3fc9-4e49-beeb-aa82058f1a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:36:10.280714 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827249e3-3fc9-4e49-beeb-aa82058f1a75 admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:36:10.281056 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827249e3-3fc9-4e49-beeb-aa82058f1a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:36:10.281335 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827249e3-3fc9-4e49-beeb-aa82058f1a75 admin admin] PATH_INFO: `/v3/domains` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:36:10.282132 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827249e3-3fc9-4e49-beeb-aa82058f1a75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:36:10.282534 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827249e3-3fc9-4e49-beeb-aa82058f1a75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:36:10.284334 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827249e3-3fc9-4e49-beeb-aa82058f1a75 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:36:10.298330 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1361/2739] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 05:36:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:36:10.303117 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827249e3-3fc9-4e49-beeb-aa82058f1a75 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:36:10.305567 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-20c1bd67-d108-4e6d-a00e-c5459ac949f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2733ccb746fd454b8e53bf6ae162f38e'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:36:10.312493 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827249e3-3fc9-4e49-beeb-aa82058f1a75 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:36:10.318862 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d62f3d-04f6-4dcb-a86c-0e301b517eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:36:10.319469 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d62f3d-04f6-4dcb-a86c-0e301b517eff admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:36:10.319800 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d62f3d-04f6-4dcb-a86c-0e301b517eff admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:36:10.320090 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d62f3d-04f6-4dcb-a86c-0e301b517eff admin admin] PATH_INFO: `/v3/projects` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:36:10.320451 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-20c1bd67-d108-4e6d-a00e-c5459ac949f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2733ccb746fd454b8e53bf6ae162f38e'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:36:10.320686 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d62f3d-04f6-4dcb-a86c-0e301b517eff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:36:10.322556 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d62f3d-04f6-4dcb-a86c-0e301b517eff admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:36:10.327235 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-20c1bd67-d108-4e6d-a00e-c5459ac949f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2733ccb746fd454b8e53bf6ae162f38e'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:36:10.335539 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-20c1bd67-d108-4e6d-a00e-c5459ac949f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2733ccb746fd454b8e53bf6ae162f38e'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:36:10.336307 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-20c1bd67-d108-4e6d-a00e-c5459ac949f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2733ccb746fd454b8e53bf6ae162f38e'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:36:10.344977 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1379/2740] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:36:10 2022] DELETE /identity/v3/users/2733ccb746fd454b8e53bf6ae162f38e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:36:10.351727 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1362/2741] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:36:10 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 05:36:10.356050 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c1bd67-d108-4e6d-a00e-c5459ac949f9 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:36:10.357865 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-20c1bd67-d108-4e6d-a00e-c5459ac949f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:36:10.405553 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:36:10.430481 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c1bd67-d108-4e6d-a00e-c5459ac949f9 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:36:10.490481 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eccaec-346a-43d7-84c6-0f5c39a21f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:36:10.491095 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eccaec-346a-43d7-84c6-0f5c39a21f89 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:36:10.491387 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eccaec-346a-43d7-84c6-0f5c39a21f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:36:10.491642 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eccaec-346a-43d7-84c6-0f5c39a21f89 admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:36:10.492306 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eccaec-346a-43d7-84c6-0f5c39a21f89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:36:10.494260 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eccaec-346a-43d7-84c6-0f5c39a21f89 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:36:10.521360 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1380/2742] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:36:10 2022] POST /identity/v3/users => generated 293 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 05:36:10.522417 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eccaec-346a-43d7-84c6-0f5c39a21f89 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:36:10.523137 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d62f3d-04f6-4dcb-a86c-0e301b517eff admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:36:10.525170 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-16d62f3d-04f6-4dcb-a86c-0e301b517eff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:36:10.533553 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eccaec-346a-43d7-84c6-0f5c39a21f89 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:36:10.538766 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d62f3d-04f6-4dcb-a86c-0e301b517eff admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:36:10.540784 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fbb9e4-934a-49e9-ba88-3a9063239b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:36:10.541415 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fbb9e4-934a-49e9-ba88-3a9063239b86 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:36:10.541703 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fbb9e4-934a-49e9-ba88-3a9063239b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:36:10.541961 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fbb9e4-934a-49e9-ba88-3a9063239b86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:36:10.542651 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fbb9e4-934a-49e9-ba88-3a9063239b86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:36:10.543781 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b758f4-bcb4-4173-aa39-3503beeb2ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:36:10.544245 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fbb9e4-934a-49e9-ba88-3a9063239b86 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:36:10.544407 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b758f4-bcb4-4173-aa39-3503beeb2ddb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:36:10.544689 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b758f4-bcb4-4173-aa39-3503beeb2ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:36:10.544961 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b758f4-bcb4-4173-aa39-3503beeb2ddb admin admin] PATH_INFO: `/v3/projects/aa9a5f2733a34f13a9ca6940e3fe3c56` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:36:10.546192 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b758f4-bcb4-4173-aa39-3503beeb2ddb admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa9a5f2733a34f13a9ca6940e3fe3c56)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:36:10.548434 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b758f4-bcb4-4173-aa39-3503beeb2ddb admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:36:10.556443 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1381/2743] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:36:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:36:10.560271 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fbb9e4-934a-49e9-ba88-3a9063239b86 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:36:10.570456 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fbb9e4-934a-49e9-ba88-3a9063239b86 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:36:10.575190 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef8009a-da82-4e7e-b24d-6b88fd6e6089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:36:10.575820 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef8009a-da82-4e7e-b24d-6b88fd6e6089 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:36:10.576093 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef8009a-da82-4e7e-b24d-6b88fd6e6089 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:36:10.576359 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef8009a-da82-4e7e-b24d-6b88fd6e6089 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:36:10.576987 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef8009a-da82-4e7e-b24d-6b88fd6e6089 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:36:10.578571 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef8009a-da82-4e7e-b24d-6b88fd6e6089 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:36:10.589171 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1382/2744] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:36:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:36:10.593239 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef8009a-da82-4e7e-b24d-6b88fd6e6089 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:36:10.603394 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef8009a-da82-4e7e-b24d-6b88fd6e6089 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:36:10.605938 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-d9b758f4-bcb4-4173-aa39-3503beeb2ddb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa9a5f2733a34f13a9ca6940e3fe3c56', 'request_id': 'req-d9b758f4-bcb4-4173-aa39-3503beeb2ddb'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:36:10.614910 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-d9b758f4-bcb4-4173-aa39-3503beeb2ddb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa9a5f2733a34f13a9ca6940e3fe3c56', 'request_id': 'req-d9b758f4-bcb4-4173-aa39-3503beeb2ddb'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:36:10.621546 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-d9b758f4-bcb4-4173-aa39-3503beeb2ddb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa9a5f2733a34f13a9ca6940e3fe3c56', 'request_id': 'req-d9b758f4-bcb4-4173-aa39-3503beeb2ddb'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:36:10.630788 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:36:10.634917 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-d9b758f4-bcb4-4173-aa39-3503beeb2ddb admin admin] The token cache is being invalidate because project aa9a5f2733a34f13a9ca6940e3fe3c56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81383) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:36:10.635432 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-d9b758f4-bcb4-4173-aa39-3503beeb2ddb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:36:10.636392 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-d9b758f4-bcb4-4173-aa39-3503beeb2ddb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:36:10.641538 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1363/2745] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:36:10 2022] DELETE /identity/v3/projects/aa9a5f2733a34f13a9ca6940e3fe3c56 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:36:10.642845 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47290b1b-8dee-4eeb-af52-ccea19d05bb2 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:36:10.643360 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47290b1b-8dee-4eeb-af52-ccea19d05bb2 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:36:10.643745 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47290b1b-8dee-4eeb-af52-ccea19d05bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:36:10.663325 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87d0d34-b4f2-4379-b177-18079beacb07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:36:10.664015 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87d0d34-b4f2-4379-b177-18079beacb07 admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:36:10.664297 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87d0d34-b4f2-4379-b177-18079beacb07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:36:10.664572 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87d0d34-b4f2-4379-b177-18079beacb07 admin admin] PATH_INFO: `/v3/projects/c8864be359cc4779b00d52c8d0787abc/users/a0937980aad94bac873b0d776db7c487/roles/aa7ff8e0ec1e48e5811335b9eb38b448` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:36:10.666256 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-47290b1b-8dee-4eeb-af52-ccea19d05bb2 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:36:10.667654 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-47290b1b-8dee-4eeb-af52-ccea19d05bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:36:10.676407 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1364/2746] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:36:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:36:10.679946 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87d0d34-b4f2-4379-b177-18079beacb07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8864be359cc4779b00d52c8d0787abc, user_id=a0937980aad94bac873b0d776db7c487, role_id=aa7ff8e0ec1e48e5811335b9eb38b448)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:36:10.682664 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87d0d34-b4f2-4379-b177-18079beacb07 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:36:10.684987 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e355c38b-0ada-4988-ae67-9054634c276e None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:36:10.685279 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e355c38b-0ada-4988-ae67-9054634c276e None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:36:10.685564 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e355c38b-0ada-4988-ae67-9054634c276e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:36:10.696307 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1383/2747] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:36:10 2022] PUT /identity/v3/projects/c8864be359cc4779b00d52c8d0787abc/users/a0937980aad94bac873b0d776db7c487/roles/aa7ff8e0ec1e48e5811335b9eb38b448 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 05:36:10.705853 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-e355c38b-0ada-4988-ae67-9054634c276e None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:36:10.707169 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-e355c38b-0ada-4988-ae67-9054634c276e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:36:10.708071 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd450b9f-f215-4dfe-9478-9e8b7a6ca4af None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:36:10.708362 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd450b9f-f215-4dfe-9478-9e8b7a6ca4af None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:36:10.708638 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd450b9f-f215-4dfe-9478-9e8b7a6ca4af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:36:10.737749 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-bd450b9f-f215-4dfe-9478-9e8b7a6ca4af None None] MFA Rules not processed for user `a0937980aad94bac873b0d776db7c487`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:36:10.739019 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-bd450b9f-f215-4dfe-9478-9e8b7a6ca4af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:36:10.764879 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:36:10.773770 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1365/2748] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:36:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 05:36:10.778060 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e355c38b-0ada-4988-ae67-9054634c276e None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:36:10.793204 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e355c38b-0ada-4988-ae67-9054634c276e None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:36:10.798646 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a78b65-1856-4418-92fe-e5a1f9364d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:36:10.799282 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a78b65-1856-4418-92fe-e5a1f9364d85 admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:36:10.799564 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a78b65-1856-4418-92fe-e5a1f9364d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:36:10.799878 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a78b65-1856-4418-92fe-e5a1f9364d85 admin admin] PATH_INFO: `/v3/domains` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:36:10.800523 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a78b65-1856-4418-92fe-e5a1f9364d85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:36:10.800829 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a78b65-1856-4418-92fe-e5a1f9364d85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:36:10.802810 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a78b65-1856-4418-92fe-e5a1f9364d85 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:36:10.806765 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1384/2749] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:36:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 05:36:10.811145 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd450b9f-f215-4dfe-9478-9e8b7a6ca4af None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:36:10.812513 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-bd450b9f-f215-4dfe-9478-9e8b7a6ca4af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:36:10.815774 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1366/2750] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 05:36:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:36:10.820113 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a78b65-1856-4418-92fe-e5a1f9364d85 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:36:10.829547 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd450b9f-f215-4dfe-9478-9e8b7a6ca4af None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:36:10.829737 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a78b65-1856-4418-92fe-e5a1f9364d85 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:36:10.834725 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d977155-9126-485d-a2ba-8943f1ae9fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:36:10.834865 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef3c3ee-19f0-4c05-b32c-1a8153fda177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:36:10.835304 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef3c3ee-19f0-4c05-b32c-1a8153fda177 admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:36:10.835441 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d977155-9126-485d-a2ba-8943f1ae9fce admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:36:10.835573 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d977155-9126-485d-a2ba-8943f1ae9fce admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:36:10.835701 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef3c3ee-19f0-4c05-b32c-1a8153fda177 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:36:10.835877 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef3c3ee-19f0-4c05-b32c-1a8153fda177 admin admin] PATH_INFO: `/v3/projects` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:36:10.835976 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d977155-9126-485d-a2ba-8943f1ae9fce admin admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:36:10.836499 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef3c3ee-19f0-4c05-b32c-1a8153fda177 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:36:10.836606 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d977155-9126-485d-a2ba-8943f1ae9fce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:36:10.838386 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef3c3ee-19f0-4c05-b32c-1a8153fda177 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:36:10.838497 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d977155-9126-485d-a2ba-8943f1ae9fce admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:36:10.868059 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1385/2751] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:36:10 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 05:36:10.868579 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1367/2752] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:36:10 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:36:10.872010 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d977155-9126-485d-a2ba-8943f1ae9fce admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:36:10.872437 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef3c3ee-19f0-4c05-b32c-1a8153fda177 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:36:10.934721 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d977155-9126-485d-a2ba-8943f1ae9fce admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:36:10.935202 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef3c3ee-19f0-4c05-b32c-1a8153fda177 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:36:10.940017 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829c955a-dcd5-4b7d-ba5d-c322ba1063c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:36:10.940167 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11bebdb-7382-4411-8463-661f8561ef70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:36:10.940715 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c955a-dcd5-4b7d-ba5d-c322ba1063c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:36:10.940812 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11bebdb-7382-4411-8463-661f8561ef70 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:36:10.940904 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c955a-dcd5-4b7d-ba5d-c322ba1063c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:36:10.940984 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11bebdb-7382-4411-8463-661f8561ef70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:36:10.941183 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c955a-dcd5-4b7d-ba5d-c322ba1063c0 admin admin] PATH_INFO: `/v3/users` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:36:10.941295 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11bebdb-7382-4411-8463-661f8561ef70 admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:36:10.941916 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829c955a-dcd5-4b7d-ba5d-c322ba1063c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:36:10.942027 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11bebdb-7382-4411-8463-661f8561ef70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:36:10.943668 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829c955a-dcd5-4b7d-ba5d-c322ba1063c0 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:36:10.943907 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11bebdb-7382-4411-8463-661f8561ef70 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:36:10.967598 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1368/2753] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:36:10 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 05:36:10.971495 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829c955a-dcd5-4b7d-ba5d-c322ba1063c0 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:36:10.976034 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1386/2754] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:36:10 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 05:36:10.977763 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11bebdb-7382-4411-8463-661f8561ef70 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:36:10.983120 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829c955a-dcd5-4b7d-ba5d-c322ba1063c0 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:36:10.989102 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11bebdb-7382-4411-8463-661f8561ef70 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:36:10.991486 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e1ca03-21a4-41ed-b717-9156ed1d6f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:36:10.992138 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e1ca03-21a4-41ed-b717-9156ed1d6f64 admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:36:10.992426 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e1ca03-21a4-41ed-b717-9156ed1d6f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:36:10.992696 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e1ca03-21a4-41ed-b717-9156ed1d6f64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:36:10.993347 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e1ca03-21a4-41ed-b717-9156ed1d6f64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:36:10.994407 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb67582-4b1c-4993-a7e9-45c383df6f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:36:10.994978 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e1ca03-21a4-41ed-b717-9156ed1d6f64 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:36:10.995133 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb67582-4b1c-4993-a7e9-45c383df6f4b admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:36:10.995478 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb67582-4b1c-4993-a7e9-45c383df6f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:36:10.995857 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb67582-4b1c-4993-a7e9-45c383df6f4b admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:36:10.996607 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb67582-4b1c-4993-a7e9-45c383df6f4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:36:10.998465 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb67582-4b1c-4993-a7e9-45c383df6f4b admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:36:11.006217 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1369/2755] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:36:10 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 05:36:11.010149 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e1ca03-21a4-41ed-b717-9156ed1d6f64 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:36:11.015914 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1387/2756] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:36:10 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:36:11.017043 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb67582-4b1c-4993-a7e9-45c383df6f4b admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:36:11.021695 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e1ca03-21a4-41ed-b717-9156ed1d6f64 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:36:11.026854 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7918789a-cbbd-47ad-8661-794ced5cf8cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:36:11.027519 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7918789a-cbbd-47ad-8661-794ced5cf8cc admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:36:11.027798 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7918789a-cbbd-47ad-8661-794ced5cf8cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:36:11.028076 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7918789a-cbbd-47ad-8661-794ced5cf8cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:36:11.028719 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7918789a-cbbd-47ad-8661-794ced5cf8cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:36:11.030139 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb67582-4b1c-4993-a7e9-45c383df6f4b admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:36:11.030311 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7918789a-cbbd-47ad-8661-794ced5cf8cc admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:36:11.035517 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d6fdf3-c40b-4ef5-9631-aa758f81e06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:36:11.036170 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d6fdf3-c40b-4ef5-9631-aa758f81e06b admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:36:11.036452 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d6fdf3-c40b-4ef5-9631-aa758f81e06b admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:36:11.036730 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d6fdf3-c40b-4ef5-9631-aa758f81e06b admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:36:11.037369 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d6fdf3-c40b-4ef5-9631-aa758f81e06b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:36:11.039006 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d6fdf3-c40b-4ef5-9631-aa758f81e06b admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:36:11.041684 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1370/2757] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:36:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 05:36:11.045810 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7918789a-cbbd-47ad-8661-794ced5cf8cc admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:36:11.054810 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1388/2758] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:36:11 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:36:11.056164 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7918789a-cbbd-47ad-8661-794ced5cf8cc admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:36:11.058380 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d6fdf3-c40b-4ef5-9631-aa758f81e06b admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:36:11.062746 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0104d04e-0022-4178-80c8-68a921143c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:36:11.063441 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104d04e-0022-4178-80c8-68a921143c59 admin admin] REQUEST_METHOD: `PUT` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:36:11.063756 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104d04e-0022-4178-80c8-68a921143c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:36:11.064035 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104d04e-0022-4178-80c8-68a921143c59 admin admin] PATH_INFO: `/v3/projects/cbfe4f58ecf446688356869d6b26f7c7/users/41bf15dfacea45a5b5615d7d7524491f/roles/aa7ff8e0ec1e48e5811335b9eb38b448` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:36:11.071650 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d6fdf3-c40b-4ef5-9631-aa758f81e06b admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:36:11.077661 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d770ced7-21e9-432e-ac46-9e2cb3233dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:36:11.078332 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d770ced7-21e9-432e-ac46-9e2cb3233dc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:36:11.078614 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d770ced7-21e9-432e-ac46-9e2cb3233dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:36:11.078938 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d770ced7-21e9-432e-ac46-9e2cb3233dc7 admin admin] PATH_INFO: `/v3/projects/85adc88dd889436897849cfdb4fd3c91/users/11d1f25497754f67b93146799fa60ccf/roles/aa7ff8e0ec1e48e5811335b9eb38b448` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:36:11.081096 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0104d04e-0022-4178-80c8-68a921143c59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbfe4f58ecf446688356869d6b26f7c7, user_id=41bf15dfacea45a5b5615d7d7524491f, role_id=aa7ff8e0ec1e48e5811335b9eb38b448)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:36:11.084437 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0104d04e-0022-4178-80c8-68a921143c59 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:36:11.103932 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d770ced7-21e9-432e-ac46-9e2cb3233dc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85adc88dd889436897849cfdb4fd3c91, user_id=11d1f25497754f67b93146799fa60ccf, role_id=aa7ff8e0ec1e48e5811335b9eb38b448)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:36:11.104078 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1371/2759] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:36:11 2022] PUT /identity/v3/projects/cbfe4f58ecf446688356869d6b26f7c7/users/41bf15dfacea45a5b5615d7d7524491f/roles/aa7ff8e0ec1e48e5811335b9eb38b448 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 05:36:11.104181 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d770ced7-21e9-432e-ac46-9e2cb3233dc7 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:36:11.104283 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbed576-89d0-42a1-9a1f-71c400448a39 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:36:11.104283 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbed576-89d0-42a1-9a1f-71c400448a39 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:36:11.104552 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbed576-89d0-42a1-9a1f-71c400448a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:36:11.112525 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:36:11.116295 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1389/2760] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:36:11 2022] PUT /identity/v3/projects/85adc88dd889436897849cfdb4fd3c91/users/11d1f25497754f67b93146799fa60ccf/roles/aa7ff8e0ec1e48e5811335b9eb38b448 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:36:11.126834 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-adbed576-89d0-42a1-9a1f-71c400448a39 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:36:11.127330 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d456012-66fd-4327-8318-1d9c0a0a360d None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:36:11.127330 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d456012-66fd-4327-8318-1d9c0a0a360d None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:36:11.127569 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d456012-66fd-4327-8318-1d9c0a0a360d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:36:11.128070 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-adbed576-89d0-42a1-9a1f-71c400448a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:36:11.155518 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-6d456012-66fd-4327-8318-1d9c0a0a360d None None] MFA Rules not processed for user `11d1f25497754f67b93146799fa60ccf`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:36:11.156750 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-6d456012-66fd-4327-8318-1d9c0a0a360d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:36:11.189737 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1372/2761] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:36:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 05:36:11.195840 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:36:11.199812 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbed576-89d0-42a1-9a1f-71c400448a39 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:36:11.201351 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-adbed576-89d0-42a1-9a1f-71c400448a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:36:11.224142 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1390/2762] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:36:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 05:36:11.228991 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d456012-66fd-4327-8318-1d9c0a0a360d None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:36:11.239804 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d456012-66fd-4327-8318-1d9c0a0a360d None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:36:11.244493 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c2db2e-2430-4a8e-a39d-7030a7ecefbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:36:11.245087 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c2db2e-2430-4a8e-a39d-7030a7ecefbe admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:36:11.245364 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c2db2e-2430-4a8e-a39d-7030a7ecefbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:36:11.245634 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c2db2e-2430-4a8e-a39d-7030a7ecefbe admin admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:36:11.246252 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c2db2e-2430-4a8e-a39d-7030a7ecefbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:36:11.248191 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c2db2e-2430-4a8e-a39d-7030a7ecefbe admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:36:11.259164 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbed576-89d0-42a1-9a1f-71c400448a39 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:36:11.262913 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b212b99-4e3a-4022-88b0-ff261e79b878 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:36:11.263517 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b212b99-4e3a-4022-88b0-ff261e79b878 service neutron] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:36:11.263863 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b212b99-4e3a-4022-88b0-ff261e79b878 service neutron] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:36:11.264145 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b212b99-4e3a-4022-88b0-ff261e79b878 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:36:11.274857 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b212b99-4e3a-4022-88b0-ff261e79b878 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:36:11.279636 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1391/2763] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:36:11 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:36:11.279803 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b212b99-4e3a-4022-88b0-ff261e79b878 service neutron] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:36:11.280498 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c2db2e-2430-4a8e-a39d-7030a7ecefbe admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:36:11.287706 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1373/2764] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:36:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 05:36:11.343534 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c2db2e-2430-4a8e-a39d-7030a7ecefbe admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:36:11.348414 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e53958-4995-4df1-8361-06bf10c4836a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:36:11.349018 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e53958-4995-4df1-8361-06bf10c4836a admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:36:11.349393 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e53958-4995-4df1-8361-06bf10c4836a admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:36:11.349670 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e53958-4995-4df1-8361-06bf10c4836a admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:36:11.350324 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e53958-4995-4df1-8361-06bf10c4836a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:36:11.352333 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e53958-4995-4df1-8361-06bf10c4836a admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:36:11.373970 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1392/2765] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:36:11 2022] POST /identity/v3/users => generated 297 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 05:36:11.378426 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b212b99-4e3a-4022-88b0-ff261e79b878 service neutron] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:36:11.389412 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b212b99-4e3a-4022-88b0-ff261e79b878 service neutron] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:36:11.396088 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053f8cff-cd20-4c52-a2b9-56a69b9f7e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:36:11.396829 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f8cff-cd20-4c52-a2b9-56a69b9f7e4c admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:36:11.397428 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f8cff-cd20-4c52-a2b9-56a69b9f7e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:36:11.397773 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f8cff-cd20-4c52-a2b9-56a69b9f7e4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:36:11.399138 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053f8cff-cd20-4c52-a2b9-56a69b9f7e4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:36:11.401105 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053f8cff-cd20-4c52-a2b9-56a69b9f7e4c admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:36:11.412868 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1374/2766] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:36:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:36:11.417767 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e53958-4995-4df1-8361-06bf10c4836a admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:36:11.432867 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e53958-4995-4df1-8361-06bf10c4836a admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:36:11.437964 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87b0d42-b2e8-48a0-a719-1f4c7ea8c60f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:36:11.438750 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b0d42-b2e8-48a0-a719-1f4c7ea8c60f admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:36:11.438966 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b0d42-b2e8-48a0-a719-1f4c7ea8c60f admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:36:11.439333 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b0d42-b2e8-48a0-a719-1f4c7ea8c60f admin admin] PATH_INFO: `/v3/projects/921ea6d9d8114923b4a40ffa6b37fd18/users/8d3c2f2052ee48039e90352bb114f9e5/roles/5b702713e40145b49e0b42abd0a5fba9` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:36:11.455272 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87b0d42-b2e8-48a0-a719-1f4c7ea8c60f admin admin] RBAC: Authorizing `identity:create_grant(project_id=921ea6d9d8114923b4a40ffa6b37fd18, user_id=8d3c2f2052ee48039e90352bb114f9e5, role_id=5b702713e40145b49e0b42abd0a5fba9)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:36:11.458824 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87b0d42-b2e8-48a0-a719-1f4c7ea8c60f admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:36:11.478331 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1393/2767] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:36:11 2022] PUT /identity/v3/projects/921ea6d9d8114923b4a40ffa6b37fd18/users/8d3c2f2052ee48039e90352bb114f9e5/roles/5b702713e40145b49e0b42abd0a5fba9 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 05:36:11.480387 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053f8cff-cd20-4c52-a2b9-56a69b9f7e4c admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:36:11.494008 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053f8cff-cd20-4c52-a2b9-56a69b9f7e4c admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:36:11.553399 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd34451-864c-47b6-8803-3bf218e0bc47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:36:11.554075 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd34451-864c-47b6-8803-3bf218e0bc47 admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:36:11.554446 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd34451-864c-47b6-8803-3bf218e0bc47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:36:11.554868 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd34451-864c-47b6-8803-3bf218e0bc47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:36:11.556002 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd34451-864c-47b6-8803-3bf218e0bc47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:36:11.557326 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd34451-864c-47b6-8803-3bf218e0bc47 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:36:11.568758 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1375/2768] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:36:11 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:36:11.573133 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87b0d42-b2e8-48a0-a719-1f4c7ea8c60f admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:36:11.584089 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87b0d42-b2e8-48a0-a719-1f4c7ea8c60f admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:36:11.589437 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ce0eb-1fbc-4baa-992c-3779d2002b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:36:11.590141 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ce0eb-1fbc-4baa-992c-3779d2002b1e admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:36:11.590424 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ce0eb-1fbc-4baa-992c-3779d2002b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:36:11.590684 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ce0eb-1fbc-4baa-992c-3779d2002b1e admin admin] PATH_INFO: `/v3/projects/921ea6d9d8114923b4a40ffa6b37fd18/users/8d3c2f2052ee48039e90352bb114f9e5/roles/5b702713e40145b49e0b42abd0a5fba9` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:36:11.592838 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624ce0eb-1fbc-4baa-992c-3779d2002b1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=921ea6d9d8114923b4a40ffa6b37fd18, user_id=8d3c2f2052ee48039e90352bb114f9e5, role_id=5b702713e40145b49e0b42abd0a5fba9)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:36:11.595642 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624ce0eb-1fbc-4baa-992c-3779d2002b1e admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:36:11.618640 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1394/2769] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:36:11 2022] PUT /identity/v3/projects/921ea6d9d8114923b4a40ffa6b37fd18/users/8d3c2f2052ee48039e90352bb114f9e5/roles/5b702713e40145b49e0b42abd0a5fba9 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 05:36:11.628670 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e5269-4c28-44f1-8883-ab0bd4825e4f None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:36:11.629062 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e5269-4c28-44f1-8883-ab0bd4825e4f None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:36:11.630316 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e5269-4c28-44f1-8883-ab0bd4825e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:36:11.662088 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-659e5269-4c28-44f1-8883-ab0bd4825e4f None None] MFA Rules not processed for user `8d3c2f2052ee48039e90352bb114f9e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:36:11.663377 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-659e5269-4c28-44f1-8883-ab0bd4825e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:36:11.686675 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:36:11.765763 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1376/2770] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:36:11 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:36:11.779394 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ce0eb-1fbc-4baa-992c-3779d2002b1e admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:36:11.781499 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-624ce0eb-1fbc-4baa-992c-3779d2002b1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:36:11.900424 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ce0eb-1fbc-4baa-992c-3779d2002b1e admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:36:11.904478 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e28537a-02b2-42e3-9ec8-bedb9d936f4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a147e14b61d481db1cac02c58ac3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:36:11.905161 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e28537a-02b2-42e3-9ec8-bedb9d936f4c service cinder] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:36:11.905439 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e28537a-02b2-42e3-9ec8-bedb9d936f4c service cinder] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:36:11.905706 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e28537a-02b2-42e3-9ec8-bedb9d936f4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:36:11.940301 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:36:11.987894 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e28537a-02b2-42e3-9ec8-bedb9d936f4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:36:11.989839 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e28537a-02b2-42e3-9ec8-bedb9d936f4c service cinder] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:36:12.009918 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1395/2771] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:36:11 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:36:13.762886 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659e5269-4c28-44f1-8883-ab0bd4825e4f None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:36:13.781670 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659e5269-4c28-44f1-8883-ab0bd4825e4f None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:36:13.794374 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0ce65a-d147-4794-b147-3617674e2da3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a147e14b61d481db1cac02c58ac3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:36:13.795009 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0ce65a-d147-4794-b147-3617674e2da3 service cinder] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:36:13.795286 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0ce65a-d147-4794-b147-3617674e2da3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:36:13.795558 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0ce65a-d147-4794-b147-3617674e2da3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:36:13.878639 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0ce65a-d147-4794-b147-3617674e2da3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:36:13.880332 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0ce65a-d147-4794-b147-3617674e2da3 service cinder] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:36:13.891368 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1377/2772] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:36:13 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:36:14.564436 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e28537a-02b2-42e3-9ec8-bedb9d936f4c service cinder] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:36:14.579566 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e28537a-02b2-42e3-9ec8-bedb9d936f4c service cinder] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:36:14.584087 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a68c90-982b-498b-837a-c055bc2c87a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a147e14b61d481db1cac02c58ac3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:36:14.585624 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a68c90-982b-498b-837a-c055bc2c87a3 service cinder] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:36:14.585957 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a68c90-982b-498b-837a-c055bc2c87a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:36:14.586234 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a68c90-982b-498b-837a-c055bc2c87a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:36:14.598613 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a68c90-982b-498b-837a-c055bc2c87a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:36:14.600378 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a68c90-982b-498b-837a-c055bc2c87a3 service cinder] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:36:14.614017 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1396/2773] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:36:14 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:36:16.038604 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb9210-2a67-4886-8da8-6bb36e250161 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:36:16.039149 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb9210-2a67-4886-8da8-6bb36e250161 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:36:16.039395 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb9210-2a67-4886-8da8-6bb36e250161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:36:16.084372 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-87eb9210-2a67-4886-8da8-6bb36e250161 None None] MFA Rules not processed for user `41bf15dfacea45a5b5615d7d7524491f`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:36:16.086368 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-87eb9210-2a67-4886-8da8-6bb36e250161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:36:16.196754 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1378/2774] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:36:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:36:16.225404 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a68c90-982b-498b-837a-c055bc2c87a3 service cinder] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:36:16.228062 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-b7a68c90-982b-498b-837a-c055bc2c87a3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:36:16.333317 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a68c90-982b-498b-837a-c055bc2c87a3 service cinder] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:36:16.339602 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf23c8d-e9c2-4d8f-9bc3-67f990e078cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cd6136036bd467c946cae90d5c29263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:36:16.340627 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf23c8d-e9c2-4d8f-9bc3-67f990e078cb service nova] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:36:16.340906 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf23c8d-e9c2-4d8f-9bc3-67f990e078cb service nova] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:36:16.341203 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf23c8d-e9c2-4d8f-9bc3-67f990e078cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:36:16.352515 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf23c8d-e9c2-4d8f-9bc3-67f990e078cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:36:16.356126 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf23c8d-e9c2-4d8f-9bc3-67f990e078cb service nova] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:36:16.369963 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1397/2775] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:36:16 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:36:17.329583 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23facfa0-4849-434c-87ff-7bd1d5af9c87 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:36:17.330452 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23facfa0-4849-434c-87ff-7bd1d5af9c87 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:36:17.330729 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23facfa0-4849-434c-87ff-7bd1d5af9c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:36:17.364544 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-23facfa0-4849-434c-87ff-7bd1d5af9c87 None None] MFA Rules not processed for user `90be99a58aa04bddb65cb18a38889043`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:36:17.366189 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-23facfa0-4849-434c-87ff-7bd1d5af9c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:36:17.410637 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:36:17.434461 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1379/2776] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:36:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:36:17.793947 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c6b24-4725-4da3-9f6a-9f6c91ebdce8 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:36:17.795595 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c6b24-4725-4da3-9f6a-9f6c91ebdce8 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:36:17.795862 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c6b24-4725-4da3-9f6a-9f6c91ebdce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:36:17.830391 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-2e6c6b24-4725-4da3-9f6a-9f6c91ebdce8 None None] MFA Rules not processed for user `41bf15dfacea45a5b5615d7d7524491f`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:36:17.831960 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-2e6c6b24-4725-4da3-9f6a-9f6c91ebdce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:36:17.840257 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1398/2777] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:36:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:36:18.805202 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23facfa0-4849-434c-87ff-7bd1d5af9c87 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:36:18.893448 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23facfa0-4849-434c-87ff-7bd1d5af9c87 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:36:18.900952 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1f014e-6fb0-4dfc-8304-d11e281530b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:36:18.902151 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f014e-6fb0-4dfc-8304-d11e281530b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:36:18.902710 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f014e-6fb0-4dfc-8304-d11e281530b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:36:18.903145 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f014e-6fb0-4dfc-8304-d11e281530b5 admin admin] PATH_INFO: `/v3/users/a0937980aad94bac873b0d776db7c487` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:36:18.905009 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1f014e-6fb0-4dfc-8304-d11e281530b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0937980aad94bac873b0d776db7c487)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:36:18.908011 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1f014e-6fb0-4dfc-8304-d11e281530b5 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:36:18.966030 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-ea1f014e-6fb0-4dfc-8304-d11e281530b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0937980aad94bac873b0d776db7c487'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:36:18.980512 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-ea1f014e-6fb0-4dfc-8304-d11e281530b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0937980aad94bac873b0d776db7c487'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:36:18.989434 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-ea1f014e-6fb0-4dfc-8304-d11e281530b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0937980aad94bac873b0d776db7c487'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:36:18.998451 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-ea1f014e-6fb0-4dfc-8304-d11e281530b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0937980aad94bac873b0d776db7c487'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:36:18.999152 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-ea1f014e-6fb0-4dfc-8304-d11e281530b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0937980aad94bac873b0d776db7c487'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:36:19.009928 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1380/2778] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:36:18 2022] DELETE /identity/v3/users/a0937980aad94bac873b0d776db7c487 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:36:19.011644 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c34ad-7f1f-4722-adf3-10c105d6f87e None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:36:19.012145 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c34ad-7f1f-4722-adf3-10c105d6f87e None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:36:19.012264 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c34ad-7f1f-4722-adf3-10c105d6f87e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:36:19.030962 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-d91c34ad-7f1f-4722-adf3-10c105d6f87e None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:36:19.032303 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-d91c34ad-7f1f-4722-adf3-10c105d6f87e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:36:19.094174 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1399/2779] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:36:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:36:19.104257 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1f014e-6fb0-4dfc-8304-d11e281530b5 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:36:19.105689 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-ea1f014e-6fb0-4dfc-8304-d11e281530b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:36:19.189568 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1f014e-6fb0-4dfc-8304-d11e281530b5 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:36:19.200106 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac27e708-f4ad-499a-a738-bdb873ab659e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:36:19.202493 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac27e708-f4ad-499a-a738-bdb873ab659e service neutron] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:36:19.202815 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac27e708-f4ad-499a-a738-bdb873ab659e service neutron] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:36:19.203096 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac27e708-f4ad-499a-a738-bdb873ab659e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:36:19.229709 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac27e708-f4ad-499a-a738-bdb873ab659e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:36:19.231286 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac27e708-f4ad-499a-a738-bdb873ab659e service neutron] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:36:19.248443 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1381/2780] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:36:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:36:19.798085 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c34ad-7f1f-4722-adf3-10c105d6f87e None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:36:19.799910 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-d91c34ad-7f1f-4722-adf3-10c105d6f87e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:36:19.813613 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c34ad-7f1f-4722-adf3-10c105d6f87e None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:36:19.819218 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b01b203-d644-40e2-af3a-7301e1ae0c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:36:19.820188 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b01b203-d644-40e2-af3a-7301e1ae0c6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:36:19.820541 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b01b203-d644-40e2-af3a-7301e1ae0c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:36:19.820885 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b01b203-d644-40e2-af3a-7301e1ae0c6f admin admin] PATH_INFO: `/v3/projects/c8864be359cc4779b00d52c8d0787abc` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:36:19.822320 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b01b203-d644-40e2-af3a-7301e1ae0c6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8864be359cc4779b00d52c8d0787abc)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:36:19.824297 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b01b203-d644-40e2-af3a-7301e1ae0c6f admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:36:19.855389 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:36:19.889636 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-8b01b203-d644-40e2-af3a-7301e1ae0c6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8864be359cc4779b00d52c8d0787abc', 'request_id': 'req-8b01b203-d644-40e2-af3a-7301e1ae0c6f'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:36:19.900521 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-8b01b203-d644-40e2-af3a-7301e1ae0c6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8864be359cc4779b00d52c8d0787abc', 'request_id': 'req-8b01b203-d644-40e2-af3a-7301e1ae0c6f'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:36:19.909067 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-8b01b203-d644-40e2-af3a-7301e1ae0c6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8864be359cc4779b00d52c8d0787abc', 'request_id': 'req-8b01b203-d644-40e2-af3a-7301e1ae0c6f'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:36:19.932533 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-8b01b203-d644-40e2-af3a-7301e1ae0c6f admin admin] The token cache is being invalidate because project c8864be359cc4779b00d52c8d0787abc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:36:19.933266 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-8b01b203-d644-40e2-af3a-7301e1ae0c6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:36:19.933761 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-8b01b203-d644-40e2-af3a-7301e1ae0c6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:36:19.935929 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1400/2781] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:36:19 2022] DELETE /identity/v3/projects/c8864be359cc4779b00d52c8d0787abc => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:36:19.940594 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac27e708-f4ad-499a-a738-bdb873ab659e service neutron] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:36:19.958233 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac27e708-f4ad-499a-a738-bdb873ab659e service neutron] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:36:19.970624 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:36:20.063040 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19797447-25ab-4bd2-af60-5be97910d879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:36:20.063945 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19797447-25ab-4bd2-af60-5be97910d879 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:36:20.064338 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19797447-25ab-4bd2-af60-5be97910d879 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:36:20.065229 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19797447-25ab-4bd2-af60-5be97910d879 admin admin] PATH_INFO: `/v3/users/11d1f25497754f67b93146799fa60ccf` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:36:20.066869 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19797447-25ab-4bd2-af60-5be97910d879 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11d1f25497754f67b93146799fa60ccf)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:36:20.069000 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19797447-25ab-4bd2-af60-5be97910d879 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:36:20.143286 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-19797447-25ab-4bd2-af60-5be97910d879 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11d1f25497754f67b93146799fa60ccf'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:36:20.159342 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-19797447-25ab-4bd2-af60-5be97910d879 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11d1f25497754f67b93146799fa60ccf'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:36:20.168100 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-19797447-25ab-4bd2-af60-5be97910d879 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11d1f25497754f67b93146799fa60ccf'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:36:20.177810 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-19797447-25ab-4bd2-af60-5be97910d879 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11d1f25497754f67b93146799fa60ccf'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:36:20.178539 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-19797447-25ab-4bd2-af60-5be97910d879 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11d1f25497754f67b93146799fa60ccf'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:36:20.186094 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1382/2782] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:36:19 2022] DELETE /identity/v3/users/11d1f25497754f67b93146799fa60ccf => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 05:36:20.551950 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b01b203-d644-40e2-af3a-7301e1ae0c6f admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:36:20.553632 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-8b01b203-d644-40e2-af3a-7301e1ae0c6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:36:20.576651 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b01b203-d644-40e2-af3a-7301e1ae0c6f admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:36:20.648781 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f09956d-9677-448c-8d29-2242ee90b42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:36:20.649530 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f09956d-9677-448c-8d29-2242ee90b42f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:36:20.649876 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f09956d-9677-448c-8d29-2242ee90b42f admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:36:20.650217 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f09956d-9677-448c-8d29-2242ee90b42f admin admin] PATH_INFO: `/v3/projects/85adc88dd889436897849cfdb4fd3c91` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:36:20.651405 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f09956d-9677-448c-8d29-2242ee90b42f admin admin] RBAC: Authorizing `identity:delete_project(project_id=85adc88dd889436897849cfdb4fd3c91)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:36:20.653442 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f09956d-9677-448c-8d29-2242ee90b42f admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:36:20.702074 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-2f09956d-9677-448c-8d29-2242ee90b42f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85adc88dd889436897849cfdb4fd3c91', 'request_id': 'req-2f09956d-9677-448c-8d29-2242ee90b42f'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:36:20.709647 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-2f09956d-9677-448c-8d29-2242ee90b42f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85adc88dd889436897849cfdb4fd3c91', 'request_id': 'req-2f09956d-9677-448c-8d29-2242ee90b42f'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:36:20.715736 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-2f09956d-9677-448c-8d29-2242ee90b42f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85adc88dd889436897849cfdb4fd3c91', 'request_id': 'req-2f09956d-9677-448c-8d29-2242ee90b42f'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:36:20.730394 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-2f09956d-9677-448c-8d29-2242ee90b42f admin admin] The token cache is being invalidate because project 85adc88dd889436897849cfdb4fd3c91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:36:20.730693 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-2f09956d-9677-448c-8d29-2242ee90b42f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:36:20.731326 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-2f09956d-9677-448c-8d29-2242ee90b42f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:36:20.733154 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1401/2783] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:36:20 2022] DELETE /identity/v3/projects/85adc88dd889436897849cfdb4fd3c91 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:36:20.737213 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19797447-25ab-4bd2-af60-5be97910d879 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:36:20.738902 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-19797447-25ab-4bd2-af60-5be97910d879 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:36:20.752104 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19797447-25ab-4bd2-af60-5be97910d879 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:36:20.825490 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69969dec-6dfe-416d-abc5-4fddd050f6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:36:20.826154 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69969dec-6dfe-416d-abc5-4fddd050f6cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:36:20.826436 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69969dec-6dfe-416d-abc5-4fddd050f6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:36:20.826711 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69969dec-6dfe-416d-abc5-4fddd050f6cb admin admin] PATH_INFO: `/v3/users/8d3c2f2052ee48039e90352bb114f9e5` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:36:20.828438 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69969dec-6dfe-416d-abc5-4fddd050f6cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d3c2f2052ee48039e90352bb114f9e5)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:36:20.831533 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69969dec-6dfe-416d-abc5-4fddd050f6cb admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:36:20.871978 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:36:20.887199 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-69969dec-6dfe-416d-abc5-4fddd050f6cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d3c2f2052ee48039e90352bb114f9e5'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:36:20.900667 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-69969dec-6dfe-416d-abc5-4fddd050f6cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d3c2f2052ee48039e90352bb114f9e5'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:36:20.907910 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-69969dec-6dfe-416d-abc5-4fddd050f6cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d3c2f2052ee48039e90352bb114f9e5'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:36:20.915795 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-69969dec-6dfe-416d-abc5-4fddd050f6cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d3c2f2052ee48039e90352bb114f9e5'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:36:20.916499 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-69969dec-6dfe-416d-abc5-4fddd050f6cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d3c2f2052ee48039e90352bb114f9e5'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:36:20.927048 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1383/2784] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:36:20 2022] DELETE /identity/v3/users/8d3c2f2052ee48039e90352bb114f9e5 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:36:21.211629 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f09956d-9677-448c-8d29-2242ee90b42f admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:36:21.213703 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-2f09956d-9677-448c-8d29-2242ee90b42f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:36:21.227201 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f09956d-9677-448c-8d29-2242ee90b42f admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:36:21.280083 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:36:21.301816 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda60a17-7ed1-4d49-a99d-bf6b61f38058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:36:21.302482 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda60a17-7ed1-4d49-a99d-bf6b61f38058 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:36:21.302746 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda60a17-7ed1-4d49-a99d-bf6b61f38058 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:36:21.303021 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda60a17-7ed1-4d49-a99d-bf6b61f38058 admin admin] PATH_INFO: `/v3/projects/921ea6d9d8114923b4a40ffa6b37fd18` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:36:21.304222 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda60a17-7ed1-4d49-a99d-bf6b61f38058 admin admin] RBAC: Authorizing `identity:delete_project(project_id=921ea6d9d8114923b4a40ffa6b37fd18)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:36:21.306154 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda60a17-7ed1-4d49-a99d-bf6b61f38058 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:36:21.354894 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-eda60a17-7ed1-4d49-a99d-bf6b61f38058 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '921ea6d9d8114923b4a40ffa6b37fd18', 'request_id': 'req-eda60a17-7ed1-4d49-a99d-bf6b61f38058'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:36:21.361969 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-eda60a17-7ed1-4d49-a99d-bf6b61f38058 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '921ea6d9d8114923b4a40ffa6b37fd18', 'request_id': 'req-eda60a17-7ed1-4d49-a99d-bf6b61f38058'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:36:21.372351 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-eda60a17-7ed1-4d49-a99d-bf6b61f38058 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '921ea6d9d8114923b4a40ffa6b37fd18', 'request_id': 'req-eda60a17-7ed1-4d49-a99d-bf6b61f38058'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:36:21.388469 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-eda60a17-7ed1-4d49-a99d-bf6b61f38058 admin admin] The token cache is being invalidate because project 921ea6d9d8114923b4a40ffa6b37fd18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:36:21.388766 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-eda60a17-7ed1-4d49-a99d-bf6b61f38058 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:36:21.389429 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-eda60a17-7ed1-4d49-a99d-bf6b61f38058 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:36:21.390961 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1402/2785] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:36:21 2022] DELETE /identity/v3/projects/921ea6d9d8114923b4a40ffa6b37fd18 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:36:30.920475 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=17,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:36:31.384334 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=32,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:36:31.997079 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9492608-ba16-4ed1-a650-7c8790369938 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:36:31.997618 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9492608-ba16-4ed1-a650-7c8790369938 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:36:31.997704 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9492608-ba16-4ed1-a650-7c8790369938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:36:32.017468 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-a9492608-ba16-4ed1-a650-7c8790369938 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:36:32.018674 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-a9492608-ba16-4ed1-a650-7c8790369938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:36:32.081216 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1384/2786] 10.222.0.43 () {58 vars in 1016 bytes} [Sun Sep 11 05:36:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:36:32.094826 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda60a17-7ed1-4d49-a99d-bf6b61f38058 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:36:32.098028 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-eda60a17-7ed1-4d49-a99d-bf6b61f38058 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:36:32.172335 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda60a17-7ed1-4d49-a99d-bf6b61f38058 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:36:32.178958 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1454124-feea-467b-898b-99845539919a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cd6136036bd467c946cae90d5c29263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:36:32.179564 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1454124-feea-467b-898b-99845539919a service nova] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:36:32.179870 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1454124-feea-467b-898b-99845539919a service nova] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:36:32.180141 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1454124-feea-467b-898b-99845539919a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:36:32.188765 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1454124-feea-467b-898b-99845539919a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:36:32.190467 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1454124-feea-467b-898b-99845539919a service nova] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:36:32.200075 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1403/2787] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:36:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 05:36:32.791147 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9492608-ba16-4ed1-a650-7c8790369938 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:36:32.792591 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-a9492608-ba16-4ed1-a650-7c8790369938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:36:32.807882 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9492608-ba16-4ed1-a650-7c8790369938 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:36:32.813490 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fca01b1-d496-4b19-a3c7-7d51ed359327 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cd6136036bd467c946cae90d5c29263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:36:32.814106 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fca01b1-d496-4b19-a3c7-7d51ed359327 service nova] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:36:32.814393 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fca01b1-d496-4b19-a3c7-7d51ed359327 service nova] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:36:32.814664 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fca01b1-d496-4b19-a3c7-7d51ed359327 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:36:32.816893 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-5fca01b1-d496-4b19-a3c7-7d51ed359327 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:36:32.829151 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fca01b1-d496-4b19-a3c7-7d51ed359327 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:36:32.830737 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fca01b1-d496-4b19-a3c7-7d51ed359327 service nova] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:36:32.842060 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1385/2788] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:36:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:36:35.233895 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9baaf78-bdf9-4189-a142-c166ce8cfb54 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:36:35.234450 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9baaf78-bdf9-4189-a142-c166ce8cfb54 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:36:35.234450 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9baaf78-bdf9-4189-a142-c166ce8cfb54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:36:35.255261 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-e9baaf78-bdf9-4189-a142-c166ce8cfb54 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:36:35.256493 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-e9baaf78-bdf9-4189-a142-c166ce8cfb54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:36:35.264375 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1404/2789] 10.222.0.43 () {58 vars in 1016 bytes} [Sun Sep 11 05:36:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:36:35.277561 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fca01b1-d496-4b19-a3c7-7d51ed359327 service nova] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:36:35.290105 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fca01b1-d496-4b19-a3c7-7d51ed359327 service nova] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:36:35.295558 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6ec349-a14c-430f-b34a-2138471f0032 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cd6136036bd467c946cae90d5c29263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:36:35.296177 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6ec349-a14c-430f-b34a-2138471f0032 service nova] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:36:35.296452 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6ec349-a14c-430f-b34a-2138471f0032 service nova] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:36:35.296720 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6ec349-a14c-430f-b34a-2138471f0032 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:36:35.305523 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6ec349-a14c-430f-b34a-2138471f0032 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:36:35.307089 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6ec349-a14c-430f-b34a-2138471f0032 service nova] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:36:35.316401 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1386/2790] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:36:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:36:38.330433 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c5c1c-d2e4-4daa-98f9-2901d907f294 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:36:38.330949 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c5c1c-d2e4-4daa-98f9-2901d907f294 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:36:38.331057 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c5c1c-d2e4-4daa-98f9-2901d907f294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:36:38.350927 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-605c5c1c-d2e4-4daa-98f9-2901d907f294 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:36:38.352162 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-605c5c1c-d2e4-4daa-98f9-2901d907f294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:36:38.360150 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1405/2791] 10.222.0.43 () {58 vars in 1016 bytes} [Sun Sep 11 05:36:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:36:38.374981 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6ec349-a14c-430f-b34a-2138471f0032 service nova] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:36:38.386165 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6ec349-a14c-430f-b34a-2138471f0032 service nova] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:36:38.391712 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc57c581-e142-4b1f-b9b1-16e2e0125e2f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cd6136036bd467c946cae90d5c29263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:36:38.392302 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc57c581-e142-4b1f-b9b1-16e2e0125e2f service nova] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:36:38.392581 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc57c581-e142-4b1f-b9b1-16e2e0125e2f service nova] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:36:38.392853 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc57c581-e142-4b1f-b9b1-16e2e0125e2f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:36:38.401484 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc57c581-e142-4b1f-b9b1-16e2e0125e2f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:36:38.403046 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc57c581-e142-4b1f-b9b1-16e2e0125e2f service nova] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:36:38.412971 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1387/2792] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:36:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:36:41.473638 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef63351-a380-42ad-bc4f-386d0b400fe3 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:36:41.474142 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef63351-a380-42ad-bc4f-386d0b400fe3 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:36:41.474260 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef63351-a380-42ad-bc4f-386d0b400fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:36:41.493224 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-fef63351-a380-42ad-bc4f-386d0b400fe3 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:36:41.494403 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-fef63351-a380-42ad-bc4f-386d0b400fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:36:41.502506 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1406/2793] 10.222.0.43 () {58 vars in 1016 bytes} [Sun Sep 11 05:36:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:36:41.517568 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc57c581-e142-4b1f-b9b1-16e2e0125e2f service nova] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:36:41.529160 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc57c581-e142-4b1f-b9b1-16e2e0125e2f service nova] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:36:41.534514 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de878d0-c9d1-402e-bad8-38f0364f8fae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cd6136036bd467c946cae90d5c29263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:36:41.535098 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de878d0-c9d1-402e-bad8-38f0364f8fae service nova] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:36:41.536020 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de878d0-c9d1-402e-bad8-38f0364f8fae service nova] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:36:41.536290 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de878d0-c9d1-402e-bad8-38f0364f8fae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:36:41.544325 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de878d0-c9d1-402e-bad8-38f0364f8fae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:36:41.545881 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de878d0-c9d1-402e-bad8-38f0364f8fae service nova] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:36:41.555050 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1388/2794] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:36:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:36:44.641710 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33f726-4bf5-4913-ad84-e0abd28748e6 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:36:44.642212 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33f726-4bf5-4913-ad84-e0abd28748e6 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:36:44.642334 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33f726-4bf5-4913-ad84-e0abd28748e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:36:44.662477 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-1e33f726-4bf5-4913-ad84-e0abd28748e6 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:36:44.663660 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-1e33f726-4bf5-4913-ad84-e0abd28748e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:36:44.671413 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1407/2795] 10.222.0.43 () {58 vars in 1016 bytes} [Sun Sep 11 05:36:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:36:44.689215 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de878d0-c9d1-402e-bad8-38f0364f8fae service nova] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:36:44.700891 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de878d0-c9d1-402e-bad8-38f0364f8fae service nova] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:36:44.706314 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f720bba-1b65-4170-bfbd-d9c072218888 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cd6136036bd467c946cae90d5c29263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:36:44.706904 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f720bba-1b65-4170-bfbd-d9c072218888 service nova] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:36:44.707183 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f720bba-1b65-4170-bfbd-d9c072218888 service nova] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:36:44.707476 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f720bba-1b65-4170-bfbd-d9c072218888 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:36:44.716172 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f720bba-1b65-4170-bfbd-d9c072218888 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:36:44.717736 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f720bba-1b65-4170-bfbd-d9c072218888 service nova] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:36:44.726987 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1389/2796] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:36:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:36:54.656786 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=46 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:36:54.723299 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=57 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:37:12.740176 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93626ec0-26a4-4a63-8be2-c41cb77c3498 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:37:12.740792 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93626ec0-26a4-4a63-8be2-c41cb77c3498 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:37:12.740792 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93626ec0-26a4-4a63-8be2-c41cb77c3498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:37:12.760001 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-93626ec0-26a4-4a63-8be2-c41cb77c3498 None None] MFA Rules not processed for user `41bf15dfacea45a5b5615d7d7524491f`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:37:12.761201 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-93626ec0-26a4-4a63-8be2-c41cb77c3498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:37:12.815415 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1408/2797] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:37:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:37:13.914115 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f720bba-1b65-4170-bfbd-d9c072218888 service nova] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:37:13.915766 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-8f720bba-1b65-4170-bfbd-d9c072218888 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:37:13.930333 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f720bba-1b65-4170-bfbd-d9c072218888 service nova] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:37:13.935498 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86fdd54-953c-4ddf-b41e-a063e160c7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:37:13.936163 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86fdd54-953c-4ddf-b41e-a063e160c7ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:37:13.936444 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86fdd54-953c-4ddf-b41e-a063e160c7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:37:13.936723 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86fdd54-953c-4ddf-b41e-a063e160c7ba admin admin] PATH_INFO: `/v3/users/90be99a58aa04bddb65cb18a38889043` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:37:13.937854 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86fdd54-953c-4ddf-b41e-a063e160c7ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=90be99a58aa04bddb65cb18a38889043)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:37:13.939802 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86fdd54-953c-4ddf-b41e-a063e160c7ba admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:37:13.990701 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-a86fdd54-953c-4ddf-b41e-a063e160c7ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90be99a58aa04bddb65cb18a38889043'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:37:14.003721 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-a86fdd54-953c-4ddf-b41e-a063e160c7ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90be99a58aa04bddb65cb18a38889043'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:37:14.011486 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-a86fdd54-953c-4ddf-b41e-a063e160c7ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90be99a58aa04bddb65cb18a38889043'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:37:14.020027 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-a86fdd54-953c-4ddf-b41e-a063e160c7ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90be99a58aa04bddb65cb18a38889043'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:37:14.020800 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-a86fdd54-953c-4ddf-b41e-a063e160c7ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90be99a58aa04bddb65cb18a38889043'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:37:14.026702 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1390/2798] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:37:13 2022] DELETE /identity/v3/users/90be99a58aa04bddb65cb18a38889043 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:37:14.205248 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93626ec0-26a4-4a63-8be2-c41cb77c3498 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:37:14.216150 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93626ec0-26a4-4a63-8be2-c41cb77c3498 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:37:14.289815 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a200fa-9663-48a2-8785-92ceb727f6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:37:14.290485 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a200fa-9663-48a2-8785-92ceb727f6aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:37:14.290973 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a200fa-9663-48a2-8785-92ceb727f6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:37:14.291255 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a200fa-9663-48a2-8785-92ceb727f6aa admin admin] PATH_INFO: `/v3/projects/cb13ab3298724362af9bfb5777527621` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:37:14.292303 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a200fa-9663-48a2-8785-92ceb727f6aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb13ab3298724362af9bfb5777527621)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:37:14.294267 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a200fa-9663-48a2-8785-92ceb727f6aa admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:37:14.344870 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-60a200fa-9663-48a2-8785-92ceb727f6aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb13ab3298724362af9bfb5777527621', 'request_id': 'req-60a200fa-9663-48a2-8785-92ceb727f6aa'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:37:14.351788 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-60a200fa-9663-48a2-8785-92ceb727f6aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb13ab3298724362af9bfb5777527621', 'request_id': 'req-60a200fa-9663-48a2-8785-92ceb727f6aa'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:37:14.357482 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-60a200fa-9663-48a2-8785-92ceb727f6aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb13ab3298724362af9bfb5777527621', 'request_id': 'req-60a200fa-9663-48a2-8785-92ceb727f6aa'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:37:14.370338 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-60a200fa-9663-48a2-8785-92ceb727f6aa admin admin] The token cache is being invalidate because project cb13ab3298724362af9bfb5777527621 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:37:14.370627 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-60a200fa-9663-48a2-8785-92ceb727f6aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:37:14.371245 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-60a200fa-9663-48a2-8785-92ceb727f6aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:37:14.372801 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1409/2799] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:37:14 2022] DELETE /identity/v3/projects/cb13ab3298724362af9bfb5777527621 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:37:24.023226 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:37:24.367152 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=76,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:38:07.674612 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86fdd54-953c-4ddf-b41e-a063e160c7ba admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:38:07.676140 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-a86fdd54-953c-4ddf-b41e-a063e160c7ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:38:07.836524 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86fdd54-953c-4ddf-b41e-a063e160c7ba admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:38:07.896391 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fe2999-93e0-43b2-9018-08166a166c08 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72e1d7dd79ff43e7b585b5090762465f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:38:07.897003 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe2999-93e0-43b2-9018-08166a166c08 service placement] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:38:07.897285 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe2999-93e0-43b2-9018-08166a166c08 service placement] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:38:07.897550 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe2999-93e0-43b2-9018-08166a166c08 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:38:07.899267 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-86fe2999-93e0-43b2-9018-08166a166c08 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:38:07.910569 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fe2999-93e0-43b2-9018-08166a166c08 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:38:07.912173 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fe2999-93e0-43b2-9018-08166a166c08 service placement] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:38:07.922039 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1391/2800] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:38:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:38:10.566486 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c2821-ceec-44b5-82f3-5ce364562a82 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:38:10.567005 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c2821-ceec-44b5-82f3-5ce364562a82 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:38:10.567113 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c2821-ceec-44b5-82f3-5ce364562a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:38:10.586754 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-a89c2821-ceec-44b5-82f3-5ce364562a82 None None] MFA Rules not processed for user `41bf15dfacea45a5b5615d7d7524491f`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:38:10.588005 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-a89c2821-ceec-44b5-82f3-5ce364562a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:38:10.653417 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1410/2801] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:38:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:38:17.917709 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=89 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:38:20.646186 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=25 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:39:00.596742 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486364fb-e083-467d-87eb-b393ab99b95b None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:39:00.597261 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486364fb-e083-467d-87eb-b393ab99b95b None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:39:00.597261 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486364fb-e083-467d-87eb-b393ab99b95b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:39:00.616957 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-486364fb-e083-467d-87eb-b393ab99b95b None None] MFA Rules not processed for user `41bf15dfacea45a5b5615d7d7524491f`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:39:00.618191 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-486364fb-e083-467d-87eb-b393ab99b95b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:39:00.624950 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1392/2802] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:39:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:39:10.610960 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=3 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:39:47.030679 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89c2821-ceec-44b5-82f3-5ce364562a82 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:39:47.032163 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-a89c2821-ceec-44b5-82f3-5ce364562a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:39:47.108985 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89c2821-ceec-44b5-82f3-5ce364562a82 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:39:47.112608 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3371f8-f0a1-4d35-9156-391415c6fc23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a147e14b61d481db1cac02c58ac3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:39:47.113208 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3371f8-f0a1-4d35-9156-391415c6fc23 service cinder] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:39:47.113485 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3371f8-f0a1-4d35-9156-391415c6fc23 service cinder] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:39:47.113756 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3371f8-f0a1-4d35-9156-391415c6fc23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:39:47.115451 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-5b3371f8-f0a1-4d35-9156-391415c6fc23 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:39:47.201890 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3371f8-f0a1-4d35-9156-391415c6fc23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:39:47.203332 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3371f8-f0a1-4d35-9156-391415c6fc23 service cinder] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:39:47.224109 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1411/2803] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:39:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:39:48.940462 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486364fb-e083-467d-87eb-b393ab99b95b None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:39:48.950059 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486364fb-e083-467d-87eb-b393ab99b95b None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:39:48.953602 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999cac77-f6e7-49bf-aaae-2b7aa8deae46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a147e14b61d481db1cac02c58ac3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:39:48.954195 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999cac77-f6e7-49bf-aaae-2b7aa8deae46 service cinder] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:39:48.955054 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999cac77-f6e7-49bf-aaae-2b7aa8deae46 service cinder] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:39:48.955332 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999cac77-f6e7-49bf-aaae-2b7aa8deae46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:39:48.957120 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-999cac77-f6e7-49bf-aaae-2b7aa8deae46 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:39:48.970198 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999cac77-f6e7-49bf-aaae-2b7aa8deae46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:39:48.971612 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999cac77-f6e7-49bf-aaae-2b7aa8deae46 service cinder] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:39:48.982730 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1393/2804] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:39:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:39:57.221554 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=75 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:39:58.977628 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=6 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:40:01.062905 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3371f8-f0a1-4d35-9156-391415c6fc23 service cinder] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:01.064963 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-5b3371f8-f0a1-4d35-9156-391415c6fc23 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:40:01.162942 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3371f8-f0a1-4d35-9156-391415c6fc23 service cinder] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:01.167481 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b505057b-dc14-4df2-af14-45b39dff86b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:01.168130 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b505057b-dc14-4df2-af14-45b39dff86b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:01.168406 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b505057b-dc14-4df2-af14-45b39dff86b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:01.168675 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b505057b-dc14-4df2-af14-45b39dff86b9 admin admin] PATH_INFO: `/v3/users/41bf15dfacea45a5b5615d7d7524491f` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:01.169787 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b505057b-dc14-4df2-af14-45b39dff86b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41bf15dfacea45a5b5615d7d7524491f)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:01.171774 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b505057b-dc14-4df2-af14-45b39dff86b9 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:01.217231 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-b505057b-dc14-4df2-af14-45b39dff86b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41bf15dfacea45a5b5615d7d7524491f'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:01.228718 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-b505057b-dc14-4df2-af14-45b39dff86b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41bf15dfacea45a5b5615d7d7524491f'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:01.236143 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-b505057b-dc14-4df2-af14-45b39dff86b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41bf15dfacea45a5b5615d7d7524491f'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:01.243939 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-b505057b-dc14-4df2-af14-45b39dff86b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41bf15dfacea45a5b5615d7d7524491f'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:01.244564 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-b505057b-dc14-4df2-af14-45b39dff86b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41bf15dfacea45a5b5615d7d7524491f'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:01.250533 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1412/2805] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:40:01 2022] DELETE /identity/v3/users/41bf15dfacea45a5b5615d7d7524491f => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:40:01.416765 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999cac77-f6e7-49bf-aaae-2b7aa8deae46 service cinder] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:01.428087 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999cac77-f6e7-49bf-aaae-2b7aa8deae46 service cinder] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:01.485961 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bef324-4e53-4022-9650-9459bc2ba9df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:01.486668 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bef324-4e53-4022-9650-9459bc2ba9df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:01.486886 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bef324-4e53-4022-9650-9459bc2ba9df admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:01.487149 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bef324-4e53-4022-9650-9459bc2ba9df admin admin] PATH_INFO: `/v3/projects/cbfe4f58ecf446688356869d6b26f7c7` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:01.488291 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bef324-4e53-4022-9650-9459bc2ba9df admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbfe4f58ecf446688356869d6b26f7c7)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:01.490199 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bef324-4e53-4022-9650-9459bc2ba9df admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:01.534601 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-35bef324-4e53-4022-9650-9459bc2ba9df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbfe4f58ecf446688356869d6b26f7c7', 'request_id': 'req-35bef324-4e53-4022-9650-9459bc2ba9df'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:01.542576 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-35bef324-4e53-4022-9650-9459bc2ba9df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbfe4f58ecf446688356869d6b26f7c7', 'request_id': 'req-35bef324-4e53-4022-9650-9459bc2ba9df'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:01.548753 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-35bef324-4e53-4022-9650-9459bc2ba9df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbfe4f58ecf446688356869d6b26f7c7', 'request_id': 'req-35bef324-4e53-4022-9650-9459bc2ba9df'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:01.559542 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-35bef324-4e53-4022-9650-9459bc2ba9df admin admin] The token cache is being invalidate because project cbfe4f58ecf446688356869d6b26f7c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81383) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:40:01.560080 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-35bef324-4e53-4022-9650-9459bc2ba9df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:01.560602 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-35bef324-4e53-4022-9650-9459bc2ba9df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:01.562265 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1394/2806] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:40:01 2022] DELETE /identity/v3/projects/cbfe4f58ecf446688356869d6b26f7c7 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:40:01.567652 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726692ec-d96d-43a6-87cc-606342b0a1f2 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:01.568016 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726692ec-d96d-43a6-87cc-606342b0a1f2 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:01.568236 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726692ec-d96d-43a6-87cc-606342b0a1f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:01.629255 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-726692ec-d96d-43a6-87cc-606342b0a1f2 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:40:01.630519 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-726692ec-d96d-43a6-87cc-606342b0a1f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:40:01.643641 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:40:01.696526 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1413/2807] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:40:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:40:01.704741 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e14539d-b324-49d2-a961-abc2625f67fe None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:01.705027 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e14539d-b324-49d2-a961-abc2625f67fe None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:01.705300 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e14539d-b324-49d2-a961-abc2625f67fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:01.725377 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-4e14539d-b324-49d2-a961-abc2625f67fe None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:40:01.726582 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-4e14539d-b324-49d2-a961-abc2625f67fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:40:01.734650 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1395/2808] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:40:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:40:01.739511 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726692ec-d96d-43a6-87cc-606342b0a1f2 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:01.749111 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726692ec-d96d-43a6-87cc-606342b0a1f2 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:01.753770 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac8af4e-b511-4811-81ee-8e732413cd27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:01.754365 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac8af4e-b511-4811-81ee-8e732413cd27 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:01.754638 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac8af4e-b511-4811-81ee-8e732413cd27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:01.754903 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac8af4e-b511-4811-81ee-8e732413cd27 admin admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:01.755541 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac8af4e-b511-4811-81ee-8e732413cd27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:40:01.755876 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac8af4e-b511-4811-81ee-8e732413cd27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:01.757480 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac8af4e-b511-4811-81ee-8e732413cd27 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:01.769838 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1414/2809] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 05:40:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:40:01.774012 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e14539d-b324-49d2-a961-abc2625f67fe None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:01.786323 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e14539d-b324-49d2-a961-abc2625f67fe None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:01.791265 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9579778f-1b06-481a-a4d7-dfec1d68fd00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:01.791953 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9579778f-1b06-481a-a4d7-dfec1d68fd00 admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:01.792229 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9579778f-1b06-481a-a4d7-dfec1d68fd00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:01.792497 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9579778f-1b06-481a-a4d7-dfec1d68fd00 admin admin] PATH_INFO: `/v3/projects` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:01.793137 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9579778f-1b06-481a-a4d7-dfec1d68fd00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:01.795060 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9579778f-1b06-481a-a4d7-dfec1d68fd00 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:01.832720 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1396/2810] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:40:01 2022] POST /identity/v3/projects => generated 375 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 05:40:01.836843 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac8af4e-b511-4811-81ee-8e732413cd27 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:01.847321 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac8af4e-b511-4811-81ee-8e732413cd27 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:01.903788 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37e299d-175d-48cb-ad1d-c46c3a696b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:01.904534 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e299d-175d-48cb-ad1d-c46c3a696b33 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:01.904814 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e299d-175d-48cb-ad1d-c46c3a696b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:01.905087 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e299d-175d-48cb-ad1d-c46c3a696b33 admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:01.905890 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37e299d-175d-48cb-ad1d-c46c3a696b33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:01.908699 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37e299d-175d-48cb-ad1d-c46c3a696b33 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:01.930939 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1415/2811] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:40:01 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:40:01.936428 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9579778f-1b06-481a-a4d7-dfec1d68fd00 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:01.947277 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9579778f-1b06-481a-a4d7-dfec1d68fd00 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:01.952392 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f857d8-07fc-4425-a1d7-918dd53b6522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:01.952999 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f857d8-07fc-4425-a1d7-918dd53b6522 admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:01.953275 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f857d8-07fc-4425-a1d7-918dd53b6522 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:01.953545 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f857d8-07fc-4425-a1d7-918dd53b6522 admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:01.954209 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f857d8-07fc-4425-a1d7-918dd53b6522 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:01.955829 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f857d8-07fc-4425-a1d7-918dd53b6522 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:01.965969 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1397/2812] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:40:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:40:01.970556 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37e299d-175d-48cb-ad1d-c46c3a696b33 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:01.982868 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37e299d-175d-48cb-ad1d-c46c3a696b33 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:01.989436 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b36a25-5516-45aa-9f5f-91e4cba4e069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:01.990075 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b36a25-5516-45aa-9f5f-91e4cba4e069 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:01.990296 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b36a25-5516-45aa-9f5f-91e4cba4e069 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:01.990572 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b36a25-5516-45aa-9f5f-91e4cba4e069 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:01.991214 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b36a25-5516-45aa-9f5f-91e4cba4e069 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:01.992857 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b36a25-5516-45aa-9f5f-91e4cba4e069 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:02.004214 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1416/2813] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:40:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:40:02.008471 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f857d8-07fc-4425-a1d7-918dd53b6522 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:02.019393 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f857d8-07fc-4425-a1d7-918dd53b6522 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:02.023966 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd820584-56e5-4152-8417-18cee25865dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:02.024822 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd820584-56e5-4152-8417-18cee25865dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:02.025131 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd820584-56e5-4152-8417-18cee25865dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:02.025398 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd820584-56e5-4152-8417-18cee25865dd admin admin] PATH_INFO: `/v3/projects/ab2fda168a5f4323a60403292f2b0d16/users/ee80d5d3e6ab4fd7b8cd609c313efe64/roles/aa7ff8e0ec1e48e5811335b9eb38b448` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:02.040979 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd820584-56e5-4152-8417-18cee25865dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab2fda168a5f4323a60403292f2b0d16, user_id=ee80d5d3e6ab4fd7b8cd609c313efe64, role_id=aa7ff8e0ec1e48e5811335b9eb38b448)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:02.043620 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd820584-56e5-4152-8417-18cee25865dd admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:02.057039 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1398/2814] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:40:02 2022] PUT /identity/v3/projects/ab2fda168a5f4323a60403292f2b0d16/users/ee80d5d3e6ab4fd7b8cd609c313efe64/roles/aa7ff8e0ec1e48e5811335b9eb38b448 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:40:02.067261 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db3048c-e51e-42c4-905f-52c92094c018 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:02.067815 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db3048c-e51e-42c4-905f-52c92094c018 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:02.067919 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db3048c-e51e-42c4-905f-52c92094c018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:02.097186 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-0db3048c-e51e-42c4-905f-52c92094c018 None None] MFA Rules not processed for user `ee80d5d3e6ab4fd7b8cd609c313efe64`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:40:02.098415 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-0db3048c-e51e-42c4-905f-52c92094c018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:40:02.161990 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1417/2815] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:40:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:40:02.173307 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd820584-56e5-4152-8417-18cee25865dd admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:02.174986 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-fd820584-56e5-4152-8417-18cee25865dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:40:02.195070 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:40:02.251526 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd820584-56e5-4152-8417-18cee25865dd admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:02.257375 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9cfc6c-b26c-435d-b223-d409a01fd5ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cd6136036bd467c946cae90d5c29263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:02.258082 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9cfc6c-b26c-435d-b223-d409a01fd5ac service nova] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:02.258355 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9cfc6c-b26c-435d-b223-d409a01fd5ac service nova] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:02.258621 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9cfc6c-b26c-435d-b223-d409a01fd5ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:02.269972 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9cfc6c-b26c-435d-b223-d409a01fd5ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:02.273940 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9cfc6c-b26c-435d-b223-d409a01fd5ac service nova] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:02.286452 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1399/2816] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:40:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:40:02.509101 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db3048c-e51e-42c4-905f-52c92094c018 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:02.526929 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:40:02.572851 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db3048c-e51e-42c4-905f-52c92094c018 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:02.577283 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3167d113-150b-4dd5-9112-470c8b3554e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:02.577898 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3167d113-150b-4dd5-9112-470c8b3554e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:02.578175 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3167d113-150b-4dd5-9112-470c8b3554e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:02.578439 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3167d113-150b-4dd5-9112-470c8b3554e7 admin admin] PATH_INFO: `/v3/users/ee80d5d3e6ab4fd7b8cd609c313efe64` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:02.580217 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3167d113-150b-4dd5-9112-470c8b3554e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee80d5d3e6ab4fd7b8cd609c313efe64)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:02.582192 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3167d113-150b-4dd5-9112-470c8b3554e7 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:02.627427 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-3167d113-150b-4dd5-9112-470c8b3554e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee80d5d3e6ab4fd7b8cd609c313efe64'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:02.642371 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-3167d113-150b-4dd5-9112-470c8b3554e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee80d5d3e6ab4fd7b8cd609c313efe64'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:02.649090 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-3167d113-150b-4dd5-9112-470c8b3554e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee80d5d3e6ab4fd7b8cd609c313efe64'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:02.656426 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-3167d113-150b-4dd5-9112-470c8b3554e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee80d5d3e6ab4fd7b8cd609c313efe64'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:02.657098 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-3167d113-150b-4dd5-9112-470c8b3554e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee80d5d3e6ab4fd7b8cd609c313efe64'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:02.662944 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1418/2817] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:40:02 2022] DELETE /identity/v3/users/ee80d5d3e6ab4fd7b8cd609c313efe64 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:40:02.667458 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ebb2e-cd23-4379-9d3c-c7203ff43358 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:02.667990 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ebb2e-cd23-4379-9d3c-c7203ff43358 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:02.668097 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ebb2e-cd23-4379-9d3c-c7203ff43358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:02.687182 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-511ebb2e-cd23-4379-9d3c-c7203ff43358 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:40:02.688935 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-511ebb2e-cd23-4379-9d3c-c7203ff43358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:40:02.746577 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1400/2818] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:40:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:40:02.758833 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3167d113-150b-4dd5-9112-470c8b3554e7 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:02.760270 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-3167d113-150b-4dd5-9112-470c8b3554e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:40:02.837760 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3167d113-150b-4dd5-9112-470c8b3554e7 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:02.841475 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a780744-4ea3-4e1c-a842-213996c3dc42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:02.842074 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a780744-4ea3-4e1c-a842-213996c3dc42 service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:02.842352 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a780744-4ea3-4e1c-a842-213996c3dc42 service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:02.842622 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a780744-4ea3-4e1c-a842-213996c3dc42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:02.851443 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a780744-4ea3-4e1c-a842-213996c3dc42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:02.852897 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a780744-4ea3-4e1c-a842-213996c3dc42 service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:02.862939 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1419/2819] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:40:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:40:03.133226 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511ebb2e-cd23-4379-9d3c-c7203ff43358 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:03.134664 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-511ebb2e-cd23-4379-9d3c-c7203ff43358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:40:03.147246 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511ebb2e-cd23-4379-9d3c-c7203ff43358 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:03.151862 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b62463-faee-4764-8e82-dd2e89df1eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:03.152707 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b62463-faee-4764-8e82-dd2e89df1eb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:03.152985 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b62463-faee-4764-8e82-dd2e89df1eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:03.153259 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b62463-faee-4764-8e82-dd2e89df1eb7 admin admin] PATH_INFO: `/v3/projects/ab2fda168a5f4323a60403292f2b0d16` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:03.154415 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b62463-faee-4764-8e82-dd2e89df1eb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab2fda168a5f4323a60403292f2b0d16)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:03.156380 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b62463-faee-4764-8e82-dd2e89df1eb7 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:03.202723 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-a3b62463-faee-4764-8e82-dd2e89df1eb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab2fda168a5f4323a60403292f2b0d16', 'request_id': 'req-a3b62463-faee-4764-8e82-dd2e89df1eb7'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:03.211885 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-a3b62463-faee-4764-8e82-dd2e89df1eb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab2fda168a5f4323a60403292f2b0d16', 'request_id': 'req-a3b62463-faee-4764-8e82-dd2e89df1eb7'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:03.217758 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-a3b62463-faee-4764-8e82-dd2e89df1eb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab2fda168a5f4323a60403292f2b0d16', 'request_id': 'req-a3b62463-faee-4764-8e82-dd2e89df1eb7'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:03.228980 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-a3b62463-faee-4764-8e82-dd2e89df1eb7 admin admin] The token cache is being invalidate because project ab2fda168a5f4323a60403292f2b0d16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81383) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:40:03.229271 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-a3b62463-faee-4764-8e82-dd2e89df1eb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:03.230148 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-a3b62463-faee-4764-8e82-dd2e89df1eb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:03.231627 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1401/2820] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:40:03 2022] DELETE /identity/v3/projects/ab2fda168a5f4323a60403292f2b0d16 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:40:03.236575 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5aa608-496d-473d-9e44-341528c45d4e None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:03.237044 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5aa608-496d-473d-9e44-341528c45d4e None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:03.237155 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5aa608-496d-473d-9e44-341528c45d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:03.256866 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-dc5aa608-496d-473d-9e44-341528c45d4e None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:40:03.258005 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-dc5aa608-496d-473d-9e44-341528c45d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:40:03.270767 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:40:03.318155 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1420/2821] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:40:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:40:03.326019 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c65a3b-6ce6-4514-9c79-cc0cda0e4086 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:03.326332 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c65a3b-6ce6-4514-9c79-cc0cda0e4086 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:03.326606 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c65a3b-6ce6-4514-9c79-cc0cda0e4086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:03.346437 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-74c65a3b-6ce6-4514-9c79-cc0cda0e4086 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:40:03.347635 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-74c65a3b-6ce6-4514-9c79-cc0cda0e4086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:40:03.355627 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1402/2822] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:40:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:40:03.359753 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5aa608-496d-473d-9e44-341528c45d4e None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:03.369387 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5aa608-496d-473d-9e44-341528c45d4e None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:03.374106 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a712e61c-ee22-4e3a-ba54-0a8029e43619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:03.374702 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a712e61c-ee22-4e3a-ba54-0a8029e43619 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:03.374984 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a712e61c-ee22-4e3a-ba54-0a8029e43619 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:03.375260 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a712e61c-ee22-4e3a-ba54-0a8029e43619 admin admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:03.376429 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a712e61c-ee22-4e3a-ba54-0a8029e43619 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:40:03.376736 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a712e61c-ee22-4e3a-ba54-0a8029e43619 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:03.378582 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a712e61c-ee22-4e3a-ba54-0a8029e43619 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:03.390336 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1421/2823] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 05:40:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:40:03.395157 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c65a3b-6ce6-4514-9c79-cc0cda0e4086 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:03.404525 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c65a3b-6ce6-4514-9c79-cc0cda0e4086 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:03.409483 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5da2cc-7d98-4a50-8d5d-6c7657370eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:03.410094 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5da2cc-7d98-4a50-8d5d-6c7657370eaa admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:03.410410 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5da2cc-7d98-4a50-8d5d-6c7657370eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:03.410713 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5da2cc-7d98-4a50-8d5d-6c7657370eaa admin admin] PATH_INFO: `/v3/projects` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:03.411355 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5da2cc-7d98-4a50-8d5d-6c7657370eaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:03.413311 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5da2cc-7d98-4a50-8d5d-6c7657370eaa admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:03.433521 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:40:03.442557 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1403/2824] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:40:03 2022] POST /identity/v3/projects => generated 387 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:40:03.446913 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a712e61c-ee22-4e3a-ba54-0a8029e43619 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:03.457733 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a712e61c-ee22-4e3a-ba54-0a8029e43619 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:03.515127 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1622c876-695b-48a3-84cb-58be5119d6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:03.515671 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622c876-695b-48a3-84cb-58be5119d6a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:03.515975 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622c876-695b-48a3-84cb-58be5119d6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:03.516305 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622c876-695b-48a3-84cb-58be5119d6a0 admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:03.516939 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1622c876-695b-48a3-84cb-58be5119d6a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:03.518876 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1622c876-695b-48a3-84cb-58be5119d6a0 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:03.538514 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1422/2825] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:40:03 2022] POST /identity/v3/users => generated 294 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 05:40:03.542664 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5da2cc-7d98-4a50-8d5d-6c7657370eaa admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:03.553535 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5da2cc-7d98-4a50-8d5d-6c7657370eaa admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:03.558389 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12e5289-96f7-400d-9a13-f6cda263eb1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:03.558992 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e5289-96f7-400d-9a13-f6cda263eb1f admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:03.559271 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e5289-96f7-400d-9a13-f6cda263eb1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:03.559542 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e5289-96f7-400d-9a13-f6cda263eb1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:03.560247 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12e5289-96f7-400d-9a13-f6cda263eb1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:03.561872 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12e5289-96f7-400d-9a13-f6cda263eb1f admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:03.572484 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1404/2826] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:40:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:40:03.576323 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1622c876-695b-48a3-84cb-58be5119d6a0 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:03.586179 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1622c876-695b-48a3-84cb-58be5119d6a0 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:03.590794 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf7511f-29fb-4305-891b-6cd45c322ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:03.591386 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7511f-29fb-4305-891b-6cd45c322ccc admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:03.591668 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7511f-29fb-4305-891b-6cd45c322ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:03.591974 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7511f-29fb-4305-891b-6cd45c322ccc admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:03.592615 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf7511f-29fb-4305-891b-6cd45c322ccc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:03.594314 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf7511f-29fb-4305-891b-6cd45c322ccc admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:03.604972 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1423/2827] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:40:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:40:03.608966 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12e5289-96f7-400d-9a13-f6cda263eb1f admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:03.619339 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12e5289-96f7-400d-9a13-f6cda263eb1f admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:03.623873 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a36ebe7-a950-4b1f-990a-b7efc5d13e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:03.624510 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a36ebe7-a950-4b1f-990a-b7efc5d13e27 admin admin] REQUEST_METHOD: `PUT` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:03.624788 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a36ebe7-a950-4b1f-990a-b7efc5d13e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:03.625057 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a36ebe7-a950-4b1f-990a-b7efc5d13e27 admin admin] PATH_INFO: `/v3/projects/e11ed9611115489c84a1290db9d96fc5/users/a1c3e1963ad448179a6abfbd1c556cab/roles/aa7ff8e0ec1e48e5811335b9eb38b448` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:03.640401 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a36ebe7-a950-4b1f-990a-b7efc5d13e27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e11ed9611115489c84a1290db9d96fc5, user_id=a1c3e1963ad448179a6abfbd1c556cab, role_id=aa7ff8e0ec1e48e5811335b9eb38b448)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:03.643187 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a36ebe7-a950-4b1f-990a-b7efc5d13e27 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:03.656214 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1405/2828] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:40:03 2022] PUT /identity/v3/projects/e11ed9611115489c84a1290db9d96fc5/users/a1c3e1963ad448179a6abfbd1c556cab/roles/aa7ff8e0ec1e48e5811335b9eb38b448 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 05:40:03.667323 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9756500-9577-4907-9e3c-59d74e0516d9 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:03.667609 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9756500-9577-4907-9e3c-59d74e0516d9 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:03.667916 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9756500-9577-4907-9e3c-59d74e0516d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:03.696199 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-f9756500-9577-4907-9e3c-59d74e0516d9 None None] MFA Rules not processed for user `a1c3e1963ad448179a6abfbd1c556cab`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:40:03.697433 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-f9756500-9577-4907-9e3c-59d74e0516d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:40:03.761202 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1424/2829] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:40:03 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:40:03.765779 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a36ebe7-a950-4b1f-990a-b7efc5d13e27 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:03.827887 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a36ebe7-a950-4b1f-990a-b7efc5d13e27 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:03.832537 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f84e825-ae91-443d-ac3a-a21fddeeb9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:03.833127 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84e825-ae91-443d-ac3a-a21fddeeb9d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:03.833408 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84e825-ae91-443d-ac3a-a21fddeeb9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:03.833676 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84e825-ae91-443d-ac3a-a21fddeeb9d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:03.834317 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f84e825-ae91-443d-ac3a-a21fddeeb9d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:03.836249 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f84e825-ae91-443d-ac3a-a21fddeeb9d9 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:03.863928 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1406/2830] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:40:03 2022] POST /identity/v3/projects => generated 387 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:40:03.867972 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9756500-9577-4907-9e3c-59d74e0516d9 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:03.878636 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9756500-9577-4907-9e3c-59d74e0516d9 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:03.887271 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:40:03.935293 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0635a99-aa6e-4c20-853e-a1c40a62312a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:03.935941 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0635a99-aa6e-4c20-853e-a1c40a62312a admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:03.936222 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0635a99-aa6e-4c20-853e-a1c40a62312a admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:03.936493 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0635a99-aa6e-4c20-853e-a1c40a62312a admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:03.937112 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0635a99-aa6e-4c20-853e-a1c40a62312a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:03.939061 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0635a99-aa6e-4c20-853e-a1c40a62312a admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:03.959718 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1425/2831] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:40:03 2022] POST /identity/v3/users => generated 300 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:40:03.963922 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f84e825-ae91-443d-ac3a-a21fddeeb9d9 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:03.974927 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f84e825-ae91-443d-ac3a-a21fddeeb9d9 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:03.979806 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4326e72-4491-4f82-ab1e-dff2ab6ee5b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:03.980415 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4326e72-4491-4f82-ab1e-dff2ab6ee5b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:03.980697 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4326e72-4491-4f82-ab1e-dff2ab6ee5b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:03.980969 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4326e72-4491-4f82-ab1e-dff2ab6ee5b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:03.981609 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4326e72-4491-4f82-ab1e-dff2ab6ee5b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:03.983203 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4326e72-4491-4f82-ab1e-dff2ab6ee5b4 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:03.994196 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1407/2832] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:40:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:40:03.998193 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0635a99-aa6e-4c20-853e-a1c40a62312a admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:04.008614 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0635a99-aa6e-4c20-853e-a1c40a62312a admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:04.013149 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d934c8-5a6d-4760-ac8a-1f24e8a0ddd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:04.013789 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d934c8-5a6d-4760-ac8a-1f24e8a0ddd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:04.014065 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d934c8-5a6d-4760-ac8a-1f24e8a0ddd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:04.014333 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d934c8-5a6d-4760-ac8a-1f24e8a0ddd6 admin admin] PATH_INFO: `/v3/projects/e6ca45e7232844ba84aae5c17c4cbd6e/users/dbe2a280871f40229a88852e6dd13afc/roles/5b702713e40145b49e0b42abd0a5fba9` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:04.029238 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d934c8-5a6d-4760-ac8a-1f24e8a0ddd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6ca45e7232844ba84aae5c17c4cbd6e, user_id=dbe2a280871f40229a88852e6dd13afc, role_id=5b702713e40145b49e0b42abd0a5fba9)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:04.032561 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d934c8-5a6d-4760-ac8a-1f24e8a0ddd6 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:04.046265 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1426/2833] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:40:03 2022] PUT /identity/v3/projects/e6ca45e7232844ba84aae5c17c4cbd6e/users/dbe2a280871f40229a88852e6dd13afc/roles/5b702713e40145b49e0b42abd0a5fba9 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:40:04.050685 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4326e72-4491-4f82-ab1e-dff2ab6ee5b4 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:04.060546 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4326e72-4491-4f82-ab1e-dff2ab6ee5b4 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:04.115253 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3141b830-a612-4c47-a452-ee22a41a69f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:04.115880 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3141b830-a612-4c47-a452-ee22a41a69f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:04.116156 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3141b830-a612-4c47-a452-ee22a41a69f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:04.116424 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3141b830-a612-4c47-a452-ee22a41a69f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:04.117048 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3141b830-a612-4c47-a452-ee22a41a69f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:04.118633 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3141b830-a612-4c47-a452-ee22a41a69f4 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:04.128105 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1408/2834] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:40:04 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:40:04.132219 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d934c8-5a6d-4760-ac8a-1f24e8a0ddd6 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:04.142415 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d934c8-5a6d-4760-ac8a-1f24e8a0ddd6 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:04.146992 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742d8843-5e98-44e2-b454-c8388b9a6354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:04.147641 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742d8843-5e98-44e2-b454-c8388b9a6354 admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:04.147952 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742d8843-5e98-44e2-b454-c8388b9a6354 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:04.148226 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742d8843-5e98-44e2-b454-c8388b9a6354 admin admin] PATH_INFO: `/v3/projects/e6ca45e7232844ba84aae5c17c4cbd6e/users/dbe2a280871f40229a88852e6dd13afc/roles/5b702713e40145b49e0b42abd0a5fba9` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:04.150135 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742d8843-5e98-44e2-b454-c8388b9a6354 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6ca45e7232844ba84aae5c17c4cbd6e, user_id=dbe2a280871f40229a88852e6dd13afc, role_id=5b702713e40145b49e0b42abd0a5fba9)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:04.152869 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742d8843-5e98-44e2-b454-c8388b9a6354 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:04.163489 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1427/2835] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:40:04 2022] PUT /identity/v3/projects/e6ca45e7232844ba84aae5c17c4cbd6e/users/dbe2a280871f40229a88852e6dd13afc/roles/5b702713e40145b49e0b42abd0a5fba9 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:40:04.173998 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e1b5b-9396-4ad7-b312-84a1dbe40151 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:04.174284 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e1b5b-9396-4ad7-b312-84a1dbe40151 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:04.174558 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e1b5b-9396-4ad7-b312-84a1dbe40151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:04.201239 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-430e1b5b-9396-4ad7-b312-84a1dbe40151 None None] MFA Rules not processed for user `dbe2a280871f40229a88852e6dd13afc`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:40:04.202435 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-430e1b5b-9396-4ad7-b312-84a1dbe40151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:40:04.222904 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:40:04.271255 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1409/2836] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:40:04 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 05:40:04.283157 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742d8843-5e98-44e2-b454-c8388b9a6354 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:04.284832 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-742d8843-5e98-44e2-b454-c8388b9a6354 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:40:04.345421 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742d8843-5e98-44e2-b454-c8388b9a6354 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:04.349140 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f71439-e8f5-4c1d-a5ae-67f32504c915 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a147e14b61d481db1cac02c58ac3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:04.349747 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f71439-e8f5-4c1d-a5ae-67f32504c915 service cinder] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:04.350024 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f71439-e8f5-4c1d-a5ae-67f32504c915 service cinder] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:04.350287 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f71439-e8f5-4c1d-a5ae-67f32504c915 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:04.360370 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f71439-e8f5-4c1d-a5ae-67f32504c915 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:04.361808 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f71439-e8f5-4c1d-a5ae-67f32504c915 service cinder] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:04.371471 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1428/2837] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:40:04 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:40:04.436195 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430e1b5b-9396-4ad7-b312-84a1dbe40151 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:04.498092 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430e1b5b-9396-4ad7-b312-84a1dbe40151 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:04.502687 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfadbdd0-26a5-46cf-8714-f247fd096b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:04.503316 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfadbdd0-26a5-46cf-8714-f247fd096b73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:04.503596 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfadbdd0-26a5-46cf-8714-f247fd096b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:04.503901 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfadbdd0-26a5-46cf-8714-f247fd096b73 admin admin] PATH_INFO: `/v3/users/a1c3e1963ad448179a6abfbd1c556cab` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:04.505033 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfadbdd0-26a5-46cf-8714-f247fd096b73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1c3e1963ad448179a6abfbd1c556cab)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:04.506963 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfadbdd0-26a5-46cf-8714-f247fd096b73 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:04.554160 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-cfadbdd0-26a5-46cf-8714-f247fd096b73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1c3e1963ad448179a6abfbd1c556cab'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:04.565870 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-cfadbdd0-26a5-46cf-8714-f247fd096b73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1c3e1963ad448179a6abfbd1c556cab'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:04.572672 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-cfadbdd0-26a5-46cf-8714-f247fd096b73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1c3e1963ad448179a6abfbd1c556cab'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:04.580681 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-cfadbdd0-26a5-46cf-8714-f247fd096b73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1c3e1963ad448179a6abfbd1c556cab'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:04.581325 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-cfadbdd0-26a5-46cf-8714-f247fd096b73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1c3e1963ad448179a6abfbd1c556cab'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:04.587169 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1410/2838] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:40:04 2022] DELETE /identity/v3/users/a1c3e1963ad448179a6abfbd1c556cab => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:40:04.591738 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de40a4-bc5a-4456-ba4c-cdc5d2d62197 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:04.592054 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de40a4-bc5a-4456-ba4c-cdc5d2d62197 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:04.592382 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de40a4-bc5a-4456-ba4c-cdc5d2d62197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:04.612210 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-f0de40a4-bc5a-4456-ba4c-cdc5d2d62197 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:40:04.613403 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-f0de40a4-bc5a-4456-ba4c-cdc5d2d62197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:40:04.671065 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1429/2839] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:40:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:40:04.683610 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfadbdd0-26a5-46cf-8714-f247fd096b73 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:04.685052 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-cfadbdd0-26a5-46cf-8714-f247fd096b73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:40:04.729956 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:40:04.747543 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfadbdd0-26a5-46cf-8714-f247fd096b73 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:04.751242 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c1e55a-7bd4-4303-9445-b21bb752d469 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:04.751872 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c1e55a-7bd4-4303-9445-b21bb752d469 service neutron] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:04.752155 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c1e55a-7bd4-4303-9445-b21bb752d469 service neutron] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:04.752422 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c1e55a-7bd4-4303-9445-b21bb752d469 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:04.761616 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c1e55a-7bd4-4303-9445-b21bb752d469 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:04.763048 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c1e55a-7bd4-4303-9445-b21bb752d469 service neutron] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:04.772419 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1411/2840] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:40:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:40:05.034926 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0de40a4-bc5a-4456-ba4c-cdc5d2d62197 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:05.036426 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-f0de40a4-bc5a-4456-ba4c-cdc5d2d62197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:40:05.049696 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0de40a4-bc5a-4456-ba4c-cdc5d2d62197 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:05.054514 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ea1ce0-ce02-4140-a5f7-a2b577afe0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:05.055673 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea1ce0-ce02-4140-a5f7-a2b577afe0bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:05.056267 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea1ce0-ce02-4140-a5f7-a2b577afe0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:05.056582 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea1ce0-ce02-4140-a5f7-a2b577afe0bc admin admin] PATH_INFO: `/v3/projects/e11ed9611115489c84a1290db9d96fc5` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:05.057761 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ea1ce0-ce02-4140-a5f7-a2b577afe0bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=e11ed9611115489c84a1290db9d96fc5)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:05.059861 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ea1ce0-ce02-4140-a5f7-a2b577afe0bc admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:05.062278 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:40:05.108411 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-82ea1ce0-ce02-4140-a5f7-a2b577afe0bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e11ed9611115489c84a1290db9d96fc5', 'request_id': 'req-82ea1ce0-ce02-4140-a5f7-a2b577afe0bc'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:05.114966 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-82ea1ce0-ce02-4140-a5f7-a2b577afe0bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e11ed9611115489c84a1290db9d96fc5', 'request_id': 'req-82ea1ce0-ce02-4140-a5f7-a2b577afe0bc'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:05.120531 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-82ea1ce0-ce02-4140-a5f7-a2b577afe0bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e11ed9611115489c84a1290db9d96fc5', 'request_id': 'req-82ea1ce0-ce02-4140-a5f7-a2b577afe0bc'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:05.133487 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-82ea1ce0-ce02-4140-a5f7-a2b577afe0bc admin admin] The token cache is being invalidate because project e11ed9611115489c84a1290db9d96fc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:40:05.133776 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-82ea1ce0-ce02-4140-a5f7-a2b577afe0bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:05.134395 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-82ea1ce0-ce02-4140-a5f7-a2b577afe0bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:05.135903 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1430/2841] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:40:05 2022] DELETE /identity/v3/projects/e11ed9611115489c84a1290db9d96fc5 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:40:05.139901 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c1e55a-7bd4-4303-9445-b21bb752d469 service neutron] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:05.149526 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c1e55a-7bd4-4303-9445-b21bb752d469 service neutron] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:05.205524 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498cc6a6-aec8-4b21-a078-d453458d4d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:05.206192 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498cc6a6-aec8-4b21-a078-d453458d4d23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:05.206472 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498cc6a6-aec8-4b21-a078-d453458d4d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:05.206745 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498cc6a6-aec8-4b21-a078-d453458d4d23 admin admin] PATH_INFO: `/v3/users/dbe2a280871f40229a88852e6dd13afc` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:05.207908 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498cc6a6-aec8-4b21-a078-d453458d4d23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbe2a280871f40229a88852e6dd13afc)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:05.209819 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498cc6a6-aec8-4b21-a078-d453458d4d23 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:05.258412 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-498cc6a6-aec8-4b21-a078-d453458d4d23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbe2a280871f40229a88852e6dd13afc'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:05.273109 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-498cc6a6-aec8-4b21-a078-d453458d4d23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbe2a280871f40229a88852e6dd13afc'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:05.280641 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-498cc6a6-aec8-4b21-a078-d453458d4d23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbe2a280871f40229a88852e6dd13afc'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:05.288294 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-498cc6a6-aec8-4b21-a078-d453458d4d23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbe2a280871f40229a88852e6dd13afc'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:05.289120 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-498cc6a6-aec8-4b21-a078-d453458d4d23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbe2a280871f40229a88852e6dd13afc'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:05.295223 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1412/2842] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:40:05 2022] DELETE /identity/v3/users/dbe2a280871f40229a88852e6dd13afc => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:40:05.563527 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ea1ce0-ce02-4140-a5f7-a2b577afe0bc admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:05.565066 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-82ea1ce0-ce02-4140-a5f7-a2b577afe0bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:40:05.580543 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ea1ce0-ce02-4140-a5f7-a2b577afe0bc admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:05.644161 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc5a70d-18b6-48b7-85b8-92ccddbd61eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:05.644798 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc5a70d-18b6-48b7-85b8-92ccddbd61eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:05.645070 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc5a70d-18b6-48b7-85b8-92ccddbd61eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:05.645337 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc5a70d-18b6-48b7-85b8-92ccddbd61eb admin admin] PATH_INFO: `/v3/projects/e6ca45e7232844ba84aae5c17c4cbd6e` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:05.646438 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc5a70d-18b6-48b7-85b8-92ccddbd61eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6ca45e7232844ba84aae5c17c4cbd6e)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:05.648387 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc5a70d-18b6-48b7-85b8-92ccddbd61eb admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:05.692918 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-5fc5a70d-18b6-48b7-85b8-92ccddbd61eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6ca45e7232844ba84aae5c17c4cbd6e', 'request_id': 'req-5fc5a70d-18b6-48b7-85b8-92ccddbd61eb'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:05.699048 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-5fc5a70d-18b6-48b7-85b8-92ccddbd61eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6ca45e7232844ba84aae5c17c4cbd6e', 'request_id': 'req-5fc5a70d-18b6-48b7-85b8-92ccddbd61eb'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:05.705167 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-5fc5a70d-18b6-48b7-85b8-92ccddbd61eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6ca45e7232844ba84aae5c17c4cbd6e', 'request_id': 'req-5fc5a70d-18b6-48b7-85b8-92ccddbd61eb'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:05.717175 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-5fc5a70d-18b6-48b7-85b8-92ccddbd61eb admin admin] The token cache is being invalidate because project e6ca45e7232844ba84aae5c17c4cbd6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:40:05.717490 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-5fc5a70d-18b6-48b7-85b8-92ccddbd61eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:05.718115 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-5fc5a70d-18b6-48b7-85b8-92ccddbd61eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:05.719563 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1431/2843] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:40:05 2022] DELETE /identity/v3/projects/e6ca45e7232844ba84aae5c17c4cbd6e => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:40:05.724550 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739c0c9c-0196-47eb-95d8-35f3ed6c5739 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:05.724829 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739c0c9c-0196-47eb-95d8-35f3ed6c5739 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:05.725098 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739c0c9c-0196-47eb-95d8-35f3ed6c5739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:05.744832 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-739c0c9c-0196-47eb-95d8-35f3ed6c5739 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:40:05.746013 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-739c0c9c-0196-47eb-95d8-35f3ed6c5739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:40:05.798050 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:40:05.808298 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1413/2844] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:40:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 05:40:05.818145 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df865f6c-39e5-4384-b14c-130906554120 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:05.818527 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df865f6c-39e5-4384-b14c-130906554120 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:05.818893 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df865f6c-39e5-4384-b14c-130906554120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:05.838258 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-df865f6c-39e5-4384-b14c-130906554120 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:40:05.839460 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-df865f6c-39e5-4384-b14c-130906554120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:40:05.847303 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1432/2845] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:40:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:40:05.851494 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739c0c9c-0196-47eb-95d8-35f3ed6c5739 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:05.862034 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739c0c9c-0196-47eb-95d8-35f3ed6c5739 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:05.866750 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60c21e5-6943-4f4d-b02b-94bf60737fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:05.867405 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c21e5-6943-4f4d-b02b-94bf60737fcb admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:05.867694 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c21e5-6943-4f4d-b02b-94bf60737fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:05.867977 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c21e5-6943-4f4d-b02b-94bf60737fcb admin admin] PATH_INFO: `/v3/domains` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:05.868623 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60c21e5-6943-4f4d-b02b-94bf60737fcb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81383) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:40:05.868946 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60c21e5-6943-4f4d-b02b-94bf60737fcb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:05.870554 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60c21e5-6943-4f4d-b02b-94bf60737fcb admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:05.882617 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1414/2846] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 05:40:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:40:05.886585 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df865f6c-39e5-4384-b14c-130906554120 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:05.895976 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df865f6c-39e5-4384-b14c-130906554120 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:05.900728 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e3deae-e80c-4502-bbef-2275b6c12da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:05.901320 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e3deae-e80c-4502-bbef-2275b6c12da2 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:05.901616 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e3deae-e80c-4502-bbef-2275b6c12da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:05.901870 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e3deae-e80c-4502-bbef-2275b6c12da2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:05.902492 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e3deae-e80c-4502-bbef-2275b6c12da2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:05.904435 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e3deae-e80c-4502-bbef-2275b6c12da2 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:05.918944 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:40:05.932698 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1433/2847] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:40:05 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:40:05.936790 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60c21e5-6943-4f4d-b02b-94bf60737fcb admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:05.947429 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60c21e5-6943-4f4d-b02b-94bf60737fcb admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:06.002802 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdfb90b-9187-4769-8d9f-5e5fe6ac4fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:06.003408 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdfb90b-9187-4769-8d9f-5e5fe6ac4fb5 admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:06.003720 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdfb90b-9187-4769-8d9f-5e5fe6ac4fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:06.003984 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdfb90b-9187-4769-8d9f-5e5fe6ac4fb5 admin admin] PATH_INFO: `/v3/users` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:06.004645 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdfb90b-9187-4769-8d9f-5e5fe6ac4fb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:06.006558 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdfb90b-9187-4769-8d9f-5e5fe6ac4fb5 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:06.026951 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1415/2848] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:40:05 2022] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:40:06.031010 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e3deae-e80c-4502-bbef-2275b6c12da2 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:06.041412 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e3deae-e80c-4502-bbef-2275b6c12da2 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:06.046094 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8833182-56c1-48a2-97b6-34d37a123560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:06.046721 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8833182-56c1-48a2-97b6-34d37a123560 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:06.046999 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8833182-56c1-48a2-97b6-34d37a123560 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:06.047799 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8833182-56c1-48a2-97b6-34d37a123560 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:06.048466 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8833182-56c1-48a2-97b6-34d37a123560 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:06.050083 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8833182-56c1-48a2-97b6-34d37a123560 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:06.059971 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1434/2849] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:40:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:40:06.064352 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdfb90b-9187-4769-8d9f-5e5fe6ac4fb5 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:06.074237 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdfb90b-9187-4769-8d9f-5e5fe6ac4fb5 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:06.079232 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f29f1e-b2fc-4f9c-bdda-ae4d0e916956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:06.079866 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f29f1e-b2fc-4f9c-bdda-ae4d0e916956 admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:06.080146 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f29f1e-b2fc-4f9c-bdda-ae4d0e916956 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:06.080422 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f29f1e-b2fc-4f9c-bdda-ae4d0e916956 admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:06.081062 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f29f1e-b2fc-4f9c-bdda-ae4d0e916956 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:06.082651 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f29f1e-b2fc-4f9c-bdda-ae4d0e916956 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:06.093357 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1416/2850] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:40:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:40:06.098405 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8833182-56c1-48a2-97b6-34d37a123560 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:06.108931 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8833182-56c1-48a2-97b6-34d37a123560 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:06.114222 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b1184e-5fcb-4c64-8343-143a2fa1446d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:06.114866 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b1184e-5fcb-4c64-8343-143a2fa1446d admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:06.115163 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b1184e-5fcb-4c64-8343-143a2fa1446d admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:06.115434 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b1184e-5fcb-4c64-8343-143a2fa1446d admin admin] PATH_INFO: `/v3/projects/980b029697a84bfbb1cb06ec4ca5d0c7/users/ca1d263412bd4d4a98314e60da7cc63b/roles/aa7ff8e0ec1e48e5811335b9eb38b448` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:06.129749 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b1184e-5fcb-4c64-8343-143a2fa1446d admin admin] RBAC: Authorizing `identity:create_grant(project_id=980b029697a84bfbb1cb06ec4ca5d0c7, user_id=ca1d263412bd4d4a98314e60da7cc63b, role_id=aa7ff8e0ec1e48e5811335b9eb38b448)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:06.132498 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b1184e-5fcb-4c64-8343-143a2fa1446d admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:06.145141 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1435/2851] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:40:06 2022] PUT /identity/v3/projects/980b029697a84bfbb1cb06ec4ca5d0c7/users/ca1d263412bd4d4a98314e60da7cc63b/roles/aa7ff8e0ec1e48e5811335b9eb38b448 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:40:06.155351 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7200c9ce-ac16-4453-a05c-26c1f012b442 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:06.155598 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7200c9ce-ac16-4453-a05c-26c1f012b442 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:06.155903 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7200c9ce-ac16-4453-a05c-26c1f012b442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:06.183552 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-7200c9ce-ac16-4453-a05c-26c1f012b442 None None] MFA Rules not processed for user `ca1d263412bd4d4a98314e60da7cc63b`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:40:06.184769 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-7200c9ce-ac16-4453-a05c-26c1f012b442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:40:06.246954 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1417/2852] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:40:06 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:40:06.251362 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b1184e-5fcb-4c64-8343-143a2fa1446d admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:06.312402 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b1184e-5fcb-4c64-8343-143a2fa1446d admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:06.317056 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9480a662-4d95-4bbd-977a-373edf366a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:06.317657 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480a662-4d95-4bbd-977a-373edf366a15 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:06.317937 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480a662-4d95-4bbd-977a-373edf366a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:06.318213 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480a662-4d95-4bbd-977a-373edf366a15 admin admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:06.318835 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9480a662-4d95-4bbd-977a-373edf366a15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:06.320792 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9480a662-4d95-4bbd-977a-373edf366a15 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:06.346809 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1436/2853] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:40:06 2022] POST /identity/v3/projects => generated 381 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:40:06.350988 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7200c9ce-ac16-4453-a05c-26c1f012b442 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:06.362463 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7200c9ce-ac16-4453-a05c-26c1f012b442 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:06.411649 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:40:06.419216 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b9dfde-c2b4-437a-a9f3-6a65340b1a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:06.419862 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b9dfde-c2b4-437a-a9f3-6a65340b1a11 admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:06.420146 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b9dfde-c2b4-437a-a9f3-6a65340b1a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:06.420420 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b9dfde-c2b4-437a-a9f3-6a65340b1a11 admin admin] PATH_INFO: `/v3/users` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:06.421053 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b9dfde-c2b4-437a-a9f3-6a65340b1a11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:06.423602 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b9dfde-c2b4-437a-a9f3-6a65340b1a11 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:06.445720 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1418/2854] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:40:06 2022] POST /identity/v3/users => generated 297 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:40:06.448010 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9480a662-4d95-4bbd-977a-373edf366a15 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:06.458221 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9480a662-4d95-4bbd-977a-373edf366a15 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:06.463065 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d9b7b9-c339-439e-9d7d-5102b7a0900c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:06.463661 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9b7b9-c339-439e-9d7d-5102b7a0900c admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:06.463968 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9b7b9-c339-439e-9d7d-5102b7a0900c admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:06.464240 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9b7b9-c339-439e-9d7d-5102b7a0900c admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:06.464906 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d9b7b9-c339-439e-9d7d-5102b7a0900c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:06.466499 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d9b7b9-c339-439e-9d7d-5102b7a0900c admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:06.477350 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1437/2855] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:40:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:40:06.481561 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b9dfde-c2b4-437a-a9f3-6a65340b1a11 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:06.492004 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b9dfde-c2b4-437a-a9f3-6a65340b1a11 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:06.496589 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1895fe-68e2-4a05-ab2a-f39ec6ca520b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:06.497227 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1895fe-68e2-4a05-ab2a-f39ec6ca520b admin admin] REQUEST_METHOD: `PUT` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:06.497502 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1895fe-68e2-4a05-ab2a-f39ec6ca520b admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:06.497772 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1895fe-68e2-4a05-ab2a-f39ec6ca520b admin admin] PATH_INFO: `/v3/projects/6cbe33e150e74eb4b5089210cfd77e40/users/ce23a47039fe4830807c4f9cb3528d6e/roles/5b702713e40145b49e0b42abd0a5fba9` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:06.512181 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1895fe-68e2-4a05-ab2a-f39ec6ca520b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cbe33e150e74eb4b5089210cfd77e40, user_id=ce23a47039fe4830807c4f9cb3528d6e, role_id=5b702713e40145b49e0b42abd0a5fba9)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:06.514825 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1895fe-68e2-4a05-ab2a-f39ec6ca520b admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:06.527806 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1419/2856] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:40:06 2022] PUT /identity/v3/projects/6cbe33e150e74eb4b5089210cfd77e40/users/ce23a47039fe4830807c4f9cb3528d6e/roles/5b702713e40145b49e0b42abd0a5fba9 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:40:06.532122 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d9b7b9-c339-439e-9d7d-5102b7a0900c admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:06.541947 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d9b7b9-c339-439e-9d7d-5102b7a0900c admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:06.598007 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8820e911-cc4b-4701-a161-39963558efd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:06.598670 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8820e911-cc4b-4701-a161-39963558efd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:06.598865 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8820e911-cc4b-4701-a161-39963558efd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:06.599144 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8820e911-cc4b-4701-a161-39963558efd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:06.599972 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8820e911-cc4b-4701-a161-39963558efd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:06.601733 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8820e911-cc4b-4701-a161-39963558efd8 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:06.611600 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1438/2857] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:40:06 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 05:40:06.615843 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1895fe-68e2-4a05-ab2a-f39ec6ca520b admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:06.626176 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1895fe-68e2-4a05-ab2a-f39ec6ca520b admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:06.630888 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1889a29d-125a-4fa6-a4be-2a7a9b2c1495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:06.631533 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889a29d-125a-4fa6-a4be-2a7a9b2c1495 admin admin] REQUEST_METHOD: `PUT` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:06.631845 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889a29d-125a-4fa6-a4be-2a7a9b2c1495 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:06.632118 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889a29d-125a-4fa6-a4be-2a7a9b2c1495 admin admin] PATH_INFO: `/v3/projects/6cbe33e150e74eb4b5089210cfd77e40/users/ce23a47039fe4830807c4f9cb3528d6e/roles/5b702713e40145b49e0b42abd0a5fba9` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:06.634021 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1889a29d-125a-4fa6-a4be-2a7a9b2c1495 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cbe33e150e74eb4b5089210cfd77e40, user_id=ce23a47039fe4830807c4f9cb3528d6e, role_id=5b702713e40145b49e0b42abd0a5fba9)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:06.637179 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1889a29d-125a-4fa6-a4be-2a7a9b2c1495 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:06.654822 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1420/2858] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:40:06 2022] PUT /identity/v3/projects/6cbe33e150e74eb4b5089210cfd77e40/users/ce23a47039fe4830807c4f9cb3528d6e/roles/5b702713e40145b49e0b42abd0a5fba9 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:40:06.667152 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e86d0da-6dbc-478c-9025-e55bbbb9cbcf None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:06.667369 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e86d0da-6dbc-478c-9025-e55bbbb9cbcf None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:06.667642 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e86d0da-6dbc-478c-9025-e55bbbb9cbcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:06.695083 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-7e86d0da-6dbc-478c-9025-e55bbbb9cbcf None None] MFA Rules not processed for user `ce23a47039fe4830807c4f9cb3528d6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:40:06.696317 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-7e86d0da-6dbc-478c-9025-e55bbbb9cbcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:40:06.713266 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:40:06.766667 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1439/2859] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:40:06 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:40:06.778703 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1889a29d-125a-4fa6-a4be-2a7a9b2c1495 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:06.780442 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-1889a29d-125a-4fa6-a4be-2a7a9b2c1495 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:40:06.838548 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1889a29d-125a-4fa6-a4be-2a7a9b2c1495 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:06.842242 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014db51a-c5b8-414e-9e83-e3a47a5ae876 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a147e14b61d481db1cac02c58ac3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:06.842842 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014db51a-c5b8-414e-9e83-e3a47a5ae876 service cinder] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:06.843119 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014db51a-c5b8-414e-9e83-e3a47a5ae876 service cinder] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:06.843387 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014db51a-c5b8-414e-9e83-e3a47a5ae876 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:06.853027 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014db51a-c5b8-414e-9e83-e3a47a5ae876 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:06.854442 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014db51a-c5b8-414e-9e83-e3a47a5ae876 service cinder] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:06.864045 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1421/2860] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:40:06 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:40:07.177566 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e86d0da-6dbc-478c-9025-e55bbbb9cbcf None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:07.186906 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e86d0da-6dbc-478c-9025-e55bbbb9cbcf None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:07.191972 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fe2ef9-c734-4bad-9959-4279f3bdeeb4 tempest-VolumeQuotaClassesTest-1686068170 tempest-VolumeQuotaClassesTest-1686068170-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce23a47039fe4830807c4f9cb3528d6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbe33e150e74eb4b5089210cfd77e40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:07.192600 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe2ef9-c734-4bad-9959-4279f3bdeeb4 tempest-VolumeQuotaClassesTest-1686068170 tempest-VolumeQuotaClassesTest-1686068170-project-admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:07.192878 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe2ef9-c734-4bad-9959-4279f3bdeeb4 tempest-VolumeQuotaClassesTest-1686068170 tempest-VolumeQuotaClassesTest-1686068170-project-admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:07.193150 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe2ef9-c734-4bad-9959-4279f3bdeeb4 tempest-VolumeQuotaClassesTest-1686068170 tempest-VolumeQuotaClassesTest-1686068170-project-admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:07.193790 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fe2ef9-c734-4bad-9959-4279f3bdeeb4 tempest-VolumeQuotaClassesTest-1686068170 tempest-VolumeQuotaClassesTest-1686068170-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:40:07.194090 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fe2ef9-c734-4bad-9959-4279f3bdeeb4 tempest-VolumeQuotaClassesTest-1686068170 tempest-VolumeQuotaClassesTest-1686068170-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:07.195696 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fe2ef9-c734-4bad-9959-4279f3bdeeb4 tempest-VolumeQuotaClassesTest-1686068170 tempest-VolumeQuotaClassesTest-1686068170-project-admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:07.207499 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1440/2861] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 05:40:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:40:07.211490 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014db51a-c5b8-414e-9e83-e3a47a5ae876 service cinder] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:07.220435 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014db51a-c5b8-414e-9e83-e3a47a5ae876 service cinder] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:07.224982 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a87e844-f625-4d5a-a51c-50a3faaf8b4e tempest-VolumeQuotaClassesTest-1686068170 tempest-VolumeQuotaClassesTest-1686068170-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce23a47039fe4830807c4f9cb3528d6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbe33e150e74eb4b5089210cfd77e40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:07.225568 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a87e844-f625-4d5a-a51c-50a3faaf8b4e tempest-VolumeQuotaClassesTest-1686068170 tempest-VolumeQuotaClassesTest-1686068170-project-admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:07.225845 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a87e844-f625-4d5a-a51c-50a3faaf8b4e tempest-VolumeQuotaClassesTest-1686068170 tempest-VolumeQuotaClassesTest-1686068170-project-admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:07.226114 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a87e844-f625-4d5a-a51c-50a3faaf8b4e tempest-VolumeQuotaClassesTest-1686068170 tempest-VolumeQuotaClassesTest-1686068170-project-admin] PATH_INFO: `/v3/projects` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:07.226746 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a87e844-f625-4d5a-a51c-50a3faaf8b4e tempest-VolumeQuotaClassesTest-1686068170 tempest-VolumeQuotaClassesTest-1686068170-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:07.228669 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a87e844-f625-4d5a-a51c-50a3faaf8b4e tempest-VolumeQuotaClassesTest-1686068170 tempest-VolumeQuotaClassesTest-1686068170-project-admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:07.257047 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1422/2862] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:40:07 2022] POST /identity/v3/projects => generated 355 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:40:07.259496 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fe2ef9-c734-4bad-9959-4279f3bdeeb4 tempest-VolumeQuotaClassesTest-1686068170 tempest-VolumeQuotaClassesTest-1686068170-project-admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:07.270418 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fe2ef9-c734-4bad-9959-4279f3bdeeb4 tempest-VolumeQuotaClassesTest-1686068170 tempest-VolumeQuotaClassesTest-1686068170-project-admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:07.331187 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb44e1b4-24f0-400f-98bb-112c938020f9 tempest-VolumeQuotaClassesTest-1686068170 tempest-VolumeQuotaClassesTest-1686068170-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce23a47039fe4830807c4f9cb3528d6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbe33e150e74eb4b5089210cfd77e40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:07.331846 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44e1b4-24f0-400f-98bb-112c938020f9 tempest-VolumeQuotaClassesTest-1686068170 tempest-VolumeQuotaClassesTest-1686068170-project-admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:07.332123 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44e1b4-24f0-400f-98bb-112c938020f9 tempest-VolumeQuotaClassesTest-1686068170 tempest-VolumeQuotaClassesTest-1686068170-project-admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:07.332401 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44e1b4-24f0-400f-98bb-112c938020f9 tempest-VolumeQuotaClassesTest-1686068170 tempest-VolumeQuotaClassesTest-1686068170-project-admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:07.333045 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb44e1b4-24f0-400f-98bb-112c938020f9 tempest-VolumeQuotaClassesTest-1686068170 tempest-VolumeQuotaClassesTest-1686068170-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:40:07.333355 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb44e1b4-24f0-400f-98bb-112c938020f9 tempest-VolumeQuotaClassesTest-1686068170 tempest-VolumeQuotaClassesTest-1686068170-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:07.334968 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb44e1b4-24f0-400f-98bb-112c938020f9 tempest-VolumeQuotaClassesTest-1686068170 tempest-VolumeQuotaClassesTest-1686068170-project-admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:07.346643 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1441/2863] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 05:40:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:40:07.383543 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a87e844-f625-4d5a-a51c-50a3faaf8b4e tempest-VolumeQuotaClassesTest-1686068170 tempest-VolumeQuotaClassesTest-1686068170-project-admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:07.393994 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a87e844-f625-4d5a-a51c-50a3faaf8b4e tempest-VolumeQuotaClassesTest-1686068170 tempest-VolumeQuotaClassesTest-1686068170-project-admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:07.398695 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9601fd6-6550-4c2b-8ee3-df1282ccd3d0 tempest-VolumeQuotaClassesTest-1686068170 tempest-VolumeQuotaClassesTest-1686068170-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce23a47039fe4830807c4f9cb3528d6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbe33e150e74eb4b5089210cfd77e40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:07.399318 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9601fd6-6550-4c2b-8ee3-df1282ccd3d0 tempest-VolumeQuotaClassesTest-1686068170 tempest-VolumeQuotaClassesTest-1686068170-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:07.399601 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9601fd6-6550-4c2b-8ee3-df1282ccd3d0 tempest-VolumeQuotaClassesTest-1686068170 tempest-VolumeQuotaClassesTest-1686068170-project-admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:07.399905 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9601fd6-6550-4c2b-8ee3-df1282ccd3d0 tempest-VolumeQuotaClassesTest-1686068170 tempest-VolumeQuotaClassesTest-1686068170-project-admin] PATH_INFO: `/v3/projects/bb40f58c1ea84450a5c60804dbbf68af` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:07.401027 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9601fd6-6550-4c2b-8ee3-df1282ccd3d0 tempest-VolumeQuotaClassesTest-1686068170 tempest-VolumeQuotaClassesTest-1686068170-project-admin] RBAC: Authorizing `identity:delete_project(project_id=bb40f58c1ea84450a5c60804dbbf68af)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:07.402934 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9601fd6-6550-4c2b-8ee3-df1282ccd3d0 tempest-VolumeQuotaClassesTest-1686068170 tempest-VolumeQuotaClassesTest-1686068170-project-admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:07.449131 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-f9601fd6-6550-4c2b-8ee3-df1282ccd3d0 tempest-VolumeQuotaClassesTest-1686068170 tempest-VolumeQuotaClassesTest-1686068170-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb40f58c1ea84450a5c60804dbbf68af', 'request_id': 'req-f9601fd6-6550-4c2b-8ee3-df1282ccd3d0'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:07.456959 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-f9601fd6-6550-4c2b-8ee3-df1282ccd3d0 tempest-VolumeQuotaClassesTest-1686068170 tempest-VolumeQuotaClassesTest-1686068170-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb40f58c1ea84450a5c60804dbbf68af', 'request_id': 'req-f9601fd6-6550-4c2b-8ee3-df1282ccd3d0'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:07.463381 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-f9601fd6-6550-4c2b-8ee3-df1282ccd3d0 tempest-VolumeQuotaClassesTest-1686068170 tempest-VolumeQuotaClassesTest-1686068170-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb40f58c1ea84450a5c60804dbbf68af', 'request_id': 'req-f9601fd6-6550-4c2b-8ee3-df1282ccd3d0'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:07.474955 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-f9601fd6-6550-4c2b-8ee3-df1282ccd3d0 tempest-VolumeQuotaClassesTest-1686068170 tempest-VolumeQuotaClassesTest-1686068170-project-admin] The token cache is being invalidate because project bb40f58c1ea84450a5c60804dbbf68af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81383) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:40:07.475242 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-f9601fd6-6550-4c2b-8ee3-df1282ccd3d0 tempest-VolumeQuotaClassesTest-1686068170 tempest-VolumeQuotaClassesTest-1686068170-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:07.475936 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-f9601fd6-6550-4c2b-8ee3-df1282ccd3d0 tempest-VolumeQuotaClassesTest-1686068170 tempest-VolumeQuotaClassesTest-1686068170-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:07.477418 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1423/2864] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:40:07 2022] DELETE /identity/v3/projects/bb40f58c1ea84450a5c60804dbbf68af => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:40:07.667775 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb44e1b4-24f0-400f-98bb-112c938020f9 tempest-VolumeQuotaClassesTest-1686068170 tempest-VolumeQuotaClassesTest-1686068170-project-admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:07.669478 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-cb44e1b4-24f0-400f-98bb-112c938020f9 tempest-VolumeQuotaClassesTest-1686068170 tempest-VolumeQuotaClassesTest-1686068170-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:40:07.733393 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb44e1b4-24f0-400f-98bb-112c938020f9 tempest-VolumeQuotaClassesTest-1686068170 tempest-VolumeQuotaClassesTest-1686068170-project-admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:07.772850 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:40:07.790519 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44a895d-52b6-482a-8d99-72afbb3c40ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:07.791151 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a895d-52b6-482a-8d99-72afbb3c40ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:07.791425 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a895d-52b6-482a-8d99-72afbb3c40ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:07.791720 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a895d-52b6-482a-8d99-72afbb3c40ca admin admin] PATH_INFO: `/v3/users/ca1d263412bd4d4a98314e60da7cc63b` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:07.792848 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44a895d-52b6-482a-8d99-72afbb3c40ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca1d263412bd4d4a98314e60da7cc63b)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:07.794775 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44a895d-52b6-482a-8d99-72afbb3c40ca admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:07.841155 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-a44a895d-52b6-482a-8d99-72afbb3c40ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca1d263412bd4d4a98314e60da7cc63b'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:07.853131 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-a44a895d-52b6-482a-8d99-72afbb3c40ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca1d263412bd4d4a98314e60da7cc63b'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:07.860594 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-a44a895d-52b6-482a-8d99-72afbb3c40ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca1d263412bd4d4a98314e60da7cc63b'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:07.867360 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-a44a895d-52b6-482a-8d99-72afbb3c40ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca1d263412bd4d4a98314e60da7cc63b'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:07.867984 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-a44a895d-52b6-482a-8d99-72afbb3c40ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca1d263412bd4d4a98314e60da7cc63b'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:07.873738 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1442/2865] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:40:07 2022] DELETE /identity/v3/users/ca1d263412bd4d4a98314e60da7cc63b => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:40:07.878174 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065bca6b-d8d1-4a16-86d6-e1efb3460be2 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:07.878667 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065bca6b-d8d1-4a16-86d6-e1efb3460be2 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:07.878767 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065bca6b-d8d1-4a16-86d6-e1efb3460be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:07.897192 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-065bca6b-d8d1-4a16-86d6-e1efb3460be2 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:40:07.898397 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-065bca6b-d8d1-4a16-86d6-e1efb3460be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:40:07.903437 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=86,keystone:INSERT=7,keystone:DELETE=7 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:40:07.964750 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1424/2866] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:40:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:40:07.974961 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44a895d-52b6-482a-8d99-72afbb3c40ca admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:07.976646 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-a44a895d-52b6-482a-8d99-72afbb3c40ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:40:08.034756 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44a895d-52b6-482a-8d99-72afbb3c40ca admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:08.038302 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2a3921-01ba-4841-8b79-de05fb411d01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:08.038895 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a3921-01ba-4841-8b79-de05fb411d01 service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:08.039170 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a3921-01ba-4841-8b79-de05fb411d01 service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:08.039438 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a3921-01ba-4841-8b79-de05fb411d01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:08.048355 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2a3921-01ba-4841-8b79-de05fb411d01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:08.049793 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2a3921-01ba-4841-8b79-de05fb411d01 service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:08.059064 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1443/2867] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:40:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:40:08.318904 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065bca6b-d8d1-4a16-86d6-e1efb3460be2 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:08.320344 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-065bca6b-d8d1-4a16-86d6-e1efb3460be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:40:08.332632 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065bca6b-d8d1-4a16-86d6-e1efb3460be2 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:08.337239 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a67d597-7b25-46a5-b845-469ee8aa69b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:08.337872 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a67d597-7b25-46a5-b845-469ee8aa69b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:08.338144 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a67d597-7b25-46a5-b845-469ee8aa69b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:08.338412 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a67d597-7b25-46a5-b845-469ee8aa69b0 admin admin] PATH_INFO: `/v3/projects/980b029697a84bfbb1cb06ec4ca5d0c7` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:08.339583 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a67d597-7b25-46a5-b845-469ee8aa69b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=980b029697a84bfbb1cb06ec4ca5d0c7)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:08.341653 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a67d597-7b25-46a5-b845-469ee8aa69b0 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:08.388377 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-5a67d597-7b25-46a5-b845-469ee8aa69b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '980b029697a84bfbb1cb06ec4ca5d0c7', 'request_id': 'req-5a67d597-7b25-46a5-b845-469ee8aa69b0'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:08.396046 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-5a67d597-7b25-46a5-b845-469ee8aa69b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '980b029697a84bfbb1cb06ec4ca5d0c7', 'request_id': 'req-5a67d597-7b25-46a5-b845-469ee8aa69b0'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:08.401811 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-5a67d597-7b25-46a5-b845-469ee8aa69b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '980b029697a84bfbb1cb06ec4ca5d0c7', 'request_id': 'req-5a67d597-7b25-46a5-b845-469ee8aa69b0'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:08.412529 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-5a67d597-7b25-46a5-b845-469ee8aa69b0 admin admin] The token cache is being invalidate because project 980b029697a84bfbb1cb06ec4ca5d0c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81383) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:40:08.412810 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-5a67d597-7b25-46a5-b845-469ee8aa69b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:08.413440 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-5a67d597-7b25-46a5-b845-469ee8aa69b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:08.414898 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1425/2868] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:40:08 2022] DELETE /identity/v3/projects/980b029697a84bfbb1cb06ec4ca5d0c7 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:40:08.418917 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2a3921-01ba-4841-8b79-de05fb411d01 service neutron] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:08.428544 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2a3921-01ba-4841-8b79-de05fb411d01 service neutron] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:08.483669 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6086a49-86bd-40ae-bfdf-4a6725605929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:08.484309 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6086a49-86bd-40ae-bfdf-4a6725605929 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:08.484599 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6086a49-86bd-40ae-bfdf-4a6725605929 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:08.484875 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6086a49-86bd-40ae-bfdf-4a6725605929 admin admin] PATH_INFO: `/v3/users/ce23a47039fe4830807c4f9cb3528d6e` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:08.485973 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6086a49-86bd-40ae-bfdf-4a6725605929 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce23a47039fe4830807c4f9cb3528d6e)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:08.487927 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6086a49-86bd-40ae-bfdf-4a6725605929 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:08.492332 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:40:08.535018 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-c6086a49-86bd-40ae-bfdf-4a6725605929 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce23a47039fe4830807c4f9cb3528d6e'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:08.546739 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-c6086a49-86bd-40ae-bfdf-4a6725605929 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce23a47039fe4830807c4f9cb3528d6e'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:08.553735 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-c6086a49-86bd-40ae-bfdf-4a6725605929 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce23a47039fe4830807c4f9cb3528d6e'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:08.560690 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-c6086a49-86bd-40ae-bfdf-4a6725605929 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce23a47039fe4830807c4f9cb3528d6e'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:08.561295 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-c6086a49-86bd-40ae-bfdf-4a6725605929 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce23a47039fe4830807c4f9cb3528d6e'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:08.567878 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1444/2869] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:40:08 2022] DELETE /identity/v3/users/ce23a47039fe4830807c4f9cb3528d6e => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:40:09.082645 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a67d597-7b25-46a5-b845-469ee8aa69b0 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:09.084113 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-5a67d597-7b25-46a5-b845-469ee8aa69b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:40:09.097252 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a67d597-7b25-46a5-b845-469ee8aa69b0 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:09.154093 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd5cc50-e675-4630-a452-45c424496cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:09.154724 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd5cc50-e675-4630-a452-45c424496cee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:09.154999 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd5cc50-e675-4630-a452-45c424496cee admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:09.155266 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd5cc50-e675-4630-a452-45c424496cee admin admin] PATH_INFO: `/v3/projects/6cbe33e150e74eb4b5089210cfd77e40` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:09.156420 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd5cc50-e675-4630-a452-45c424496cee admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cbe33e150e74eb4b5089210cfd77e40)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:09.158906 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd5cc50-e675-4630-a452-45c424496cee admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:09.195508 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:40:09.205527 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-6cd5cc50-e675-4630-a452-45c424496cee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cbe33e150e74eb4b5089210cfd77e40', 'request_id': 'req-6cd5cc50-e675-4630-a452-45c424496cee'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:09.212423 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-6cd5cc50-e675-4630-a452-45c424496cee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cbe33e150e74eb4b5089210cfd77e40', 'request_id': 'req-6cd5cc50-e675-4630-a452-45c424496cee'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:09.217853 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-6cd5cc50-e675-4630-a452-45c424496cee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cbe33e150e74eb4b5089210cfd77e40', 'request_id': 'req-6cd5cc50-e675-4630-a452-45c424496cee'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:09.228993 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-6cd5cc50-e675-4630-a452-45c424496cee admin admin] The token cache is being invalidate because project 6cbe33e150e74eb4b5089210cfd77e40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81383) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:40:09.229284 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-6cd5cc50-e675-4630-a452-45c424496cee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:09.230223 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-6cd5cc50-e675-4630-a452-45c424496cee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:09.231704 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1426/2870] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:40:09 2022] DELETE /identity/v3/projects/6cbe33e150e74eb4b5089210cfd77e40 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:40:09.237132 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465f5e78-8de2-4120-8e9a-cc7c4ca68d85 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:09.237626 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465f5e78-8de2-4120-8e9a-cc7c4ca68d85 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:09.237729 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465f5e78-8de2-4120-8e9a-cc7c4ca68d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:09.256992 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-465f5e78-8de2-4120-8e9a-cc7c4ca68d85 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:40:09.258229 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-465f5e78-8de2-4120-8e9a-cc7c4ca68d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:40:09.317135 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1445/2871] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:40:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:40:09.378148 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04897d4-6201-4544-97c3-cda21e394f85 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:09.378373 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04897d4-6201-4544-97c3-cda21e394f85 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:09.378608 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04897d4-6201-4544-97c3-cda21e394f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:09.398334 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-f04897d4-6201-4544-97c3-cda21e394f85 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:40:09.399555 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-f04897d4-6201-4544-97c3-cda21e394f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:40:09.408085 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1427/2872] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:40:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:40:09.412257 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465f5e78-8de2-4120-8e9a-cc7c4ca68d85 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:09.421855 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465f5e78-8de2-4120-8e9a-cc7c4ca68d85 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:09.427028 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0f60d3-3984-4283-ab46-993a08831889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:09.427622 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f60d3-3984-4283-ab46-993a08831889 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:09.427934 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f60d3-3984-4283-ab46-993a08831889 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:09.428206 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f60d3-3984-4283-ab46-993a08831889 admin admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:09.428851 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0f60d3-3984-4283-ab46-993a08831889 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:40:09.429153 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0f60d3-3984-4283-ab46-993a08831889 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:09.430741 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0f60d3-3984-4283-ab46-993a08831889 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:09.442051 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1446/2873] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 05:40:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:40:09.446298 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04897d4-6201-4544-97c3-cda21e394f85 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:09.455563 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04897d4-6201-4544-97c3-cda21e394f85 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:09.462598 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b61ad50-b3d0-4f14-8811-c693cc379151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:09.463252 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b61ad50-b3d0-4f14-8811-c693cc379151 admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:09.463537 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b61ad50-b3d0-4f14-8811-c693cc379151 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:09.463861 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b61ad50-b3d0-4f14-8811-c693cc379151 admin admin] PATH_INFO: `/v3/projects` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:09.464510 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b61ad50-b3d0-4f14-8811-c693cc379151 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:09.466415 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b61ad50-b3d0-4f14-8811-c693cc379151 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:09.497318 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1428/2874] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:40:09 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:40:09.502188 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0f60d3-3984-4283-ab46-993a08831889 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:09.512136 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0f60d3-3984-4283-ab46-993a08831889 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:09.566960 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8cac10-ae66-42f0-b8c4-2e01982846e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:09.567557 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8cac10-ae66-42f0-b8c4-2e01982846e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:09.567868 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8cac10-ae66-42f0-b8c4-2e01982846e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:09.568138 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8cac10-ae66-42f0-b8c4-2e01982846e3 admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:09.568750 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8cac10-ae66-42f0-b8c4-2e01982846e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:09.570653 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8cac10-ae66-42f0-b8c4-2e01982846e3 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:09.587279 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:40:09.596804 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1447/2875] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:40:09 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 05:40:09.598098 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b61ad50-b3d0-4f14-8811-c693cc379151 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:09.608915 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b61ad50-b3d0-4f14-8811-c693cc379151 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:09.613571 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e11c5-09b7-4ab8-961a-fadb14894910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:09.614177 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e11c5-09b7-4ab8-961a-fadb14894910 admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:09.614457 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e11c5-09b7-4ab8-961a-fadb14894910 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:09.614731 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e11c5-09b7-4ab8-961a-fadb14894910 admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:09.615399 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333e11c5-09b7-4ab8-961a-fadb14894910 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:09.617037 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333e11c5-09b7-4ab8-961a-fadb14894910 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:09.626876 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1429/2876] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:40:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:40:09.630874 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8cac10-ae66-42f0-b8c4-2e01982846e3 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:09.640787 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8cac10-ae66-42f0-b8c4-2e01982846e3 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:09.645984 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f485df75-fd8a-4f0a-8c6b-10195ac0978f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:09.646577 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485df75-fd8a-4f0a-8c6b-10195ac0978f admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:09.646861 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485df75-fd8a-4f0a-8c6b-10195ac0978f admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:09.647133 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485df75-fd8a-4f0a-8c6b-10195ac0978f admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:09.647813 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f485df75-fd8a-4f0a-8c6b-10195ac0978f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:09.649436 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f485df75-fd8a-4f0a-8c6b-10195ac0978f admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:09.659976 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1448/2877] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:40:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:40:09.663866 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e11c5-09b7-4ab8-961a-fadb14894910 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:09.674176 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e11c5-09b7-4ab8-961a-fadb14894910 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:09.678693 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dc0712-faa0-470f-838d-10fe31b11d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:09.679336 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc0712-faa0-470f-838d-10fe31b11d5e admin admin] REQUEST_METHOD: `PUT` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:09.679610 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc0712-faa0-470f-838d-10fe31b11d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:09.679914 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc0712-faa0-470f-838d-10fe31b11d5e admin admin] PATH_INFO: `/v3/projects/dc4c13f8f1b6443ea48f4411df93da12/users/55c5dbdabf904007b267b185824f8392/roles/aa7ff8e0ec1e48e5811335b9eb38b448` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:09.694471 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dc0712-faa0-470f-838d-10fe31b11d5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc4c13f8f1b6443ea48f4411df93da12, user_id=55c5dbdabf904007b267b185824f8392, role_id=aa7ff8e0ec1e48e5811335b9eb38b448)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:09.697132 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dc0712-faa0-470f-838d-10fe31b11d5e admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:09.709532 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1430/2878] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:40:09 2022] PUT /identity/v3/projects/dc4c13f8f1b6443ea48f4411df93da12/users/55c5dbdabf904007b267b185824f8392/roles/aa7ff8e0ec1e48e5811335b9eb38b448 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 05:40:09.719197 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72357e2-61da-43fb-a874-fb722dda9017 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:09.719478 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72357e2-61da-43fb-a874-fb722dda9017 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:09.719814 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72357e2-61da-43fb-a874-fb722dda9017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:09.747196 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-b72357e2-61da-43fb-a874-fb722dda9017 None None] MFA Rules not processed for user `55c5dbdabf904007b267b185824f8392`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:40:09.748457 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-b72357e2-61da-43fb-a874-fb722dda9017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:40:09.812525 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1449/2879] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:40:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:40:09.817736 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dc0712-faa0-470f-838d-10fe31b11d5e admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:09.884525 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dc0712-faa0-470f-838d-10fe31b11d5e admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:09.889025 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065087a8-91b8-4065-8286-1f2c096de78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:09.889620 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065087a8-91b8-4065-8286-1f2c096de78f admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:09.889893 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065087a8-91b8-4065-8286-1f2c096de78f admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:09.890158 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065087a8-91b8-4065-8286-1f2c096de78f admin admin] PATH_INFO: `/v3/projects` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:09.890786 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065087a8-91b8-4065-8286-1f2c096de78f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:09.892704 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065087a8-91b8-4065-8286-1f2c096de78f admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:09.919379 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1431/2880] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:40:09 2022] POST /identity/v3/projects => generated 377 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:40:09.924138 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72357e2-61da-43fb-a874-fb722dda9017 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:09.934789 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72357e2-61da-43fb-a874-fb722dda9017 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:09.994409 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ce654a-ab16-4118-9b82-e38de768c470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:09.995019 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce654a-ab16-4118-9b82-e38de768c470 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:09.995305 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce654a-ab16-4118-9b82-e38de768c470 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:09.995605 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce654a-ab16-4118-9b82-e38de768c470 admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:09.996274 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ce654a-ab16-4118-9b82-e38de768c470 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:09.998236 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ce654a-ab16-4118-9b82-e38de768c470 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:10.018878 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1450/2881] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:40:09 2022] POST /identity/v3/users => generated 295 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:40:10.022958 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065087a8-91b8-4065-8286-1f2c096de78f admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:10.033672 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065087a8-91b8-4065-8286-1f2c096de78f admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:10.038310 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22db809-104c-4d09-a287-54555b55fd61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:10.038909 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22db809-104c-4d09-a287-54555b55fd61 admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:10.039187 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22db809-104c-4d09-a287-54555b55fd61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:10.039459 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22db809-104c-4d09-a287-54555b55fd61 admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:10.040123 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22db809-104c-4d09-a287-54555b55fd61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:10.041717 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22db809-104c-4d09-a287-54555b55fd61 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:10.053023 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1432/2882] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:40:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:40:10.057163 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ce654a-ab16-4118-9b82-e38de768c470 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:10.067080 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ce654a-ab16-4118-9b82-e38de768c470 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:10.071856 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d31cbe3-674a-4b26-be28-7a415c7bee3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:10.072508 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d31cbe3-674a-4b26-be28-7a415c7bee3c admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:10.072817 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d31cbe3-674a-4b26-be28-7a415c7bee3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:10.073144 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d31cbe3-674a-4b26-be28-7a415c7bee3c admin admin] PATH_INFO: `/v3/projects/83565b1b07b74f929422154f65a15c70/users/ad501feb08e3428f9937f2c72ed54d98/roles/5b702713e40145b49e0b42abd0a5fba9` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:10.087671 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d31cbe3-674a-4b26-be28-7a415c7bee3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=83565b1b07b74f929422154f65a15c70, user_id=ad501feb08e3428f9937f2c72ed54d98, role_id=5b702713e40145b49e0b42abd0a5fba9)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:10.090400 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d31cbe3-674a-4b26-be28-7a415c7bee3c admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:10.103775 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1451/2883] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:40:10 2022] PUT /identity/v3/projects/83565b1b07b74f929422154f65a15c70/users/ad501feb08e3428f9937f2c72ed54d98/roles/5b702713e40145b49e0b42abd0a5fba9 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:40:10.107918 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22db809-104c-4d09-a287-54555b55fd61 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:10.118615 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22db809-104c-4d09-a287-54555b55fd61 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:10.149723 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:40:10.176431 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2a1b4d-4ddb-4d30-8b30-a3a60df0f181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:10.177038 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a1b4d-4ddb-4d30-8b30-a3a60df0f181 admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:10.177314 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a1b4d-4ddb-4d30-8b30-a3a60df0f181 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:10.177583 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a1b4d-4ddb-4d30-8b30-a3a60df0f181 admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:10.178211 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2a1b4d-4ddb-4d30-8b30-a3a60df0f181 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:10.179814 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2a1b4d-4ddb-4d30-8b30-a3a60df0f181 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:10.189365 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1433/2884] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:40:10 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:40:10.193557 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d31cbe3-674a-4b26-be28-7a415c7bee3c admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:10.203963 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d31cbe3-674a-4b26-be28-7a415c7bee3c admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:10.208693 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a514158-d4a5-454c-b1ff-603f41412f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:10.209341 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a514158-d4a5-454c-b1ff-603f41412f74 admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:10.209621 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a514158-d4a5-454c-b1ff-603f41412f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:10.209892 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a514158-d4a5-454c-b1ff-603f41412f74 admin admin] PATH_INFO: `/v3/projects/83565b1b07b74f929422154f65a15c70/users/ad501feb08e3428f9937f2c72ed54d98/roles/5b702713e40145b49e0b42abd0a5fba9` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:10.211858 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a514158-d4a5-454c-b1ff-603f41412f74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83565b1b07b74f929422154f65a15c70, user_id=ad501feb08e3428f9937f2c72ed54d98, role_id=5b702713e40145b49e0b42abd0a5fba9)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:10.214519 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a514158-d4a5-454c-b1ff-603f41412f74 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:10.225015 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1452/2885] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:40:10 2022] PUT /identity/v3/projects/83565b1b07b74f929422154f65a15c70/users/ad501feb08e3428f9937f2c72ed54d98/roles/5b702713e40145b49e0b42abd0a5fba9 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:40:10.235622 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be684e-a727-47e3-9b7c-af15c1402bdf None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:10.235946 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be684e-a727-47e3-9b7c-af15c1402bdf None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:10.236221 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be684e-a727-47e3-9b7c-af15c1402bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:10.262980 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-05be684e-a727-47e3-9b7c-af15c1402bdf None None] MFA Rules not processed for user `ad501feb08e3428f9937f2c72ed54d98`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:40:10.264209 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-05be684e-a727-47e3-9b7c-af15c1402bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:40:10.333083 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1434/2886] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:40:10 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:40:10.343640 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a514158-d4a5-454c-b1ff-603f41412f74 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:10.345974 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-6a514158-d4a5-454c-b1ff-603f41412f74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:40:10.379205 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:40:10.403768 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a514158-d4a5-454c-b1ff-603f41412f74 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:10.408026 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c61d38e-07e5-44ec-b0df-a5a6981dd38f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a147e14b61d481db1cac02c58ac3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:10.408619 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61d38e-07e5-44ec-b0df-a5a6981dd38f service cinder] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:10.408892 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61d38e-07e5-44ec-b0df-a5a6981dd38f service cinder] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:10.409159 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61d38e-07e5-44ec-b0df-a5a6981dd38f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:10.417823 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c61d38e-07e5-44ec-b0df-a5a6981dd38f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:10.419253 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c61d38e-07e5-44ec-b0df-a5a6981dd38f service cinder] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:10.428581 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1453/2887] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:40:10 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:40:10.530349 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05be684e-a727-47e3-9b7c-af15c1402bdf None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:10.540561 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05be684e-a727-47e3-9b7c-af15c1402bdf None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:10.544096 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81ff5eb-b8e0-4e3c-9773-fbb3e1d64ff0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a147e14b61d481db1cac02c58ac3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:10.544696 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ff5eb-b8e0-4e3c-9773-fbb3e1d64ff0 service cinder] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:10.544974 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ff5eb-b8e0-4e3c-9773-fbb3e1d64ff0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:10.545246 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ff5eb-b8e0-4e3c-9773-fbb3e1d64ff0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:10.601358 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81ff5eb-b8e0-4e3c-9773-fbb3e1d64ff0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:10.602776 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81ff5eb-b8e0-4e3c-9773-fbb3e1d64ff0 service cinder] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:10.611876 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1435/2888] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:40:10 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:40:13.189286 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c61d38e-07e5-44ec-b0df-a5a6981dd38f service cinder] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:13.253331 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c61d38e-07e5-44ec-b0df-a5a6981dd38f service cinder] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:13.258090 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d61a7f-22b4-4088-be43-d062b5b4132f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:13.258722 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d61a7f-22b4-4088-be43-d062b5b4132f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:13.259004 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d61a7f-22b4-4088-be43-d062b5b4132f admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:13.259280 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d61a7f-22b4-4088-be43-d062b5b4132f admin admin] PATH_INFO: `/v3/users/55c5dbdabf904007b267b185824f8392` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:13.260458 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d61a7f-22b4-4088-be43-d062b5b4132f admin admin] RBAC: Authorizing `identity:delete_user(user_id=55c5dbdabf904007b267b185824f8392)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:13.262396 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d61a7f-22b4-4088-be43-d062b5b4132f admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:13.306960 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-08d61a7f-22b4-4088-be43-d062b5b4132f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55c5dbdabf904007b267b185824f8392'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:13.319412 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-08d61a7f-22b4-4088-be43-d062b5b4132f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55c5dbdabf904007b267b185824f8392'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:13.326451 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-08d61a7f-22b4-4088-be43-d062b5b4132f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55c5dbdabf904007b267b185824f8392'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:13.333556 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-08d61a7f-22b4-4088-be43-d062b5b4132f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55c5dbdabf904007b267b185824f8392'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:13.334172 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-08d61a7f-22b4-4088-be43-d062b5b4132f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55c5dbdabf904007b267b185824f8392'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:13.339929 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1454/2889] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:40:13 2022] DELETE /identity/v3/users/55c5dbdabf904007b267b185824f8392 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:40:13.344592 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bee51dc-dbf7-4d68-a4c4-047097ed57df None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:13.345044 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bee51dc-dbf7-4d68-a4c4-047097ed57df None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:13.345162 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bee51dc-dbf7-4d68-a4c4-047097ed57df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:13.364797 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-1bee51dc-dbf7-4d68-a4c4-047097ed57df None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:40:13.365999 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-1bee51dc-dbf7-4d68-a4c4-047097ed57df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:40:13.413888 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=100 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:40:13.426182 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1436/2890] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:40:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:40:13.435703 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d61a7f-22b4-4088-be43-d062b5b4132f admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:13.437095 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-08d61a7f-22b4-4088-be43-d062b5b4132f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:40:13.493981 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d61a7f-22b4-4088-be43-d062b5b4132f admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:13.497614 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3040fa-c441-4c0d-8277-6293e398e2c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:13.498219 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3040fa-c441-4c0d-8277-6293e398e2c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:13.498493 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3040fa-c441-4c0d-8277-6293e398e2c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:13.498764 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3040fa-c441-4c0d-8277-6293e398e2c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:13.507084 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:40:13.510345 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3040fa-c441-4c0d-8277-6293e398e2c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:13.512496 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3040fa-c441-4c0d-8277-6293e398e2c9 service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:13.523402 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1455/2891] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:40:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:40:13.788780 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bee51dc-dbf7-4d68-a4c4-047097ed57df None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:13.790432 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-1bee51dc-dbf7-4d68-a4c4-047097ed57df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:40:13.804877 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bee51dc-dbf7-4d68-a4c4-047097ed57df None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:13.809642 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185e70de-a5eb-45fc-a271-123edddbd570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:13.810287 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e70de-a5eb-45fc-a271-123edddbd570 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:13.810574 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e70de-a5eb-45fc-a271-123edddbd570 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:13.810849 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e70de-a5eb-45fc-a271-123edddbd570 admin admin] PATH_INFO: `/v3/projects/dc4c13f8f1b6443ea48f4411df93da12` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:13.812030 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185e70de-a5eb-45fc-a271-123edddbd570 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc4c13f8f1b6443ea48f4411df93da12)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:13.813947 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185e70de-a5eb-45fc-a271-123edddbd570 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:13.861574 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-185e70de-a5eb-45fc-a271-123edddbd570 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc4c13f8f1b6443ea48f4411df93da12', 'request_id': 'req-185e70de-a5eb-45fc-a271-123edddbd570'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:13.869489 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-185e70de-a5eb-45fc-a271-123edddbd570 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc4c13f8f1b6443ea48f4411df93da12', 'request_id': 'req-185e70de-a5eb-45fc-a271-123edddbd570'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:13.875259 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-185e70de-a5eb-45fc-a271-123edddbd570 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc4c13f8f1b6443ea48f4411df93da12', 'request_id': 'req-185e70de-a5eb-45fc-a271-123edddbd570'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:13.886408 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-185e70de-a5eb-45fc-a271-123edddbd570 admin admin] The token cache is being invalidate because project dc4c13f8f1b6443ea48f4411df93da12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81383) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:40:13.886699 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-185e70de-a5eb-45fc-a271-123edddbd570 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:13.887351 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-185e70de-a5eb-45fc-a271-123edddbd570 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:13.888862 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1437/2892] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:40:13 2022] DELETE /identity/v3/projects/dc4c13f8f1b6443ea48f4411df93da12 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:40:13.892908 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3040fa-c441-4c0d-8277-6293e398e2c9 service neutron] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:13.902463 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3040fa-c441-4c0d-8277-6293e398e2c9 service neutron] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:13.960124 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fa5b0b-314f-477b-91fd-0b2a3f6fa35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:13.960675 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa5b0b-314f-477b-91fd-0b2a3f6fa35a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:13.960957 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa5b0b-314f-477b-91fd-0b2a3f6fa35a admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:13.961231 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa5b0b-314f-477b-91fd-0b2a3f6fa35a admin admin] PATH_INFO: `/v3/users/ad501feb08e3428f9937f2c72ed54d98` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:13.962372 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fa5b0b-314f-477b-91fd-0b2a3f6fa35a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad501feb08e3428f9937f2c72ed54d98)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:13.964348 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fa5b0b-314f-477b-91fd-0b2a3f6fa35a admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:14.009490 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-51fa5b0b-314f-477b-91fd-0b2a3f6fa35a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad501feb08e3428f9937f2c72ed54d98'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:14.021959 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-51fa5b0b-314f-477b-91fd-0b2a3f6fa35a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad501feb08e3428f9937f2c72ed54d98'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:14.028797 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-51fa5b0b-314f-477b-91fd-0b2a3f6fa35a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad501feb08e3428f9937f2c72ed54d98'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:14.036460 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-51fa5b0b-314f-477b-91fd-0b2a3f6fa35a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad501feb08e3428f9937f2c72ed54d98'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:14.037073 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-51fa5b0b-314f-477b-91fd-0b2a3f6fa35a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad501feb08e3428f9937f2c72ed54d98'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:14.043049 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1456/2893] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:40:13 2022] DELETE /identity/v3/users/ad501feb08e3428f9937f2c72ed54d98 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:40:14.318199 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185e70de-a5eb-45fc-a271-123edddbd570 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:14.319667 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-185e70de-a5eb-45fc-a271-123edddbd570 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:40:14.335312 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185e70de-a5eb-45fc-a271-123edddbd570 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:14.397131 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6ae305-435f-4618-a729-507bef9226f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:14.397828 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ae305-435f-4618-a729-507bef9226f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:14.398036 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ae305-435f-4618-a729-507bef9226f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:14.398310 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ae305-435f-4618-a729-507bef9226f4 admin admin] PATH_INFO: `/v3/projects/83565b1b07b74f929422154f65a15c70` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:14.399431 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6ae305-435f-4618-a729-507bef9226f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83565b1b07b74f929422154f65a15c70)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:14.401388 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6ae305-435f-4618-a729-507bef9226f4 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:14.446585 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-5f6ae305-435f-4618-a729-507bef9226f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83565b1b07b74f929422154f65a15c70', 'request_id': 'req-5f6ae305-435f-4618-a729-507bef9226f4'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:14.454205 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-5f6ae305-435f-4618-a729-507bef9226f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83565b1b07b74f929422154f65a15c70', 'request_id': 'req-5f6ae305-435f-4618-a729-507bef9226f4'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:14.460483 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-5f6ae305-435f-4618-a729-507bef9226f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83565b1b07b74f929422154f65a15c70', 'request_id': 'req-5f6ae305-435f-4618-a729-507bef9226f4'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:14.471253 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-5f6ae305-435f-4618-a729-507bef9226f4 admin admin] The token cache is being invalidate because project 83565b1b07b74f929422154f65a15c70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81383) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:40:14.471535 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-5f6ae305-435f-4618-a729-507bef9226f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:14.472203 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-5f6ae305-435f-4618-a729-507bef9226f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:14.473698 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1438/2894] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:40:14 2022] DELETE /identity/v3/projects/83565b1b07b74f929422154f65a15c70 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:40:14.478593 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b8a55b-2ddb-4721-b56c-11841b08d35f None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:14.479061 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b8a55b-2ddb-4721-b56c-11841b08d35f None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:14.479169 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b8a55b-2ddb-4721-b56c-11841b08d35f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:14.498692 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-a2b8a55b-2ddb-4721-b56c-11841b08d35f None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:40:14.499875 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-a2b8a55b-2ddb-4721-b56c-11841b08d35f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:40:14.558428 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1457/2895] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:40:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:40:14.566785 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ae2578-abff-4876-9816-68d35b3068dd None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:14.567070 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ae2578-abff-4876-9816-68d35b3068dd None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:14.567368 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ae2578-abff-4876-9816-68d35b3068dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:14.587395 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-f3ae2578-abff-4876-9816-68d35b3068dd None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:40:14.588631 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-f3ae2578-abff-4876-9816-68d35b3068dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:40:14.596856 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1439/2896] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:40:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:40:14.600916 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b8a55b-2ddb-4721-b56c-11841b08d35f None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:14.610988 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b8a55b-2ddb-4721-b56c-11841b08d35f None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:14.615658 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff7c09-428c-4e3c-a48f-d0a102d5394a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:14.616289 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff7c09-428c-4e3c-a48f-d0a102d5394a admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:14.616570 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff7c09-428c-4e3c-a48f-d0a102d5394a admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:14.616845 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff7c09-428c-4e3c-a48f-d0a102d5394a admin admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:14.617499 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deff7c09-428c-4e3c-a48f-d0a102d5394a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:40:14.617805 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deff7c09-428c-4e3c-a48f-d0a102d5394a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:14.619417 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deff7c09-428c-4e3c-a48f-d0a102d5394a admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:14.631327 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1458/2897] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 05:40:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 05:40:14.635399 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ae2578-abff-4876-9816-68d35b3068dd None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:14.639866 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:40:14.646861 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ae2578-abff-4876-9816-68d35b3068dd None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:14.652548 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fd9da1-594c-4733-a772-7284917656af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:14.653153 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd9da1-594c-4733-a772-7284917656af admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:14.653436 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd9da1-594c-4733-a772-7284917656af admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:14.653711 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd9da1-594c-4733-a772-7284917656af admin admin] PATH_INFO: `/v3/projects` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:14.654393 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fd9da1-594c-4733-a772-7284917656af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:14.656326 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fd9da1-594c-4733-a772-7284917656af admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:14.683875 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1440/2898] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:40:14 2022] POST /identity/v3/projects => generated 367 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 05:40:14.687897 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff7c09-428c-4e3c-a48f-d0a102d5394a admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:14.693582 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:40:14.699674 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff7c09-428c-4e3c-a48f-d0a102d5394a admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:14.756799 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7c8830-9bb2-4614-8e3a-f4c8a55eace3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:14.757333 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c8830-9bb2-4614-8e3a-f4c8a55eace3 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:14.757618 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c8830-9bb2-4614-8e3a-f4c8a55eace3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:14.757891 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c8830-9bb2-4614-8e3a-f4c8a55eace3 admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:14.758514 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7c8830-9bb2-4614-8e3a-f4c8a55eace3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:14.760481 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7c8830-9bb2-4614-8e3a-f4c8a55eace3 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:14.781311 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1459/2899] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:40:14 2022] POST /identity/v3/users => generated 284 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:40:14.785589 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fd9da1-594c-4733-a772-7284917656af admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:14.795889 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fd9da1-594c-4733-a772-7284917656af admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:14.800954 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1198a9db-32c5-44c5-b204-4227d08742c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:14.801546 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198a9db-32c5-44c5-b204-4227d08742c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:14.801820 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198a9db-32c5-44c5-b204-4227d08742c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:14.802091 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198a9db-32c5-44c5-b204-4227d08742c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:14.802732 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1198a9db-32c5-44c5-b204-4227d08742c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:14.804413 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1198a9db-32c5-44c5-b204-4227d08742c2 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:14.814093 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1441/2900] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:40:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:40:14.818724 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7c8830-9bb2-4614-8e3a-f4c8a55eace3 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:14.828738 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7c8830-9bb2-4614-8e3a-f4c8a55eace3 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:14.833340 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84476c50-fd33-430e-baba-39f382d16e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:14.833924 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84476c50-fd33-430e-baba-39f382d16e5d admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:14.834204 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84476c50-fd33-430e-baba-39f382d16e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:14.834472 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84476c50-fd33-430e-baba-39f382d16e5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:14.835102 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84476c50-fd33-430e-baba-39f382d16e5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:14.836738 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84476c50-fd33-430e-baba-39f382d16e5d admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:14.846991 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1460/2901] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:40:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:40:14.850929 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1198a9db-32c5-44c5-b204-4227d08742c2 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:14.861026 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1198a9db-32c5-44c5-b204-4227d08742c2 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:14.866326 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3af5d42-0732-4b4b-abfc-44c9d9ea6c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:14.866961 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af5d42-0732-4b4b-abfc-44c9d9ea6c7e admin admin] REQUEST_METHOD: `PUT` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:14.867239 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af5d42-0732-4b4b-abfc-44c9d9ea6c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:14.867512 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af5d42-0732-4b4b-abfc-44c9d9ea6c7e admin admin] PATH_INFO: `/v3/projects/eccaf4d4f4f841df9f35c066a88f123d/users/4cc058701f8d44be9b2c43fe67c29bf8/roles/aa7ff8e0ec1e48e5811335b9eb38b448` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:14.882450 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3af5d42-0732-4b4b-abfc-44c9d9ea6c7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=eccaf4d4f4f841df9f35c066a88f123d, user_id=4cc058701f8d44be9b2c43fe67c29bf8, role_id=aa7ff8e0ec1e48e5811335b9eb38b448)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:14.885130 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3af5d42-0732-4b4b-abfc-44c9d9ea6c7e admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:14.897974 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1442/2902] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:40:14 2022] PUT /identity/v3/projects/eccaf4d4f4f841df9f35c066a88f123d/users/4cc058701f8d44be9b2c43fe67c29bf8/roles/aa7ff8e0ec1e48e5811335b9eb38b448 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 05:40:14.908310 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c17dbb-6d5b-4ae5-9668-efc155c38b21 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:14.908592 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c17dbb-6d5b-4ae5-9668-efc155c38b21 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:14.908885 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c17dbb-6d5b-4ae5-9668-efc155c38b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:14.936376 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-72c17dbb-6d5b-4ae5-9668-efc155c38b21 None None] MFA Rules not processed for user `4cc058701f8d44be9b2c43fe67c29bf8`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:40:14.937585 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-72c17dbb-6d5b-4ae5-9668-efc155c38b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:40:15.000364 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1461/2903] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:40:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:40:15.005447 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3af5d42-0732-4b4b-abfc-44c9d9ea6c7e admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:15.064408 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3af5d42-0732-4b4b-abfc-44c9d9ea6c7e admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:15.069584 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f16ab8c-6335-47ba-80ae-ee615d8ba401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:15.070179 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f16ab8c-6335-47ba-80ae-ee615d8ba401 admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:15.070456 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f16ab8c-6335-47ba-80ae-ee615d8ba401 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:15.070727 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f16ab8c-6335-47ba-80ae-ee615d8ba401 admin admin] PATH_INFO: `/v3/projects` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:15.071355 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f16ab8c-6335-47ba-80ae-ee615d8ba401 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:15.073277 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f16ab8c-6335-47ba-80ae-ee615d8ba401 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:15.099962 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1443/2904] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:40:15 2022] POST /identity/v3/projects => generated 365 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:40:15.104037 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c17dbb-6d5b-4ae5-9668-efc155c38b21 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:15.115637 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c17dbb-6d5b-4ae5-9668-efc155c38b21 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:15.169652 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b26098-c626-489b-9f0b-f494a01b1903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:15.170253 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b26098-c626-489b-9f0b-f494a01b1903 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:15.170531 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b26098-c626-489b-9f0b-f494a01b1903 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:15.170801 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b26098-c626-489b-9f0b-f494a01b1903 admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:15.171423 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b26098-c626-489b-9f0b-f494a01b1903 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:15.173368 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b26098-c626-489b-9f0b-f494a01b1903 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:15.189779 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:40:15.195404 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1462/2905] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:40:15 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:40:15.198828 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f16ab8c-6335-47ba-80ae-ee615d8ba401 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:15.209130 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f16ab8c-6335-47ba-80ae-ee615d8ba401 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:15.213635 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ae124c-570e-4ddb-9846-e0d8aa74cb96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:15.214223 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae124c-570e-4ddb-9846-e0d8aa74cb96 admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:15.214499 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae124c-570e-4ddb-9846-e0d8aa74cb96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:15.214767 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae124c-570e-4ddb-9846-e0d8aa74cb96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:15.215392 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ae124c-570e-4ddb-9846-e0d8aa74cb96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:15.217018 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ae124c-570e-4ddb-9846-e0d8aa74cb96 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:15.227853 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1444/2906] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:40:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:40:15.232191 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b26098-c626-489b-9f0b-f494a01b1903 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:15.242376 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b26098-c626-489b-9f0b-f494a01b1903 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:15.246912 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16fb673-381e-48aa-95ee-3debd4ff4750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:15.247547 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16fb673-381e-48aa-95ee-3debd4ff4750 admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:15.247861 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16fb673-381e-48aa-95ee-3debd4ff4750 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:15.248133 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16fb673-381e-48aa-95ee-3debd4ff4750 admin admin] PATH_INFO: `/v3/projects/36c2130faa5b4977bac632578deecaee/users/14454f7e0b2b42f2a216ff68d3d7061a/roles/5b702713e40145b49e0b42abd0a5fba9` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:15.262369 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16fb673-381e-48aa-95ee-3debd4ff4750 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36c2130faa5b4977bac632578deecaee, user_id=14454f7e0b2b42f2a216ff68d3d7061a, role_id=5b702713e40145b49e0b42abd0a5fba9)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:15.265051 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16fb673-381e-48aa-95ee-3debd4ff4750 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:15.277603 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1463/2907] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:40:15 2022] PUT /identity/v3/projects/36c2130faa5b4977bac632578deecaee/users/14454f7e0b2b42f2a216ff68d3d7061a/roles/5b702713e40145b49e0b42abd0a5fba9 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:40:15.281341 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ae124c-570e-4ddb-9846-e0d8aa74cb96 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:15.296455 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ae124c-570e-4ddb-9846-e0d8aa74cb96 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:15.353914 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d967790-e1f6-4c2e-9939-3ef5c73f4171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:15.354439 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d967790-e1f6-4c2e-9939-3ef5c73f4171 admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:15.354715 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d967790-e1f6-4c2e-9939-3ef5c73f4171 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:15.355235 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d967790-e1f6-4c2e-9939-3ef5c73f4171 admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:15.355895 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d967790-e1f6-4c2e-9939-3ef5c73f4171 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:15.357519 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d967790-e1f6-4c2e-9939-3ef5c73f4171 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:15.367944 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1445/2908] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:40:15 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:40:15.371735 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16fb673-381e-48aa-95ee-3debd4ff4750 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:15.381960 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16fb673-381e-48aa-95ee-3debd4ff4750 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:15.386605 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc6197-7ada-448f-ad7c-95b3d1b1dc19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:15.387254 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc6197-7ada-448f-ad7c-95b3d1b1dc19 admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:15.387534 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc6197-7ada-448f-ad7c-95b3d1b1dc19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:15.387849 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc6197-7ada-448f-ad7c-95b3d1b1dc19 admin admin] PATH_INFO: `/v3/projects/36c2130faa5b4977bac632578deecaee/users/14454f7e0b2b42f2a216ff68d3d7061a/roles/5b702713e40145b49e0b42abd0a5fba9` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:15.389758 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fc6197-7ada-448f-ad7c-95b3d1b1dc19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36c2130faa5b4977bac632578deecaee, user_id=14454f7e0b2b42f2a216ff68d3d7061a, role_id=5b702713e40145b49e0b42abd0a5fba9)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:15.392442 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fc6197-7ada-448f-ad7c-95b3d1b1dc19 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:15.402375 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1464/2909] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:40:15 2022] PUT /identity/v3/projects/36c2130faa5b4977bac632578deecaee/users/14454f7e0b2b42f2a216ff68d3d7061a/roles/5b702713e40145b49e0b42abd0a5fba9 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:40:15.414047 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60159d5a-7ff8-4e88-b25b-e8fee9ba3a86 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:15.414557 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60159d5a-7ff8-4e88-b25b-e8fee9ba3a86 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:15.414656 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60159d5a-7ff8-4e88-b25b-e8fee9ba3a86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:15.442581 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-60159d5a-7ff8-4e88-b25b-e8fee9ba3a86 None None] MFA Rules not processed for user `14454f7e0b2b42f2a216ff68d3d7061a`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:40:15.443805 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-60159d5a-7ff8-4e88-b25b-e8fee9ba3a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:40:15.447637 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:40:15.515334 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1446/2910] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:40:15 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:40:15.527100 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc6197-7ada-448f-ad7c-95b3d1b1dc19 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:15.528885 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-77fc6197-7ada-448f-ad7c-95b3d1b1dc19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:40:15.585700 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc6197-7ada-448f-ad7c-95b3d1b1dc19 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:15.589355 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b280e8f-8daf-49f5-bf30-52be89b661d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a147e14b61d481db1cac02c58ac3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:15.589951 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b280e8f-8daf-49f5-bf30-52be89b661d8 service cinder] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:15.590228 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b280e8f-8daf-49f5-bf30-52be89b661d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:15.590516 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b280e8f-8daf-49f5-bf30-52be89b661d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:15.600000 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b280e8f-8daf-49f5-bf30-52be89b661d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:15.601440 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b280e8f-8daf-49f5-bf30-52be89b661d8 service cinder] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:15.611261 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1465/2911] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:40:15 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:40:15.691420 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60159d5a-7ff8-4e88-b25b-e8fee9ba3a86 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:15.701214 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60159d5a-7ff8-4e88-b25b-e8fee9ba3a86 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:15.704807 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f70af9-d30e-48ab-8ea9-95eff7149a29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a147e14b61d481db1cac02c58ac3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:15.705400 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f70af9-d30e-48ab-8ea9-95eff7149a29 service cinder] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:15.706223 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f70af9-d30e-48ab-8ea9-95eff7149a29 service cinder] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:15.706492 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f70af9-d30e-48ab-8ea9-95eff7149a29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:15.762482 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f70af9-d30e-48ab-8ea9-95eff7149a29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:15.763944 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f70af9-d30e-48ab-8ea9-95eff7149a29 service cinder] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:15.772664 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1447/2912] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:40:15 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:40:20.456697 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b280e8f-8daf-49f5-bf30-52be89b661d8 service cinder] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:20.518724 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b280e8f-8daf-49f5-bf30-52be89b661d8 service cinder] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:20.523229 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb62d7c-ebec-43b0-9aa8-97f5c83b8454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:20.523875 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb62d7c-ebec-43b0-9aa8-97f5c83b8454 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:20.524151 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb62d7c-ebec-43b0-9aa8-97f5c83b8454 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:20.524420 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb62d7c-ebec-43b0-9aa8-97f5c83b8454 admin admin] PATH_INFO: `/v3/users/4cc058701f8d44be9b2c43fe67c29bf8` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:20.525518 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb62d7c-ebec-43b0-9aa8-97f5c83b8454 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cc058701f8d44be9b2c43fe67c29bf8)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:20.527419 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb62d7c-ebec-43b0-9aa8-97f5c83b8454 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:20.572250 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-7fb62d7c-ebec-43b0-9aa8-97f5c83b8454 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cc058701f8d44be9b2c43fe67c29bf8'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:20.583621 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-7fb62d7c-ebec-43b0-9aa8-97f5c83b8454 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cc058701f8d44be9b2c43fe67c29bf8'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:20.585570 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:40:20.592928 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-7fb62d7c-ebec-43b0-9aa8-97f5c83b8454 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cc058701f8d44be9b2c43fe67c29bf8'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:20.600956 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-7fb62d7c-ebec-43b0-9aa8-97f5c83b8454 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cc058701f8d44be9b2c43fe67c29bf8'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:20.601553 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-7fb62d7c-ebec-43b0-9aa8-97f5c83b8454 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cc058701f8d44be9b2c43fe67c29bf8'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:20.607567 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1466/2913] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:40:20 2022] DELETE /identity/v3/users/4cc058701f8d44be9b2c43fe67c29bf8 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:40:20.612831 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a8ec5d-147e-411c-bd31-5d126c1fac79 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:20.613429 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a8ec5d-147e-411c-bd31-5d126c1fac79 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:20.613551 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a8ec5d-147e-411c-bd31-5d126c1fac79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:20.632123 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-c4a8ec5d-147e-411c-bd31-5d126c1fac79 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:40:20.633321 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-c4a8ec5d-147e-411c-bd31-5d126c1fac79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:40:20.697629 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1448/2914] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:40:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:40:20.707911 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb62d7c-ebec-43b0-9aa8-97f5c83b8454 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:20.709311 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-7fb62d7c-ebec-43b0-9aa8-97f5c83b8454 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:40:20.765591 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb62d7c-ebec-43b0-9aa8-97f5c83b8454 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:20.769800 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f8899c-3ea2-49aa-88bd-3622ac5ddc03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:20.770402 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f8899c-3ea2-49aa-88bd-3622ac5ddc03 service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:20.770680 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f8899c-3ea2-49aa-88bd-3622ac5ddc03 service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:20.770953 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f8899c-3ea2-49aa-88bd-3622ac5ddc03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:20.779829 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f8899c-3ea2-49aa-88bd-3622ac5ddc03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:20.781265 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f8899c-3ea2-49aa-88bd-3622ac5ddc03 service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:20.791557 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1467/2915] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:40:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:40:21.058647 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a8ec5d-147e-411c-bd31-5d126c1fac79 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:21.061187 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-c4a8ec5d-147e-411c-bd31-5d126c1fac79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:40:21.074209 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a8ec5d-147e-411c-bd31-5d126c1fac79 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:21.078815 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2183265b-ae00-4693-99da-bd513e8fabf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:21.079447 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2183265b-ae00-4693-99da-bd513e8fabf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:21.079749 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2183265b-ae00-4693-99da-bd513e8fabf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:21.080024 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2183265b-ae00-4693-99da-bd513e8fabf6 admin admin] PATH_INFO: `/v3/projects/eccaf4d4f4f841df9f35c066a88f123d` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:21.081696 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2183265b-ae00-4693-99da-bd513e8fabf6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eccaf4d4f4f841df9f35c066a88f123d)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:21.083613 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2183265b-ae00-4693-99da-bd513e8fabf6 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:21.120548 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:40:21.131469 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-2183265b-ae00-4693-99da-bd513e8fabf6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eccaf4d4f4f841df9f35c066a88f123d', 'request_id': 'req-2183265b-ae00-4693-99da-bd513e8fabf6'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:21.138687 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-2183265b-ae00-4693-99da-bd513e8fabf6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eccaf4d4f4f841df9f35c066a88f123d', 'request_id': 'req-2183265b-ae00-4693-99da-bd513e8fabf6'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:21.145098 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-2183265b-ae00-4693-99da-bd513e8fabf6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eccaf4d4f4f841df9f35c066a88f123d', 'request_id': 'req-2183265b-ae00-4693-99da-bd513e8fabf6'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:21.156091 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-2183265b-ae00-4693-99da-bd513e8fabf6 admin admin] The token cache is being invalidate because project eccaf4d4f4f841df9f35c066a88f123d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81383) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:40:21.156378 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-2183265b-ae00-4693-99da-bd513e8fabf6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:21.157000 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-2183265b-ae00-4693-99da-bd513e8fabf6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:21.158456 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1449/2916] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:40:21 2022] DELETE /identity/v3/projects/eccaf4d4f4f841df9f35c066a88f123d => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:40:21.162497 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f8899c-3ea2-49aa-88bd-3622ac5ddc03 service neutron] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:21.172172 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f8899c-3ea2-49aa-88bd-3622ac5ddc03 service neutron] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:21.227255 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04cdce0-ab66-4b89-9d1e-8a0622411719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:21.227922 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04cdce0-ab66-4b89-9d1e-8a0622411719 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:21.228201 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04cdce0-ab66-4b89-9d1e-8a0622411719 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:21.228476 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04cdce0-ab66-4b89-9d1e-8a0622411719 admin admin] PATH_INFO: `/v3/users/14454f7e0b2b42f2a216ff68d3d7061a` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:21.229594 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04cdce0-ab66-4b89-9d1e-8a0622411719 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14454f7e0b2b42f2a216ff68d3d7061a)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:21.231849 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04cdce0-ab66-4b89-9d1e-8a0622411719 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:21.276709 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-e04cdce0-ab66-4b89-9d1e-8a0622411719 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14454f7e0b2b42f2a216ff68d3d7061a'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:21.288432 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-e04cdce0-ab66-4b89-9d1e-8a0622411719 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14454f7e0b2b42f2a216ff68d3d7061a'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:21.295192 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-e04cdce0-ab66-4b89-9d1e-8a0622411719 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14454f7e0b2b42f2a216ff68d3d7061a'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:21.302734 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-e04cdce0-ab66-4b89-9d1e-8a0622411719 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14454f7e0b2b42f2a216ff68d3d7061a'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:21.303369 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-e04cdce0-ab66-4b89-9d1e-8a0622411719 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14454f7e0b2b42f2a216ff68d3d7061a'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:21.309472 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1468/2917] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:40:21 2022] DELETE /identity/v3/users/14454f7e0b2b42f2a216ff68d3d7061a => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:40:21.582923 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2183265b-ae00-4693-99da-bd513e8fabf6 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:21.584441 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-2183265b-ae00-4693-99da-bd513e8fabf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:40:21.598197 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2183265b-ae00-4693-99da-bd513e8fabf6 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:21.655242 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bb8681-609b-4153-afd9-849fdd5d9d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:21.655929 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb8681-609b-4153-afd9-849fdd5d9d60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:21.656247 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb8681-609b-4153-afd9-849fdd5d9d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:21.656447 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb8681-609b-4153-afd9-849fdd5d9d60 admin admin] PATH_INFO: `/v3/projects/36c2130faa5b4977bac632578deecaee` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:21.657566 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bb8681-609b-4153-afd9-849fdd5d9d60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36c2130faa5b4977bac632578deecaee)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:21.659494 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bb8681-609b-4153-afd9-849fdd5d9d60 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:21.706063 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-a8bb8681-609b-4153-afd9-849fdd5d9d60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36c2130faa5b4977bac632578deecaee', 'request_id': 'req-a8bb8681-609b-4153-afd9-849fdd5d9d60'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:21.713406 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-a8bb8681-609b-4153-afd9-849fdd5d9d60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36c2130faa5b4977bac632578deecaee', 'request_id': 'req-a8bb8681-609b-4153-afd9-849fdd5d9d60'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:21.719044 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-a8bb8681-609b-4153-afd9-849fdd5d9d60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36c2130faa5b4977bac632578deecaee', 'request_id': 'req-a8bb8681-609b-4153-afd9-849fdd5d9d60'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:21.729858 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-a8bb8681-609b-4153-afd9-849fdd5d9d60 admin admin] The token cache is being invalidate because project 36c2130faa5b4977bac632578deecaee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81383) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:40:21.730398 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-a8bb8681-609b-4153-afd9-849fdd5d9d60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:21.731015 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-a8bb8681-609b-4153-afd9-849fdd5d9d60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:40:21.732547 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1450/2918] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:40:21 2022] DELETE /identity/v3/projects/36c2130faa5b4977bac632578deecaee => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:40:21.737844 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b898f0fb-67d7-49f6-a1a1-0dd8b909bf1f None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:21.738300 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b898f0fb-67d7-49f6-a1a1-0dd8b909bf1f None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:21.738412 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b898f0fb-67d7-49f6-a1a1-0dd8b909bf1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:21.752104 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:40:21.758993 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-b898f0fb-67d7-49f6-a1a1-0dd8b909bf1f None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:40:21.760824 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-b898f0fb-67d7-49f6-a1a1-0dd8b909bf1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:40:21.819943 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1469/2919] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:40:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:40:21.827903 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4532684-6892-4e3b-ae6c-d9a9e3162496 None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:21.828230 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4532684-6892-4e3b-ae6c-d9a9e3162496 None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:21.828501 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4532684-6892-4e3b-ae6c-d9a9e3162496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:21.848289 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-d4532684-6892-4e3b-ae6c-d9a9e3162496 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:40:21.849471 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-d4532684-6892-4e3b-ae6c-d9a9e3162496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:40:21.857390 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1451/2920] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:40:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 05:40:21.861431 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b898f0fb-67d7-49f6-a1a1-0dd8b909bf1f None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:21.871823 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b898f0fb-67d7-49f6-a1a1-0dd8b909bf1f None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:21.876421 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06186bdb-47af-44da-95df-ccb79211e0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:21.877017 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06186bdb-47af-44da-95df-ccb79211e0bc admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:21.877299 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06186bdb-47af-44da-95df-ccb79211e0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:21.877604 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06186bdb-47af-44da-95df-ccb79211e0bc admin admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:21.878283 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06186bdb-47af-44da-95df-ccb79211e0bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 05:40:21.878592 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06186bdb-47af-44da-95df-ccb79211e0bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:21.880241 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06186bdb-47af-44da-95df-ccb79211e0bc admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:21.891560 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1470/2921] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 05:40:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 05:40:21.895575 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4532684-6892-4e3b-ae6c-d9a9e3162496 None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:21.904642 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4532684-6892-4e3b-ae6c-d9a9e3162496 None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:21.910051 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747e56c9-d408-4b6b-932b-4a3e19e56fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:21.910672 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e56c9-d408-4b6b-932b-4a3e19e56fa7 admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:21.911018 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e56c9-d408-4b6b-932b-4a3e19e56fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:21.911352 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e56c9-d408-4b6b-932b-4a3e19e56fa7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:21.912086 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747e56c9-d408-4b6b-932b-4a3e19e56fa7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:21.914055 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747e56c9-d408-4b6b-932b-4a3e19e56fa7 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:21.942384 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1452/2922] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:40:21 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 05:40:21.946734 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06186bdb-47af-44da-95df-ccb79211e0bc admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:21.956606 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06186bdb-47af-44da-95df-ccb79211e0bc admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:22.014292 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f79b51-fee5-47eb-a3c6-ab4640673aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:22.014930 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f79b51-fee5-47eb-a3c6-ab4640673aac admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:22.015209 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f79b51-fee5-47eb-a3c6-ab4640673aac admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:22.015481 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f79b51-fee5-47eb-a3c6-ab4640673aac admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:22.016145 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f79b51-fee5-47eb-a3c6-ab4640673aac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:22.018080 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f79b51-fee5-47eb-a3c6-ab4640673aac admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:22.041292 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1471/2923] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:40:21 2022] POST /identity/v3/users => generated 286 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 05:40:22.045364 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747e56c9-d408-4b6b-932b-4a3e19e56fa7 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:22.056190 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747e56c9-d408-4b6b-932b-4a3e19e56fa7 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:22.060806 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bf7195-303d-4473-a4a0-77daf610998a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:22.061402 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf7195-303d-4473-a4a0-77daf610998a admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:22.061679 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf7195-303d-4473-a4a0-77daf610998a admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:22.061950 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf7195-303d-4473-a4a0-77daf610998a admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:22.062590 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bf7195-303d-4473-a4a0-77daf610998a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:22.064215 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bf7195-303d-4473-a4a0-77daf610998a admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:22.074038 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1453/2924] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:40:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:40:22.077753 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f79b51-fee5-47eb-a3c6-ab4640673aac admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:22.087741 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f79b51-fee5-47eb-a3c6-ab4640673aac admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:22.092396 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee51d44-3890-4b74-91be-f670cdeedae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:22.092985 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee51d44-3890-4b74-91be-f670cdeedae6 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:22.093265 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee51d44-3890-4b74-91be-f670cdeedae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:22.093534 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee51d44-3890-4b74-91be-f670cdeedae6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:22.094167 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee51d44-3890-4b74-91be-f670cdeedae6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:22.095795 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee51d44-3890-4b74-91be-f670cdeedae6 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:22.106993 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1472/2925] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:40:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:40:22.110898 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bf7195-303d-4473-a4a0-77daf610998a admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:22.121474 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bf7195-303d-4473-a4a0-77daf610998a admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:22.125984 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8386a7-bf82-4c57-8400-f095fda5834b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:22.126652 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8386a7-bf82-4c57-8400-f095fda5834b admin admin] REQUEST_METHOD: `PUT` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:22.126928 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8386a7-bf82-4c57-8400-f095fda5834b admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:22.127198 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8386a7-bf82-4c57-8400-f095fda5834b admin admin] PATH_INFO: `/v3/projects/f7877a547d334ea985849f7b094f33ac/users/bb2b9ccf42aa4072a21b4ac8b665979d/roles/aa7ff8e0ec1e48e5811335b9eb38b448` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:22.138345 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:40:22.143656 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8386a7-bf82-4c57-8400-f095fda5834b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7877a547d334ea985849f7b094f33ac, user_id=bb2b9ccf42aa4072a21b4ac8b665979d, role_id=aa7ff8e0ec1e48e5811335b9eb38b448)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:22.146844 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8386a7-bf82-4c57-8400-f095fda5834b admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:22.159820 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1454/2926] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:40:22 2022] PUT /identity/v3/projects/f7877a547d334ea985849f7b094f33ac/users/bb2b9ccf42aa4072a21b4ac8b665979d/roles/aa7ff8e0ec1e48e5811335b9eb38b448 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:40:22.164836 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd24d1-f758-4099-b0dc-355e60ec9ce8 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:22.165061 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd24d1-f758-4099-b0dc-355e60ec9ce8 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:22.165330 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd24d1-f758-4099-b0dc-355e60ec9ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:22.184197 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-01dd24d1-f758-4099-b0dc-355e60ec9ce8 None None] MFA Rules not processed for user `dd85f0a5ebc14829989036033392af00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:40:22.185374 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-01dd24d1-f758-4099-b0dc-355e60ec9ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:40:22.243085 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1473/2927] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:40:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:40:22.252562 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8386a7-bf82-4c57-8400-f095fda5834b admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:22.254256 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-ec8386a7-bf82-4c57-8400-f095fda5834b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:40:22.310816 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8386a7-bf82-4c57-8400-f095fda5834b admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:22.314542 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eae487-3865-408d-9a48-d980afe57548 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:22.315124 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eae487-3865-408d-9a48-d980afe57548 service neutron] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:22.315402 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eae487-3865-408d-9a48-d980afe57548 service neutron] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:22.315697 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eae487-3865-408d-9a48-d980afe57548 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:22.324798 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eae487-3865-408d-9a48-d980afe57548 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:22.326251 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eae487-3865-408d-9a48-d980afe57548 service neutron] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:22.336194 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1455/2928] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:40:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:40:26.300411 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38773a70-56c0-4e81-9f49-db6e134cb767 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:26.300938 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38773a70-56c0-4e81-9f49-db6e134cb767 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:26.301173 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38773a70-56c0-4e81-9f49-db6e134cb767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:26.328839 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:40:26.332200 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-38773a70-56c0-4e81-9f49-db6e134cb767 None None] MFA Rules not processed for user `bb2b9ccf42aa4072a21b4ac8b665979d`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:40:26.334111 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-38773a70-56c0-4e81-9f49-db6e134cb767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:40:26.407516 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1474/2929] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:40:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:40:26.409735 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eae487-3865-408d-9a48-d980afe57548 service neutron] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:26.419878 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eae487-3865-408d-9a48-d980afe57548 service neutron] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:26.425100 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615406a4-097f-40b6-866c-ea4b86f48d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:26.425697 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615406a4-097f-40b6-866c-ea4b86f48d09 admin admin] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:26.425976 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615406a4-097f-40b6-866c-ea4b86f48d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:26.426251 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615406a4-097f-40b6-866c-ea4b86f48d09 admin admin] PATH_INFO: `/v3/projects` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:26.426887 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615406a4-097f-40b6-866c-ea4b86f48d09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:26.428822 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615406a4-097f-40b6-866c-ea4b86f48d09 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:26.456075 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1456/2930] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 05:40:26 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:40:26.460067 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38773a70-56c0-4e81-9f49-db6e134cb767 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:26.472133 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38773a70-56c0-4e81-9f49-db6e134cb767 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:26.530818 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb02ccd9-b5c1-4206-9f53-c71cd74073ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:26.531453 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb02ccd9-b5c1-4206-9f53-c71cd74073ce admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:26.531762 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb02ccd9-b5c1-4206-9f53-c71cd74073ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:26.532040 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb02ccd9-b5c1-4206-9f53-c71cd74073ce admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:26.532680 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb02ccd9-b5c1-4206-9f53-c71cd74073ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:26.535175 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb02ccd9-b5c1-4206-9f53-c71cd74073ce admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:26.556748 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1475/2931] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 05:40:26 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 05:40:26.560551 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615406a4-097f-40b6-866c-ea4b86f48d09 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:26.570672 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615406a4-097f-40b6-866c-ea4b86f48d09 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:26.575189 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea050879-b281-4103-bdd6-4aa1c09a4cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:26.575818 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea050879-b281-4103-bdd6-4aa1c09a4cdd admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:26.576096 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea050879-b281-4103-bdd6-4aa1c09a4cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:26.576364 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea050879-b281-4103-bdd6-4aa1c09a4cdd admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:26.576994 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea050879-b281-4103-bdd6-4aa1c09a4cdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:26.578576 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea050879-b281-4103-bdd6-4aa1c09a4cdd admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:26.588956 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1457/2932] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:40:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:40:26.592931 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb02ccd9-b5c1-4206-9f53-c71cd74073ce admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:26.603325 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb02ccd9-b5c1-4206-9f53-c71cd74073ce admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:26.608194 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3716f1d0-b671-4f83-a5d8-3f8d7203474c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:26.608839 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3716f1d0-b671-4f83-a5d8-3f8d7203474c admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:26.609114 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3716f1d0-b671-4f83-a5d8-3f8d7203474c admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:26.609386 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3716f1d0-b671-4f83-a5d8-3f8d7203474c admin admin] PATH_INFO: `/v3/projects/3d7b6e6c4d954273be778130ba456135/users/fc147cd34dc4418e8ee4e1e6dde7fa0e/roles/5b702713e40145b49e0b42abd0a5fba9` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:26.624816 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3716f1d0-b671-4f83-a5d8-3f8d7203474c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d7b6e6c4d954273be778130ba456135, user_id=fc147cd34dc4418e8ee4e1e6dde7fa0e, role_id=5b702713e40145b49e0b42abd0a5fba9)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:26.628083 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3716f1d0-b671-4f83-a5d8-3f8d7203474c admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:26.641311 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1476/2933] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:40:26 2022] PUT /identity/v3/projects/3d7b6e6c4d954273be778130ba456135/users/fc147cd34dc4418e8ee4e1e6dde7fa0e/roles/5b702713e40145b49e0b42abd0a5fba9 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:40:26.645878 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea050879-b281-4103-bdd6-4aa1c09a4cdd admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:26.655746 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea050879-b281-4103-bdd6-4aa1c09a4cdd admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:26.711892 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3311b23b-540e-45fd-998f-9a06fcc0fa9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:26.712558 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3311b23b-540e-45fd-998f-9a06fcc0fa9e admin admin] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:26.712841 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3311b23b-540e-45fd-998f-9a06fcc0fa9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:26.713114 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3311b23b-540e-45fd-998f-9a06fcc0fa9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:26.713755 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3311b23b-540e-45fd-998f-9a06fcc0fa9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:26.715367 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3311b23b-540e-45fd-998f-9a06fcc0fa9e admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:26.725654 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1458/2934] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 05:40:26 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 05:40:26.730475 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3716f1d0-b671-4f83-a5d8-3f8d7203474c admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:26.741343 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3716f1d0-b671-4f83-a5d8-3f8d7203474c admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:26.746100 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3316b4-32f7-4bc5-a4b6-08ff919973c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:26.746735 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3316b4-32f7-4bc5-a4b6-08ff919973c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:26.747058 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3316b4-32f7-4bc5-a4b6-08ff919973c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:26.747277 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3316b4-32f7-4bc5-a4b6-08ff919973c2 admin admin] PATH_INFO: `/v3/projects/3d7b6e6c4d954273be778130ba456135/users/fc147cd34dc4418e8ee4e1e6dde7fa0e/roles/5b702713e40145b49e0b42abd0a5fba9` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:26.749189 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3316b4-32f7-4bc5-a4b6-08ff919973c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d7b6e6c4d954273be778130ba456135, user_id=fc147cd34dc4418e8ee4e1e6dde7fa0e, role_id=5b702713e40145b49e0b42abd0a5fba9)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:26.751893 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3316b4-32f7-4bc5-a4b6-08ff919973c2 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:26.762963 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1477/2935] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 05:40:26 2022] PUT /identity/v3/projects/3d7b6e6c4d954273be778130ba456135/users/fc147cd34dc4418e8ee4e1e6dde7fa0e/roles/5b702713e40145b49e0b42abd0a5fba9 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:40:31.136981 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308048c6-3d69-40e0-8e5f-897b386e76ab None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:31.137587 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308048c6-3d69-40e0-8e5f-897b386e76ab None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:31.139317 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308048c6-3d69-40e0-8e5f-897b386e76ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:31.177164 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-308048c6-3d69-40e0-8e5f-897b386e76ab None None] MFA Rules not processed for user `fc147cd34dc4418e8ee4e1e6dde7fa0e`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:40:31.179273 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-308048c6-3d69-40e0-8e5f-897b386e76ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:40:31.247738 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:40:31.283563 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1459/2936] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:40:31 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:40:31.300574 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3316b4-32f7-4bc5-a4b6-08ff919973c2 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:31.302457 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-fe3316b4-32f7-4bc5-a4b6-08ff919973c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:40:31.370364 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:40:31.399839 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3316b4-32f7-4bc5-a4b6-08ff919973c2 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:31.405699 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e826ff-9ca8-4a45-bc25-efa9c4dcb9f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cd6136036bd467c946cae90d5c29263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:31.406406 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e826ff-9ca8-4a45-bc25-efa9c4dcb9f7 service nova] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:31.406754 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e826ff-9ca8-4a45-bc25-efa9c4dcb9f7 service nova] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:31.407100 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e826ff-9ca8-4a45-bc25-efa9c4dcb9f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:31.470549 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e826ff-9ca8-4a45-bc25-efa9c4dcb9f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:31.472827 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e826ff-9ca8-4a45-bc25-efa9c4dcb9f7 service nova] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:31.482708 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1478/2937] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:40:31 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:40:32.482867 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd2e7a2-55d9-4f83-886e-e144aa1ab4fc None None] REQUEST_METHOD: `POST` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:32.483367 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd2e7a2-55d9-4f83-886e-e144aa1ab4fc None None] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:32.483469 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd2e7a2-55d9-4f83-886e-e144aa1ab4fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:32.503172 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.auth.core [None req-3dd2e7a2-55d9-4f83-886e-e144aa1ab4fc None None] MFA Rules not processed for user `bb2b9ccf42aa4072a21b4ac8b665979d`. Rule list: `[]` (Enabled: `True`). {{(pid=81383) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 05:40:32.504419 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-3dd2e7a2-55d9-4f83-886e-e144aa1ab4fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:40:32.511498 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1460/2938] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 05:40:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 05:40:41.478003 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=31 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:40:42.497521 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=12 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:40:44.875669 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e826ff-9ca8-4a45-bc25-efa9c4dcb9f7 service nova] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:44.930459 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e826ff-9ca8-4a45-bc25-efa9c4dcb9f7 service nova] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:44.934083 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771f2400-e6be-4e63-8823-91accd9d14b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:44.934686 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f2400-e6be-4e63-8823-91accd9d14b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:44.934964 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f2400-e6be-4e63-8823-91accd9d14b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:44.935237 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f2400-e6be-4e63-8823-91accd9d14b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:44.936992 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-771f2400-e6be-4e63-8823-91accd9d14b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:40:44.947121 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771f2400-e6be-4e63-8823-91accd9d14b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:44.948641 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771f2400-e6be-4e63-8823-91accd9d14b4 service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:44.957305 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1479/2939] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:40:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:40:45.400912 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd2e7a2-55d9-4f83-886e-e144aa1ab4fc None None] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:45.402375 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-3dd2e7a2-55d9-4f83-886e-e144aa1ab4fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:40:45.481972 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd2e7a2-55d9-4f83-886e-e144aa1ab4fc None None] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:45.486965 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95948aa2-4eb8-4c1d-b638-322a0a767ae8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72e1d7dd79ff43e7b585b5090762465f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:45.487619 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95948aa2-4eb8-4c1d-b638-322a0a767ae8 service placement] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:45.487926 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95948aa2-4eb8-4c1d-b638-322a0a767ae8 service placement] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:45.488201 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95948aa2-4eb8-4c1d-b638-322a0a767ae8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:45.489936 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-95948aa2-4eb8-4c1d-b638-322a0a767ae8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:40:45.501188 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95948aa2-4eb8-4c1d-b638-322a0a767ae8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:45.502763 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95948aa2-4eb8-4c1d-b638-322a0a767ae8 service placement] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:45.513155 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1461/2940] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:40:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:40:47.181587 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771f2400-e6be-4e63-8823-91accd9d14b4 service neutron] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:47.183060 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-771f2400-e6be-4e63-8823-91accd9d14b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:40:47.194060 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771f2400-e6be-4e63-8823-91accd9d14b4 service neutron] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:47.197733 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acc8215-57a9-4595-b3b4-0c2ed717d67d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:47.198343 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc8215-57a9-4595-b3b4-0c2ed717d67d service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:47.198618 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc8215-57a9-4595-b3b4-0c2ed717d67d service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:47.198889 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc8215-57a9-4595-b3b4-0c2ed717d67d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:47.200685 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-9acc8215-57a9-4595-b3b4-0c2ed717d67d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:40:47.211366 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acc8215-57a9-4595-b3b4-0c2ed717d67d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:47.212980 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acc8215-57a9-4595-b3b4-0c2ed717d67d service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:47.221836 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1480/2941] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:40:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:40:47.924720 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95948aa2-4eb8-4c1d-b638-322a0a767ae8 service placement] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:47.926436 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-95948aa2-4eb8-4c1d-b638-322a0a767ae8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:40:47.944250 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95948aa2-4eb8-4c1d-b638-322a0a767ae8 service placement] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:47.950434 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef701d6-e514-4d0e-80a6-e2b587ccc5b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cd6136036bd467c946cae90d5c29263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:47.951170 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef701d6-e514-4d0e-80a6-e2b587ccc5b1 service nova] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:47.951541 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef701d6-e514-4d0e-80a6-e2b587ccc5b1 service nova] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:47.951934 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef701d6-e514-4d0e-80a6-e2b587ccc5b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:47.954173 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-0ef701d6-e514-4d0e-80a6-e2b587ccc5b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:40:47.967625 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef701d6-e514-4d0e-80a6-e2b587ccc5b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:47.969406 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef701d6-e514-4d0e-80a6-e2b587ccc5b1 service nova] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:47.980935 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1462/2942] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:40:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:40:52.553347 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acc8215-57a9-4595-b3b4-0c2ed717d67d service neutron] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:52.569415 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acc8215-57a9-4595-b3b4-0c2ed717d67d service neutron] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:52.574940 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c3835e-5dba-45b5-bb62-3cebc007056c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cd6136036bd467c946cae90d5c29263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:52.575540 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c3835e-5dba-45b5-bb62-3cebc007056c service nova] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:52.575849 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c3835e-5dba-45b5-bb62-3cebc007056c service nova] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:52.576121 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c3835e-5dba-45b5-bb62-3cebc007056c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:52.577833 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-70c3835e-5dba-45b5-bb62-3cebc007056c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:40:52.590000 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c3835e-5dba-45b5-bb62-3cebc007056c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:52.591588 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c3835e-5dba-45b5-bb62-3cebc007056c service nova] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:52.602334 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1481/2943] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:40:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:40:55.010656 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef701d6-e514-4d0e-80a6-e2b587ccc5b1 service nova] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:40:55.019995 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef701d6-e514-4d0e-80a6-e2b587ccc5b1 service nova] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:40:55.023509 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969dc201-4deb-43b7-bd2a-8b148a195d4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:40:55.024141 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969dc201-4deb-43b7-bd2a-8b148a195d4d service neutron] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:40:55.024421 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969dc201-4deb-43b7-bd2a-8b148a195d4d service neutron] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:40:55.024698 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969dc201-4deb-43b7-bd2a-8b148a195d4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:40:55.033564 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969dc201-4deb-43b7-bd2a-8b148a195d4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:40:55.034970 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969dc201-4deb-43b7-bd2a-8b148a195d4d service neutron] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:40:55.044446 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1463/2944] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:40:55 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:41:02.597494 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=38 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:41:05.040183 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=44 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:43:03.961970 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c3835e-5dba-45b5-bb62-3cebc007056c service nova] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:43:03.971274 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c3835e-5dba-45b5-bb62-3cebc007056c service nova] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:43:03.974947 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f036049f-7130-4b98-b32e-3a4412a485ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:43:03.975545 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f036049f-7130-4b98-b32e-3a4412a485ee service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:43:03.975859 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f036049f-7130-4b98-b32e-3a4412a485ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:43:03.976136 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f036049f-7130-4b98-b32e-3a4412a485ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:43:03.978368 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-f036049f-7130-4b98-b32e-3a4412a485ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:43:03.988119 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f036049f-7130-4b98-b32e-3a4412a485ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:43:03.989552 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f036049f-7130-4b98-b32e-3a4412a485ee service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:43:03.998099 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1482/2945] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:43:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:43:05.122653 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969dc201-4deb-43b7-bd2a-8b148a195d4d service neutron] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:43:05.132183 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969dc201-4deb-43b7-bd2a-8b148a195d4d service neutron] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:43:05.136720 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6dfe3f-95ae-4c53-aedc-f25110e4e0af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:43:05.137346 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6dfe3f-95ae-4c53-aedc-f25110e4e0af service neutron] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:43:05.137625 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6dfe3f-95ae-4c53-aedc-f25110e4e0af service neutron] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:43:05.137895 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6dfe3f-95ae-4c53-aedc-f25110e4e0af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:43:05.139710 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-7d6dfe3f-95ae-4c53-aedc-f25110e4e0af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:43:05.150561 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6dfe3f-95ae-4c53-aedc-f25110e4e0af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:43:05.154026 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6dfe3f-95ae-4c53-aedc-f25110e4e0af service neutron] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:43:05.162038 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1464/2946] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:43:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:43:05.254359 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f036049f-7130-4b98-b32e-3a4412a485ee service neutron] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:43:05.264759 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f036049f-7130-4b98-b32e-3a4412a485ee service neutron] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:43:05.268642 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6a7a51-3d22-408d-966b-9226aa336466 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72086abb4e0547dc96d76a44886805ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:43:05.269251 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a7a51-3d22-408d-966b-9226aa336466 service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:43:05.269746 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a7a51-3d22-408d-966b-9226aa336466 service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:43:05.270020 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a7a51-3d22-408d-966b-9226aa336466 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:43:05.271810 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-9c6a7a51-3d22-408d-966b-9226aa336466 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:43:05.286596 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6a7a51-3d22-408d-966b-9226aa336466 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:43:05.288142 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6a7a51-3d22-408d-966b-9226aa336466 service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:43:05.302197 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1483/2947] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:43:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:43:15.157106 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=6 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:43:15.295490 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=12 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:43:55.742730 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6dfe3f-95ae-4c53-aedc-f25110e4e0af service neutron] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:43:55.744138 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-7d6dfe3f-95ae-4c53-aedc-f25110e4e0af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:43:55.758865 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6dfe3f-95ae-4c53-aedc-f25110e4e0af service neutron] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:43:55.763947 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0196bbb-75c0-49eb-b2e9-7220975e302b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72e1d7dd79ff43e7b585b5090762465f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:43:55.764552 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0196bbb-75c0-49eb-b2e9-7220975e302b service placement] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:43:55.764983 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0196bbb-75c0-49eb-b2e9-7220975e302b service placement] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:43:55.765263 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0196bbb-75c0-49eb-b2e9-7220975e302b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:43:55.766954 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-e0196bbb-75c0-49eb-b2e9-7220975e302b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:43:55.778384 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0196bbb-75c0-49eb-b2e9-7220975e302b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:43:55.779989 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0196bbb-75c0-49eb-b2e9-7220975e302b service placement] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:43:55.790523 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1465/2948] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:43:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:44:05.785578 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=6 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:44:26.300174 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6a7a51-3d22-408d-966b-9226aa336466 service neutron] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:44:26.314683 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6a7a51-3d22-408d-966b-9226aa336466 service neutron] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:44:26.321770 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9021afed-0369-4195-a138-8afbe91f2d00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cd6136036bd467c946cae90d5c29263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:44:26.322495 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9021afed-0369-4195-a138-8afbe91f2d00 service nova] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:44:26.322850 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9021afed-0369-4195-a138-8afbe91f2d00 service nova] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:44:26.323212 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9021afed-0369-4195-a138-8afbe91f2d00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:44:26.325047 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-9021afed-0369-4195-a138-8afbe91f2d00 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:44:26.338529 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9021afed-0369-4195-a138-8afbe91f2d00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:44:26.340328 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9021afed-0369-4195-a138-8afbe91f2d00 service nova] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:44:26.352080 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1484/2949] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:44:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:44:33.319795 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0196bbb-75c0-49eb-b2e9-7220975e302b service placement] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:44:33.330484 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0196bbb-75c0-49eb-b2e9-7220975e302b service placement] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:44:33.335614 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19a0f5e-ce81-42f7-a631-7c654d60f5f3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72e1d7dd79ff43e7b585b5090762465f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:44:33.336467 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a0f5e-ce81-42f7-a631-7c654d60f5f3 service placement] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:44:33.336743 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a0f5e-ce81-42f7-a631-7c654d60f5f3 service placement] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:44:33.337012 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a0f5e-ce81-42f7-a631-7c654d60f5f3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:44:33.342624 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-c19a0f5e-ce81-42f7-a631-7c654d60f5f3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:44:33.356048 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19a0f5e-ce81-42f7-a631-7c654d60f5f3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:44:33.357653 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19a0f5e-ce81-42f7-a631-7c654d60f5f3 service placement] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:44:33.368766 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1466/2950] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:44:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:44:36.347079 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=6 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:44:36.367107 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9021afed-0369-4195-a138-8afbe91f2d00 service nova] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:44:36.378999 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9021afed-0369-4195-a138-8afbe91f2d00 service nova] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:44:36.385034 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96537761-7762-41e9-828b-6d507e14f86a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72e1d7dd79ff43e7b585b5090762465f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:44:36.385794 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96537761-7762-41e9-828b-6d507e14f86a service placement] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:44:36.386172 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96537761-7762-41e9-828b-6d507e14f86a service placement] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:44:36.386546 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96537761-7762-41e9-828b-6d507e14f86a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:44:36.388571 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-96537761-7762-41e9-828b-6d507e14f86a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:44:36.402939 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96537761-7762-41e9-828b-6d507e14f86a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:44:36.405059 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96537761-7762-41e9-828b-6d507e14f86a service placement] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:44:36.418775 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1485/2951] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:44:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:44:36.427436 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19a0f5e-ce81-42f7-a631-7c654d60f5f3 service placement] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:44:36.506982 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19a0f5e-ce81-42f7-a631-7c654d60f5f3 service placement] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:44:36.512127 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207196c9-07c3-48f0-b335-2cd9f7082897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:44:36.512757 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207196c9-07c3-48f0-b335-2cd9f7082897 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:44:36.513038 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207196c9-07c3-48f0-b335-2cd9f7082897 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:44:36.513316 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207196c9-07c3-48f0-b335-2cd9f7082897 admin admin] PATH_INFO: `/v3/users/bb2b9ccf42aa4072a21b4ac8b665979d` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:44:36.514449 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207196c9-07c3-48f0-b335-2cd9f7082897 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb2b9ccf42aa4072a21b4ac8b665979d)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:44:36.516426 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207196c9-07c3-48f0-b335-2cd9f7082897 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:44:36.568715 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-207196c9-07c3-48f0-b335-2cd9f7082897 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb2b9ccf42aa4072a21b4ac8b665979d'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:44:36.581004 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-207196c9-07c3-48f0-b335-2cd9f7082897 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb2b9ccf42aa4072a21b4ac8b665979d'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:44:36.587861 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-207196c9-07c3-48f0-b335-2cd9f7082897 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb2b9ccf42aa4072a21b4ac8b665979d'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:44:36.595435 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-207196c9-07c3-48f0-b335-2cd9f7082897 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb2b9ccf42aa4072a21b4ac8b665979d'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:44:36.596003 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-207196c9-07c3-48f0-b335-2cd9f7082897 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb2b9ccf42aa4072a21b4ac8b665979d'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:44:36.601901 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1467/2952] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:44:36 2022] DELETE /identity/v3/users/bb2b9ccf42aa4072a21b4ac8b665979d => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 05:44:36.771143 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96537761-7762-41e9-828b-6d507e14f86a service placement] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:44:36.781719 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96537761-7762-41e9-828b-6d507e14f86a service placement] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:44:36.838290 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1cc829-3b14-4c37-9d2c-c73c593ad243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:44:36.838925 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1cc829-3b14-4c37-9d2c-c73c593ad243 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:44:36.839207 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1cc829-3b14-4c37-9d2c-c73c593ad243 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:44:36.839485 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1cc829-3b14-4c37-9d2c-c73c593ad243 admin admin] PATH_INFO: `/v3/projects/f7877a547d334ea985849f7b094f33ac` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:44:36.840655 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1cc829-3b14-4c37-9d2c-c73c593ad243 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7877a547d334ea985849f7b094f33ac)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:44:36.842648 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1cc829-3b14-4c37-9d2c-c73c593ad243 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:44:36.900449 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-fe1cc829-3b14-4c37-9d2c-c73c593ad243 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7877a547d334ea985849f7b094f33ac', 'request_id': 'req-fe1cc829-3b14-4c37-9d2c-c73c593ad243'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:44:36.906525 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-fe1cc829-3b14-4c37-9d2c-c73c593ad243 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7877a547d334ea985849f7b094f33ac', 'request_id': 'req-fe1cc829-3b14-4c37-9d2c-c73c593ad243'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:44:36.912133 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-fe1cc829-3b14-4c37-9d2c-c73c593ad243 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7877a547d334ea985849f7b094f33ac', 'request_id': 'req-fe1cc829-3b14-4c37-9d2c-c73c593ad243'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:44:36.926673 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-fe1cc829-3b14-4c37-9d2c-c73c593ad243 admin admin] The token cache is being invalidate because project f7877a547d334ea985849f7b094f33ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:44:36.926962 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-fe1cc829-3b14-4c37-9d2c-c73c593ad243 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:44:36.927826 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-fe1cc829-3b14-4c37-9d2c-c73c593ad243 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:44:36.930064 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1486/2953] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:44:36 2022] DELETE /identity/v3/projects/f7877a547d334ea985849f7b094f33ac => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:44:36.935280 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207196c9-07c3-48f0-b335-2cd9f7082897 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:44:36.936748 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-207196c9-07c3-48f0-b335-2cd9f7082897 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:44:36.949825 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207196c9-07c3-48f0-b335-2cd9f7082897 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:44:37.008414 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a9d08e-a2cb-407d-90e6-c75a94118b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:44:37.009059 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a9d08e-a2cb-407d-90e6-c75a94118b96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:44:37.009341 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a9d08e-a2cb-407d-90e6-c75a94118b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:44:37.009615 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a9d08e-a2cb-407d-90e6-c75a94118b96 admin admin] PATH_INFO: `/v3/users/fc147cd34dc4418e8ee4e1e6dde7fa0e` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:44:37.010746 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a9d08e-a2cb-407d-90e6-c75a94118b96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc147cd34dc4418e8ee4e1e6dde7fa0e)` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:44:37.012751 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a9d08e-a2cb-407d-90e6-c75a94118b96 admin admin] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:44:37.018030 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:44:37.062699 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-93a9d08e-a2cb-407d-90e6-c75a94118b96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc147cd34dc4418e8ee4e1e6dde7fa0e'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:44:37.074876 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-93a9d08e-a2cb-407d-90e6-c75a94118b96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc147cd34dc4418e8ee4e1e6dde7fa0e'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:44:37.081700 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-93a9d08e-a2cb-407d-90e6-c75a94118b96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc147cd34dc4418e8ee4e1e6dde7fa0e'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:44:37.088883 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-93a9d08e-a2cb-407d-90e6-c75a94118b96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc147cd34dc4418e8ee4e1e6dde7fa0e'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:44:37.089588 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.notifications [None req-93a9d08e-a2cb-407d-90e6-c75a94118b96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc147cd34dc4418e8ee4e1e6dde7fa0e'} {{(pid=81383) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:44:37.095443 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1468/2954] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 05:44:36 2022] DELETE /identity/v3/users/fc147cd34dc4418e8ee4e1e6dde7fa0e => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:44:37.267672 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1cc829-3b14-4c37-9d2c-c73c593ad243 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:44:37.269183 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-fe1cc829-3b14-4c37-9d2c-c73c593ad243 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:44:37.284061 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1cc829-3b14-4c37-9d2c-c73c593ad243 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:44:37.341207 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8cfc23-c266-4d59-b72e-821cba32dc08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd85f0a5ebc14829989036033392af00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b45298f54324df991aa8efd3235c168', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:44:37.341836 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8cfc23-c266-4d59-b72e-821cba32dc08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:44:37.342213 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8cfc23-c266-4d59-b72e-821cba32dc08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:44:37.342496 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8cfc23-c266-4d59-b72e-821cba32dc08 admin admin] PATH_INFO: `/v3/projects/3d7b6e6c4d954273be778130ba456135` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:44:37.343634 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8cfc23-c266-4d59-b72e-821cba32dc08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d7b6e6c4d954273be778130ba456135)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:44:37.345577 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8cfc23-c266-4d59-b72e-821cba32dc08 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:44:37.367117 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:44:37.393090 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-da8cfc23-c266-4d59-b72e-821cba32dc08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d7b6e6c4d954273be778130ba456135', 'request_id': 'req-da8cfc23-c266-4d59-b72e-821cba32dc08'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:44:37.399019 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-da8cfc23-c266-4d59-b72e-821cba32dc08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d7b6e6c4d954273be778130ba456135', 'request_id': 'req-da8cfc23-c266-4d59-b72e-821cba32dc08'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:44:37.405067 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-da8cfc23-c266-4d59-b72e-821cba32dc08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d7b6e6c4d954273be778130ba456135', 'request_id': 'req-da8cfc23-c266-4d59-b72e-821cba32dc08'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:44:37.417244 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-da8cfc23-c266-4d59-b72e-821cba32dc08 admin admin] The token cache is being invalidate because project 3d7b6e6c4d954273be778130ba456135 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 05:44:37.417531 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-da8cfc23-c266-4d59-b72e-821cba32dc08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:44:37.418169 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-da8cfc23-c266-4d59-b72e-821cba32dc08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 05:44:37.419636 dv-cinder-856921-1-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1487/2955] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 05:44:37 2022] DELETE /identity/v3/projects/3d7b6e6c4d954273be778130ba456135 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 05:44:47.092132 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=23,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:44:47.413769 dv-cinder-856921-1-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:48:59.720445 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a9d08e-a2cb-407d-90e6-c75a94118b96 admin admin] Authenticating user token {{(pid=81383) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 05:48:59.721845 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-93a9d08e-a2cb-407d-90e6-c75a94118b96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:48:59.859847 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a9d08e-a2cb-407d-90e6-c75a94118b96 admin admin] Validating token access rules against request {{(pid=81383) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 05:48:59.917511 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068f2bbd-f7e6-4abe-8cf1-b8b54935e841 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72e1d7dd79ff43e7b585b5090762465f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61ffb079d9e1437084945554bcc0747b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81383) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 05:48:59.918111 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068f2bbd-f7e6-4abe-8cf1-b8b54935e841 service placement] REQUEST_METHOD: `GET` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 05:48:59.918387 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068f2bbd-f7e6-4abe-8cf1-b8b54935e841 service placement] SCRIPT_NAME: `/identity` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 05:48:59.918653 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068f2bbd-f7e6-4abe-8cf1-b8b54935e841 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81383) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 05:48:59.920356 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.fernet_utils [None req-068f2bbd-f7e6-4abe-8cf1-b8b54935e841 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81383) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 05:48:59.931281 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068f2bbd-f7e6-4abe-8cf1-b8b54935e841 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 05:48:59.932871 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068f2bbd-f7e6-4abe-8cf1-b8b54935e841 service placement] RBAC: Authorization granted {{(pid=81383) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 05:48:59.942581 dv-cinder-856921-1-smb devstack@keystone.service[81383]: [pid: 81383|app: 0|req: 1469/2956] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 05:48:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 05:49:09.938337 dv-cinder-856921-1-smb devstack@keystone.service[81383]: DEBUG dbcounter [-] [81383] Writing DB stats keystone:SELECT=89 {{(pid=81383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}